-- Logs begin at Fri 2022-07-15 19:51:33 UTC, end at Fri 2022-07-15 20:56:55 UTC. -- Jul 15 20:22:25.963963 dv-cinder-799871-35-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 15 20:22:25.973172 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 15 20:22:25.975647 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 20:22:25 2022] *** Jul 15 20:22:25.975647 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 20:22:25.975647 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 20:22:25.975647 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: nodename: dv-cinder-799871-35-iscsi Jul 15 20:22:25.975647 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: machine: x86_64 Jul 15 20:22:25.975647 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: clock source: unix Jul 15 20:22:25.975647 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: pcre jit disabled Jul 15 20:22:25.975647 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: detected number of CPU cores: 4 Jul 15 20:22:25.975647 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: current working directory: / Jul 15 20:22:25.975647 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: detected binary path: /usr/bin/uwsgi-core Jul 15 20:22:25.976294 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: your processes number limit is 47680 Jul 15 20:22:25.976294 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: your memory page size is 4096 bytes Jul 15 20:22:25.976294 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: detected max file descriptor number: 2048 Jul 15 20:22:25.976294 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: lock engine: pthread robust mutexes Jul 15 20:22:25.976294 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: thunder lock: enabled Jul 15 20:22:25.976294 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 15 20:22:25.976294 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 20:22:26.016731 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: Python main interpreter initialized at 0x5614363929c0 Jul 15 20:22:26.016731 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: python threads support enabled Jul 15 20:22:26.016731 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: your server socket listen backlog is limited to 100 connections Jul 15 20:22:26.016731 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: your mercy for graceful operations on workers is 90 seconds Jul 15 20:22:26.017060 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 20:22:26.017151 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: *** Operational MODE: preforking *** Jul 15 20:22:26.017420 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: *** uWSGI is running in multiple interpreter mode *** Jul 15 20:22:26.017420 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: spawned uWSGI master process (pid: 80242) Jul 15 20:22:26.017611 dv-cinder-799871-35-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 15 20:22:26.018767 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: spawned uWSGI worker 1 (pid: 80252, cores: 1) Jul 15 20:22:26.019072 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: spawned uWSGI worker 2 (pid: 80253, cores: 1) Jul 15 20:22:26.019288 dv-cinder-799871-35-iscsi devstack@keystone.service[80242]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 20:22:31.370656 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:22:31.370656 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: from cryptography.utils import int_from_bytes Jul 15 20:22:31.371440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:22:31.371440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: from cryptography.utils import int_from_bytes Jul 15 20:22:31.388541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:22:31.388541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: from cryptography.utils import int_from_bytes Jul 15 20:22:31.389006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:22:31.389006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: from cryptography.utils import int_from_bytes Jul 15 20:22:31.420594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 20:22:31.420767 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 20:22:31.420961 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] command line args: [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 20:22:31.421228 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 20:22:31.421404 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ================================================================================ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 20:22:31.421655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] admin_token = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.421899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] config_dir = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.422085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.422267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] config_source = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.422445 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] debug = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.422641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.423133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.423232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.423422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.423668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.423898 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.424076 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] log_config_append = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.424254 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.424451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] log_dir = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.424629 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] log_file = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.424866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.425116 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.425360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.425605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.425781 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.425956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.426199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.426443 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.426674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.426904 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.427136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.427366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.427610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.427852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.428124 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.428633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.428820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] publish_errors = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.429050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.429278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.429455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.429700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.429930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.430162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] standard_threads = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.430580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.430889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.431067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.431241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] use_journal = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.431417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] use_json = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.431592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] use_stderr = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.431766 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] use_syslog = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.431998 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.432254 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.432520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.432784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.433025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.433274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.433513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.433761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.434000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.434249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.434496 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.434746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.434983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.435230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.435467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.435714 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.435960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.436198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.436482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.436741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.436989 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.437070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 20:22:31.437226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.437303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 20:22:31.437422 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] command line args: [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 20:22:31.437504 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.437696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 20:22:31.437824 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.437899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ================================================================================ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 20:22:31.438013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.438135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] admin_token = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.438264 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.438382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] config_dir = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.438500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.438610 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.438705 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.438806 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] config_source = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.438899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.438991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] debug = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.439084 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.439262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.439361 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.439455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.439554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.439655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.439758 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.439860 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.439955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.440054 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.440148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.440240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.440344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] log_config_append = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.440484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.440581 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.440680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] log_dir = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.440785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.440894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] log_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.441001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.441103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.441221 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.441338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.441449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.441560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.441682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.441795 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.441916 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.442028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.442140 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.442258 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.442372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.442488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.442607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.442718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.442830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.442955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.443073 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.443185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.443296 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.443414 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.443530 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.443652 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.443764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.443874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.443991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.444109 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.444226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.444447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.444528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.444528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.444727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.444811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.444922 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] publish_errors = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.445000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.445179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.445255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.445647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.445762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.445836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.446429 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.446429 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.446664 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.446772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.446923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.447180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.447421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.447704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.447966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.448207 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.448478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.448739 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.449033 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.449287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.449547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.449812 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.450063 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.450321 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.450568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.450838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.450947 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.451086 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.451179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] standard_threads = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.451345 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.451440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.451599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.451712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.451858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.452010 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.452107 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.452184 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] use_journal = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.452322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] use_json = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.452461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.452633 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] use_stderr = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.452782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.452899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] use_syslog = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.453011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.453130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:22:31.453250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.453350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.453455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.453551 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.453645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.453821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.453925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.454094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.454213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.454357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.454477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.454603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.454727 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.454889 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.455007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.455160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.455263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.455440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.455583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.455717 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.455832 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.455992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.456103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.456253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.456451 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.456572 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.456685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.456785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.456899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.457063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.457179 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.457332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.457448 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.457594 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.457710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.457879 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.458026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.458145 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.458300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.458410 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.458568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.external = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.458679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.458831 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.458946 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.459166 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.459356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.459505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.459674 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.459845 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.password = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.460012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.460195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.token = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.460347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.460997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.461075 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.461194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.461279 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.461279 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.461409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.462134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.462221 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.462321 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.462444 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.462530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.462602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.462602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.462727 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.462811 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.462945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.463070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.463230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.463309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.463504 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.463582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.463774 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.463859 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.464038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.464114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.464304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.464380 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.464600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.464681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.464858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.464936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.465130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.465207 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.465436 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.465513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.465705 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.465795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.465999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.466076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.466264 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.466349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.466506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.466651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.466762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.466925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.467082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.467226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.467312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.467471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.467549 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.467718 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.467806 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.467949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.468028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.468195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.468273 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.468451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.468533 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.468697 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.468781 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.468935 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.469018 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.469176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.469253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.469418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.469497 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.469656 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.469733 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.469891 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.469966 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.470139 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.470218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.470380 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.470456 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.470613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.470689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.470847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.470957 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.471094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.471173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.471325 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.471410 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.471567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.471683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.471807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.471907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.472053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.472130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.472283 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.472362 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.472537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.472768 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.473013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.473133 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.473273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.473388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.473608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.473866 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.473940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.474102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.474368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.474446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.474606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.474680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.474841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.474914 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.475074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.475146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.475318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.475431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.476508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.476645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.476765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.476865 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.476980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.477172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.477310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.477479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.477584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.477723 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.477849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.477954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.478041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.478104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.478163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.478163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.478277 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.478374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.478374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.478485 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.478571 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.478632 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.478725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.478789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.478849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.478952 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.479017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.479120 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.479274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.479373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.479469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.479563 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.479644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.479706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.479777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.479921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.479995 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.480164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.480238 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.480417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.480506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.480708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.480773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.480924 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.481022 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.482401 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.482613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.482717 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.482816 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.482816 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.482994 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.483073 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.483144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.483206 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.483264 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.483720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.483794 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.external = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.483892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.483967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.484029 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.484087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.484145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.484324 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.484418 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.484484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.password = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.484543 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.484600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.token = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.484658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.484715 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.484786 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.484848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.484906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.484906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.485019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.485077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.485143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.485203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.485261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.485319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.485377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.485434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.485499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.485559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.485617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.486883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.487018 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.487128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.487236 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.487333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.487429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.487524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.487627 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.487724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.487829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.487932 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.488029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.488125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.488220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.488315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.488492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.488604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.488702 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.488798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.488798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.488975 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.489080 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.489296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.489397 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.489492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.489596 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.489693 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.489800 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.489897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.489992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.490088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.490184 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.490278 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.490391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.490488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.490583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.490685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.490787 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.490787 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.490973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.491070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.491171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.491268 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.491364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.491460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.491570 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.491668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.491774 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.491872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.491974 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.492126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.492255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.492360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.492580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.492685 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.492685 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.493282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.493595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.493595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] role.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.493952 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.494078 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] role.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.494176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.494278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.494384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.494509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.494608 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.494705 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.494868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.495000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.495146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.495279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.495279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.495407 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.495466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.495534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.495627 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.495627 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.495757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.495818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.496019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.496137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.496307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.496428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.496579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.496750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.496836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.497149 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.497235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.497974 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.498108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.498208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.498295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.498367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.498367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.498475 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.498534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.498598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.498659 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.498919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.499066 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.499171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.499256 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.499672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.499818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.499973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.499973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.500137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.500211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.500272 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.500441 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.500536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.500681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.500758 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.500820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.500957 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.501035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.501250 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.501338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.501479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.501558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.501697 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] token.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.501867 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.502006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.502106 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.502203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.502328 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.502434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.502584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.502698 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.502829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.502934 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.503073 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.503176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.503317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.503431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.503552 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.503655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.503949 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.504105 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.504105 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.504491 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.504598 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.504696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.504791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.504888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.504993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.505092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.505188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.505283 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.505379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.505474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.505651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.505752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.505849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.505945 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.506041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.506146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.506253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.506430 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.506558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.506808 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.506920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.507017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.507486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.507609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.507609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.507804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.507899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.508103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.508209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.508209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.509501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.509501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.509722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.510076 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.510076 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.510259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.510456 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.510531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.510603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.510603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.510841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.510915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.510915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.510915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 20:22:31.511306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.511404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.511646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.511936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.512454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.513066 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.513255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.513865 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.514367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.514559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.514818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.515221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.515484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.516882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.517153 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.517529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.517787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.518202 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.518761 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.519024 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.519286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.519548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.519798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.520067 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.520443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.520689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.521620 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.522058 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.522341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.522745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.523007 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.523462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.523694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.524381 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.524927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.525251 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.525503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.525769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.526035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.526608 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.526608 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.527869 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.528135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.528365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] role.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.528652 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] role.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.528898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.529161 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.529453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.529745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.529927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.530327 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.530448 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.530682 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.530939 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.531183 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.531439 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.531694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.531949 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.532203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.532665 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.532910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.533179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.533439 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.533696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.533955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.534205 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.534469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.534731 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.534977 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.535217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.535457 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.535695 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.535952 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.536215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.536504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.536751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.536994 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.537232 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.537475 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] token.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.537719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.537974 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.538217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.538480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.538734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.538976 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.539225 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.539476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.540439 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.540900 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.541164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.541415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.541680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.541942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.542182 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.542435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.542742 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.543010 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.543263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.543519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.543765 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.544015 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.544259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.544532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.544788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.545032 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.545122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.545286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.545365 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.545528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.545608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.545779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.546021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.546275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.546516 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.546767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.547003 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.547251 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.547492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:22:31.547666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 20:22:31.553814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.574708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.574945 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.575177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.581902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.582131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.583499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.601937 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.602751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.724802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.734043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.773232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.773466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.777092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.777334 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.838198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.838432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.838655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.838870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.839085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.839175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.839300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.839428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.839590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.839815 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.840036 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.840255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.863741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.863971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.864117 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.864219 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.864296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.864378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.864481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.864613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.864700 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.864825 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.864907 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.865037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.865120 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.865255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.876437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.877317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.889095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.889325 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.889547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.889755 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.889839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.889963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.890044 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.890171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.890255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.890380 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.890463 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.890624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.890839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.891056 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 20:22:31.907742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.907952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 20:22:31.908146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.908287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.908419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 20:22:31.908501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 20:22:31.908731 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.908938 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 20:22:31.909032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.909210 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.909303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.909473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.909554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.909727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.909806 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.909988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.920813 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.921087 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.921353 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.921633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.921824 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.922105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.922374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.922655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.929769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:31.931586 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:31.933567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:31.933847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.934129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.934410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.934690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.934913 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:31.934998 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.935196 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.935275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.935462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.935552 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.935728 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.935810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.935995 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.936075 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.936255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.936380 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.936680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.936960 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.937235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.937515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.937788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.963418 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.965045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:31.965322 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.965404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.967073 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:31.967355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.970520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:31.970798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.971076 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.972662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:31.972944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.973228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.978545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:31.978777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.981129 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:31.981414 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.983186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:31.983469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.983747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.984028 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.984301 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.984694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.984960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.985225 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.985901 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:31.986308 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.986598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.986884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.987166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.987446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.987719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:31.987994 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.004452 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.004725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.007438 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.007722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.009261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.012676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.013020 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.013314 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.016282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.016609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.018468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.021804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.022082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.026410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.026544 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.026703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.026987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.027277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.027561 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.027850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.030187 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.030492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.030780 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.031075 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.031366 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.031669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.047008 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.047288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.047551 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.047816 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.051266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.051558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.051827 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.052093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.056189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.057915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.058191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.060981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.061355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.061648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.061942 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.062220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.062502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.062707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.062987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.066060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.066345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.066629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.066921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.067198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.075630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.075908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.076188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.076494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.076772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.077055 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.077326 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.081132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.081415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.081694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.081974 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.082261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.082547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.082822 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.096402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.099620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.103280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.103457 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.105081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.106573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.106842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.107117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.107390 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.109944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.111554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.113308 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.113593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.113885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.114595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.116177 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.119462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.119748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.120030 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.120302 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.121704 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.123332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.126617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.126911 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.127215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.127480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.129468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.129750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.130025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.137490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.137778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.138163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.138447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.138743 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.139001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.139269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.139544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.139823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.140090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.140351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.140741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.141009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.141284 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.141555 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.141815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.142075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.146020 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 20:22:32.146305 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.146599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.146877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.147149 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.147436 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.147715 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.147991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.148271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.148566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.148846 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.149249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.149721 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.149990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 20:22:32.179952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5614363929c0 pid: 80252 (default app) Jul 15 20:22:32.183402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4fdd2-4f14-48eb-8f6b-63479726a430 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:32.183693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4fdd2-4f14-48eb-8f6b-63479726a430 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:32.183968 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4fdd2-4f14-48eb-8f6b-63479726a430 None None] PATH_INFO: `/v3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:32.188196 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 791 bytes} [Fri Jul 15 20:22:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:22:32.189062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5614363929c0 pid: 80253 (default app) Jul 15 20:22:39.965989 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e732a9-178b-4eea-9b1d-7f72c4675ebc None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:39.966543 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e732a9-178b-4eea-9b1d-7f72c4675ebc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:39.966543 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e732a9-178b-4eea-9b1d-7f72c4675ebc None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:39.968002 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:22:39.975418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873adb2-b4dd-4bae-a73c-bc03bac05584 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:39.975835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873adb2-b4dd-4bae-a73c-bc03bac05584 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:39.975980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873adb2-b4dd-4bae-a73c-bc03bac05584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:40.045083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: INFO dbcounter [None req-9873adb2-b4dd-4bae-a73c-bc03bac05584 None None] Registered counter for database keystone Jul 15 20:22:40.066204 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG oslo_db.sqlalchemy.engines [None req-9873adb2-b4dd-4bae-a73c-bc03bac05584 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:22:40.072472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writer thread running {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:22:40.257295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG passlib.handlers.bcrypt [None req-9873adb2-b4dd-4bae-a73c-bc03bac05584 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80253) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 20:22:40.257644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG passlib.handlers.bcrypt [None req-9873adb2-b4dd-4bae-a73c-bc03bac05584 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80253) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 20:22:40.314211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9873adb2-b4dd-4bae-a73c-bc03bac05584 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:40.315832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9873adb2-b4dd-4bae-a73c-bc03bac05584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:40.440347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1/3] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 20:22:40.590489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e732a9-178b-4eea-9b1d-7f72c4675ebc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:40.659382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: INFO dbcounter [None req-49e732a9-178b-4eea-9b1d-7f72c4675ebc None None] Registered counter for database keystone Jul 15 20:22:40.679151 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG oslo_db.sqlalchemy.engines [None req-49e732a9-178b-4eea-9b1d-7f72c4675ebc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:22:40.685980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writer thread running {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:22:40.805345 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e732a9-178b-4eea-9b1d-7f72c4675ebc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:40.811101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70cd9c-2617-4fca-b65a-157600a50670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:40.811861 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70cd9c-2617-4fca-b65a-157600a50670 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:40.812185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70cd9c-2617-4fca-b65a-157600a50670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:40.812517 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70cd9c-2617-4fca-b65a-157600a50670 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:40.820811 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70cd9c-2617-4fca-b65a-157600a50670 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:40.872727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cd70cd9c-2617-4fca-b65a-157600a50670 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 20:22:40.873015 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70cd9c-2617-4fca-b65a-157600a50670 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:40.882548 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 3/4] 10.222.0.66 () {58 vars in 1324 bytes} [Fri Jul 15 20:22:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 20:22:40.889248 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873adb2-b4dd-4bae-a73c-bc03bac05584 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:40.903723 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873adb2-b4dd-4bae-a73c-bc03bac05584 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:40.908148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e342349-1db3-4776-9d6d-0ef46055472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:40.909291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e342349-1db3-4776-9d6d-0ef46055472b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:40.909582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e342349-1db3-4776-9d6d-0ef46055472b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:40.909875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e342349-1db3-4776-9d6d-0ef46055472b admin admin] PATH_INFO: `/v3/projects/090394e10e7f467d9c567173bebe0143` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:40.913904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e342349-1db3-4776-9d6d-0ef46055472b admin admin] RBAC: Authorizing `identity:get_project(project_id=090394e10e7f467d9c567173bebe0143)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:40.966325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2e342349-1db3-4776-9d6d-0ef46055472b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 20:22:40.966671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e342349-1db3-4776-9d6d-0ef46055472b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:40.971360 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 2/5] 10.222.0.66 () {56 vars in 1207 bytes} [Fri Jul 15 20:22:40 2022] GET /identity/v3/projects/090394e10e7f467d9c567173bebe0143 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:22:42.936662 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deb403-1974-42b4-9c17-4cce4e0424ee None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:42.937175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deb403-1974-42b4-9c17-4cce4e0424ee None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:42.937265 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deb403-1974-42b4-9c17-4cce4e0424ee None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:42.941360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 4/6] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:22:42.946684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc573-389a-4b5c-8713-0a585fdab0af None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:42.947101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc573-389a-4b5c-8713-0a585fdab0af None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:42.947247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc573-389a-4b5c-8713-0a585fdab0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:42.966239 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-67efc573-389a-4b5c-8713-0a585fdab0af None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:42.967802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-67efc573-389a-4b5c-8713-0a585fdab0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:42.975681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 3/7] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 20:22:42.998062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94deb403-1974-42b4-9c17-4cce4e0424ee None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:43.010650 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94deb403-1974-42b4-9c17-4cce4e0424ee None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:43.014850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61e643-32db-42e5-945a-aa10fd349b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:43.015484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61e643-32db-42e5-945a-aa10fd349b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:43.015774 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61e643-32db-42e5-945a-aa10fd349b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:43.016058 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61e643-32db-42e5-945a-aa10fd349b72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:43.024689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61e643-32db-42e5-945a-aa10fd349b72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:43.026491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61e643-32db-42e5-945a-aa10fd349b72 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:43.035243 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 5/8] 10.222.0.66 () {58 vars in 1324 bytes} [Fri Jul 15 20:22:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 20:22:43.041724 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efc573-389a-4b5c-8713-0a585fdab0af None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:43.050664 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efc573-389a-4b5c-8713-0a585fdab0af None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:43.055080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ffee6-66c2-4a22-a7b7-726e4c69806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:43.056093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ffee6-66c2-4a22-a7b7-726e4c69806d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:43.056383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ffee6-66c2-4a22-a7b7-726e4c69806d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:43.056692 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ffee6-66c2-4a22-a7b7-726e4c69806d admin admin] PATH_INFO: `/v3/users/95a76fa60149455a8ad27ef586bc5044` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:43.058090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ffee6-66c2-4a22-a7b7-726e4c69806d admin admin] RBAC: Authorizing `identity:get_user(user_id=95a76fa60149455a8ad27ef586bc5044)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:43.059924 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ffee6-66c2-4a22-a7b7-726e4c69806d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:43.061523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 4/9] 10.222.0.66 () {56 vars in 1198 bytes} [Fri Jul 15 20:22:43 2022] GET /identity/v3/users/95a76fa60149455a8ad27ef586bc5044 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:22:45.108455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67841949-257e-46d9-8b7a-9c631cf7e381 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:45.108979 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67841949-257e-46d9-8b7a-9c631cf7e381 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:45.109092 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67841949-257e-46d9-8b7a-9c631cf7e381 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:45.110350 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:22:45.115485 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3bb40-9783-4ee0-b738-5749dcc296fc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:45.115882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3bb40-9783-4ee0-b738-5749dcc296fc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:45.116039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3bb40-9783-4ee0-b738-5749dcc296fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:45.133168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f5a3bb40-9783-4ee0-b738-5749dcc296fc None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:45.134320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f5a3bb40-9783-4ee0-b738-5749dcc296fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:45.172764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8b4a6-fcd8-4a1b-ad38-36b7caa4e6a6 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:45.173056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8b4a6-fcd8-4a1b-ad38-36b7caa4e6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:45.173463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8b4a6-fcd8-4a1b-ad38-36b7caa4e6a6 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:45.174818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 7/11] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:22:45.180466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faa0e3-2b4c-4510-8647-dac3c745ec47 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:45.180767 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faa0e3-2b4c-4510-8647-dac3c745ec47 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:45.181180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faa0e3-2b4c-4510-8647-dac3c745ec47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:45.217082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 5/12] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:22:45.220689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG passlib.handlers.bcrypt [None req-91faa0e3-2b4c-4510-8647-dac3c745ec47 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80252) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 20:22:45.221119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG passlib.handlers.bcrypt [None req-91faa0e3-2b4c-4510-8647-dac3c745ec47 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80252) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 20:22:45.240151 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3bb40-9783-4ee0-b738-5749dcc296fc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:45.263056 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:45.266618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-91faa0e3-2b4c-4510-8647-dac3c745ec47 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:45.268211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-91faa0e3-2b4c-4510-8647-dac3c745ec47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:45.343579 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3bb40-9783-4ee0-b738-5749dcc296fc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:45.369295 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 8/13] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:22:45.377581 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c45ba1-62bf-4f69-a63d-0101e37a3f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:45.378381 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45ba1-62bf-4f69-a63d-0101e37a3f5c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:45.378671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45ba1-62bf-4f69-a63d-0101e37a3f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:45.378953 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45ba1-62bf-4f69-a63d-0101e37a3f5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:45.390374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c45ba1-62bf-4f69-a63d-0101e37a3f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:22:45.391115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91faa0e3-2b4c-4510-8647-dac3c745ec47 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-00c45ba1-62bf-4f69-a63d-0101e37a3f5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:22:45.402374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:22:45.403367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:22:45.404196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:22:45.404196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:22:45.404196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:22:45.404196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:22:45.404196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:22:45.404196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:22:45.404196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:22:45.404196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:22:45.404196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:22:45.404196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:22:45.404196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:22:45.404196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:22:45.404196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 6/14] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:22:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:22:45.409411 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c45ba1-62bf-4f69-a63d-0101e37a3f5c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:45.493281 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91faa0e3-2b4c-4510-8647-dac3c745ec47 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:45.495018 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:45.495587 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:45.514638 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c45ba1-62bf-4f69-a63d-0101e37a3f5c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:45.531426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f1bfb-fa17-4595-bde7-6e6118c8d856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:45.532450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f1bfb-fa17-4595-bde7-6e6118c8d856 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:45.532805 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f1bfb-fa17-4595-bde7-6e6118c8d856 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:45.533146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f1bfb-fa17-4595-bde7-6e6118c8d856 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:45.549829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5663b-511a-47f9-8970-053709338335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:45.550491 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5663b-511a-47f9-8970-053709338335 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:45.550773 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5663b-511a-47f9-8970-053709338335 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:45.551046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5663b-511a-47f9-8970-053709338335 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:45.551788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5663b-511a-47f9-8970-053709338335 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:22:45.552090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5663b-511a-47f9-8970-053709338335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:45.553505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5663b-511a-47f9-8970-053709338335 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:45.565215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 7/15] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:22:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:22:45.571926 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5663b-511a-47f9-8970-053709338335 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:45.602361 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f1bfb-fa17-4595-bde7-6e6118c8d856 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:45.603900 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f1bfb-fa17-4595-bde7-6e6118c8d856 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:45.672666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5663b-511a-47f9-8970-053709338335 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:45.702133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 9/16] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:22:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:22:45.706657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538494a1-3128-4706-9648-e8590a13a893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:45.707525 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538494a1-3128-4706-9648-e8590a13a893 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:45.707809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538494a1-3128-4706-9648-e8590a13a893 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:45.708085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538494a1-3128-4706-9648-e8590a13a893 None admin] PATH_INFO: `/v3/users/95a76fa60149455a8ad27ef586bc5044` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:45.709306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538494a1-3128-4706-9648-e8590a13a893 None admin] RBAC: Authorizing `identity:get_user(user_id=95a76fa60149455a8ad27ef586bc5044)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:45.709404 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f1bfb-fa17-4595-bde7-6e6118c8d856 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:45.710784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538494a1-3128-4706-9648-e8590a13a893 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:45.712962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 8/17] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:22:45 2022] GET /identity/v3/users/95a76fa60149455a8ad27ef586bc5044 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:22:45.713377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:45.718263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538494a1-3128-4706-9648-e8590a13a893 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:45.733916 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:45.812233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f1bfb-fa17-4595-bde7-6e6118c8d856 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:45.819776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538494a1-3128-4706-9648-e8590a13a893 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:45.852377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29518f7-f5b7-45cb-90f3-67b7bdd8173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:45.853212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29518f7-f5b7-45cb-90f3-67b7bdd8173b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:45.853498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29518f7-f5b7-45cb-90f3-67b7bdd8173b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:45.853589 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5d229-db44-418c-bc77-0ad6622e2d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:45.853784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29518f7-f5b7-45cb-90f3-67b7bdd8173b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:45.854375 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5d229-db44-418c-bc77-0ad6622e2d6c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:45.854658 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5d229-db44-418c-bc77-0ad6622e2d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:45.854931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5d229-db44-418c-bc77-0ad6622e2d6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:45.856121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5d229-db44-418c-bc77-0ad6622e2d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:45.857595 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5d229-db44-418c-bc77-0ad6622e2d6c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:45.859491 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 9/18] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:22:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:22:45.864989 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5d229-db44-418c-bc77-0ad6622e2d6c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:45.873018 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29518f7-f5b7-45cb-90f3-67b7bdd8173b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:45.874503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29518f7-f5b7-45cb-90f3-67b7bdd8173b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e29518f7-f5b7-45cb-90f3-67b7bdd8173b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:22:45.894943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:22:45.895915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:22:45.896899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:22:45.896899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:22:45.896899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:22:45.896899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:22:45.896899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 10/19] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:22:45.902147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29518f7-f5b7-45cb-90f3-67b7bdd8173b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:45.946746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:45.959033 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:45.966711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5d229-db44-418c-bc77-0ad6622e2d6c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:46.001302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05057c91-779f-45ca-9a7f-0bb0c05b8034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:46.002035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057c91-779f-45ca-9a7f-0bb0c05b8034 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:46.002319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057c91-779f-45ca-9a7f-0bb0c05b8034 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:46.005708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057c91-779f-45ca-9a7f-0bb0c05b8034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:46.005836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29518f7-f5b7-45cb-90f3-67b7bdd8173b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:46.005992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05057c91-779f-45ca-9a7f-0bb0c05b8034 None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.domain.id=default, user.id=95a76fa60149455a8ad27ef586bc5044) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:22:46.005992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05057c91-779f-45ca-9a7f-0bb0c05b8034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:46.005992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05057c91-779f-45ca-9a7f-0bb0c05b8034 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:46.013854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 10/20] 10.222.0.66 () {56 vars in 1322 bytes} [Fri Jul 15 20:22:45 2022] GET /identity/v3/role_assignments?user.id=95a76fa60149455a8ad27ef586bc5044&scope.domain.id=default&role.id=43e0afe364894278be44a97662ca6f8e => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:22:46.042969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e60f51-fd90-4d51-b234-600c2278a779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:46.043673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e60f51-fd90-4d51-b234-600c2278a779 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:46.043968 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e60f51-fd90-4d51-b234-600c2278a779 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:46.044247 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e60f51-fd90-4d51-b234-600c2278a779 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:46.045037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e60f51-fd90-4d51-b234-600c2278a779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:22:46.045352 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e60f51-fd90-4d51-b234-600c2278a779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:46.046805 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e60f51-fd90-4d51-b234-600c2278a779 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:46.067498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 11/21] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:22:48.326477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ad5f9-4ea1-4174-b0d9-b4fd92feca69 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:48.327409 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ad5f9-4ea1-4174-b0d9-b4fd92feca69 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:48.327842 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ad5f9-4ea1-4174-b0d9-b4fd92feca69 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:48.329403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 11/22] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:22:48.334908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff1cf0-c402-4dd2-98e8-435517977f26 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:48.335687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff1cf0-c402-4dd2-98e8-435517977f26 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:48.336672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff1cf0-c402-4dd2-98e8-435517977f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:48.361397 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0fff1cf0-c402-4dd2-98e8-435517977f26 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:48.362860 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0fff1cf0-c402-4dd2-98e8-435517977f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:48.456920 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 12/23] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:22:48.488300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ad5f9-4ea1-4174-b0d9-b4fd92feca69 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:48.511704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6cbeb-2fd3-4692-ad2e-3683e8f0c070 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:48.512253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6cbeb-2fd3-4692-ad2e-3683e8f0c070 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:48.512725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6cbeb-2fd3-4692-ad2e-3683e8f0c070 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:48.514247 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:22:48.527003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25140a92-8a42-4f60-8271-a093d6c58c81 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:48.527533 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25140a92-8a42-4f60-8271-a093d6c58c81 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:48.527976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25140a92-8a42-4f60-8271-a093d6c58c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:48.554096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-25140a92-8a42-4f60-8271-a093d6c58c81 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:48.556792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-25140a92-8a42-4f60-8271-a093d6c58c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:48.623119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:48.655720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 14/25] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:22:48.698437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25140a92-8a42-4f60-8271-a093d6c58c81 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:48.729103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ad5f9-4ea1-4174-b0d9-b4fd92feca69 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:48.806235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917890eb-0df3-40ab-be63-13dc6d7f9d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:48.807047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917890eb-0df3-40ab-be63-13dc6d7f9d83 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:48.807332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917890eb-0df3-40ab-be63-13dc6d7f9d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:48.807608 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917890eb-0df3-40ab-be63-13dc6d7f9d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:48.824770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917890eb-0df3-40ab-be63-13dc6d7f9d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:48.826283 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917890eb-0df3-40ab-be63-13dc6d7f9d83 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:48.833362 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:48.846788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25140a92-8a42-4f60-8271-a093d6c58c81 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-917890eb-0df3-40ab-be63-13dc6d7f9d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:22:48.861471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:22:48.862371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:22:48.863189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:22:48.863189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:22:48.863189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:22:48.863189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:22:48.863189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 12/26] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:22:48.868440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809b5ea-ab1f-4aab-93cb-883b9929c480 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:48.868440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809b5ea-ab1f-4aab-93cb-883b9929c480 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:48.868440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809b5ea-ab1f-4aab-93cb-883b9929c480 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:48.869807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 13/27] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:22:48.870541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809b5ea-ab1f-4aab-93cb-883b9929c480 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:48.884002 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87756236-39f9-4bdf-a776-65212b54ed0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:48.885151 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87756236-39f9-4bdf-a776-65212b54ed0f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:48.885722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87756236-39f9-4bdf-a776-65212b54ed0f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:48.886205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87756236-39f9-4bdf-a776-65212b54ed0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:48.917649 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87756236-39f9-4bdf-a776-65212b54ed0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-87756236-39f9-4bdf-a776-65212b54ed0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:22:48.929205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:22:48.930710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:22:48.931451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:22:48.931451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:22:48.931451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:22:48.931451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:22:48.931451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:22:48.931451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:22:48.931451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:22:48.931451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:22:48.931451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:22:48.931451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:22:48.931451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:22:48.931451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:22:48.934963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 15/28] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:22:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:22:48.936737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ee93d-f162-4ae1-912f-576122648ec8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:48.937207 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ee93d-f162-4ae1-912f-576122648ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:48.937631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ee93d-f162-4ae1-912f-576122648ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:48.956111 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-852ee93d-f162-4ae1-912f-576122648ec8 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:48.957705 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-852ee93d-f162-4ae1-912f-576122648ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:48.998297 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:49.015185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809b5ea-ab1f-4aab-93cb-883b9929c480 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:49.050538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 16/29] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:22:49.052021 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82ce8c-d921-416b-9893-263bc94bb004 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:49.052320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82ce8c-d921-416b-9893-263bc94bb004 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:49.052640 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82ce8c-d921-416b-9893-263bc94bb004 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:49.054121 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 17/30] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:22:49.055635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82ce8c-d921-416b-9893-263bc94bb004 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:49.059513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735f4a7-5779-445d-98d5-452bdbbef2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:49.060561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735f4a7-5779-445d-98d5-452bdbbef2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:49.061185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735f4a7-5779-445d-98d5-452bdbbef2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:49.061671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735f4a7-5779-445d-98d5-452bdbbef2f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:49.062712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735f4a7-5779-445d-98d5-452bdbbef2f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:22:49.063218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735f4a7-5779-445d-98d5-452bdbbef2f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:49.064874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735f4a7-5779-445d-98d5-452bdbbef2f5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:49.085228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 14/31] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:22:49.087746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3be473-fdd2-4a9a-8d1d-adac9a3d197a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:49.088243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3be473-fdd2-4a9a-8d1d-adac9a3d197a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:49.088778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3be473-fdd2-4a9a-8d1d-adac9a3d197a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:49.106617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ab3be473-fdd2-4a9a-8d1d-adac9a3d197a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:49.108206 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ab3be473-fdd2-4a9a-8d1d-adac9a3d197a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:49.169354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:49.188233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 15/32] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:22:49.189609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3be473-fdd2-4a9a-8d1d-adac9a3d197a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:49.190390 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82ce8c-d921-416b-9893-263bc94bb004 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:49.236277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3e94a-8bb9-45d7-a3b8-039fe08c70e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:49.237239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3e94a-8bb9-45d7-a3b8-039fe08c70e7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:49.237508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3e94a-8bb9-45d7-a3b8-039fe08c70e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:49.237907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3e94a-8bb9-45d7-a3b8-039fe08c70e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:49.238676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3e94a-8bb9-45d7-a3b8-039fe08c70e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:22:49.238985 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3e94a-8bb9-45d7-a3b8-039fe08c70e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:49.240662 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3e94a-8bb9-45d7-a3b8-039fe08c70e7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:49.257630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 18/33] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:22:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:22:49.259350 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3e94a-8bb9-45d7-a3b8-039fe08c70e7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:49.298999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:49.307683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3be473-fdd2-4a9a-8d1d-adac9a3d197a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:49.345663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803da635-058f-49a0-bafd-9354be32d92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:49.346296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803da635-058f-49a0-bafd-9354be32d92d None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:49.346472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803da635-058f-49a0-bafd-9354be32d92d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:49.346866 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803da635-058f-49a0-bafd-9354be32d92d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:49.347682 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803da635-058f-49a0-bafd-9354be32d92d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:49.349186 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803da635-058f-49a0-bafd-9354be32d92d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:49.390996 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3e94a-8bb9-45d7-a3b8-039fe08c70e7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:49.428028 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768690bd-fc91-4f5e-b810-cb3d10a14ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:49.429033 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768690bd-fc91-4f5e-b810-cb3d10a14ed3 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:49.429538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768690bd-fc91-4f5e-b810-cb3d10a14ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:49.431061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768690bd-fc91-4f5e-b810-cb3d10a14ed3 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:49.432212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768690bd-fc91-4f5e-b810-cb3d10a14ed3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:49.433857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768690bd-fc91-4f5e-b810-cb3d10a14ed3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:49.486461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 16/34] 10.222.0.66 () {60 vars in 1131 bytes} [Fri Jul 15 20:22:49 2022] POST /identity/v3/roles => generated 219 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:22:49.488182 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803da635-058f-49a0-bafd-9354be32d92d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:49.544700 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:49.605410 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803da635-058f-49a0-bafd-9354be32d92d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:49.611787 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 19/35] 10.222.0.66 () {60 vars in 1141 bytes} [Fri Jul 15 20:22:49 2022] POST /identity/v3/projects => generated 301 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:22:49.613317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768690bd-fc91-4f5e-b810-cb3d10a14ed3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:49.646248 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863acef-2c49-4343-b69f-d7eac1373581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:49.646981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863acef-2c49-4343-b69f-d7eac1373581 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:49.647262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863acef-2c49-4343-b69f-d7eac1373581 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:49.647548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863acef-2c49-4343-b69f-d7eac1373581 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:49.648337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863acef-2c49-4343-b69f-d7eac1373581 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:49.650477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863acef-2c49-4343-b69f-d7eac1373581 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:49.677897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 17/36] 10.222.0.66 () {60 vars in 1131 bytes} [Fri Jul 15 20:22:49 2022] POST /identity/v3/roles => generated 225 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:22:49.720515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:49.772618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768690bd-fc91-4f5e-b810-cb3d10a14ed3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:49.827471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2637a-8b99-44fc-849b-55b68bfff734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:49.828412 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2637a-8b99-44fc-849b-55b68bfff734 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:49.828707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2637a-8b99-44fc-849b-55b68bfff734 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:49.828994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2637a-8b99-44fc-849b-55b68bfff734 None admin] PATH_INFO: `/v3/users/95a76fa60149455a8ad27ef586bc5044` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:49.833636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2637a-8b99-44fc-849b-55b68bfff734 None admin] RBAC: Authorizing `identity:get_user(user_id=95a76fa60149455a8ad27ef586bc5044)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:49.835282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2637a-8b99-44fc-849b-55b68bfff734 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:49.837986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 20/37] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:22:49 2022] GET /identity/v3/users/95a76fa60149455a8ad27ef586bc5044 => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:22:49.844008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863acef-2c49-4343-b69f-d7eac1373581 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:50.061378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70507-31fa-4344-983d-89c3e2ac96bb None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:50.061709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70507-31fa-4344-983d-89c3e2ac96bb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:50.061915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70507-31fa-4344-983d-89c3e2ac96bb None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:50.063332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 21/38] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:22:50.069702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19a5d3-0bfb-430c-a104-d393c5a3545c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:50.070003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19a5d3-0bfb-430c-a104-d393c5a3545c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:50.070981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19a5d3-0bfb-430c-a104-d393c5a3545c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:50.088584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ee19a5d3-0bfb-430c-a104-d393c5a3545c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:50.090109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ee19a5d3-0bfb-430c-a104-d393c5a3545c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:50.113567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863acef-2c49-4343-b69f-d7eac1373581 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:50.121847 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:50.149981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40593510-8c27-4bbf-ad90-b59b7621d959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:50.150782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40593510-8c27-4bbf-ad90-b59b7621d959 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:50.151076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40593510-8c27-4bbf-ad90-b59b7621d959 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:50.151349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40593510-8c27-4bbf-ad90-b59b7621d959 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:50.152699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40593510-8c27-4bbf-ad90-b59b7621d959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:50.154146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40593510-8c27-4bbf-ad90-b59b7621d959 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:50.156062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 18/39] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:22:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:22:50.157803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a212a-31d7-4823-8126-62b12a53b545 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:50.158093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a212a-31d7-4823-8126-62b12a53b545 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:50.158401 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a212a-31d7-4823-8126-62b12a53b545 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:50.159724 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 19/40] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:22:50.165107 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a212a-31d7-4823-8126-62b12a53b545 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:50.172354 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 22/41] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:22:50.174013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a8a8-6fe6-4ffc-a7f9-e8f180f9321c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:50.174013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a8a8-6fe6-4ffc-a7f9-e8f180f9321c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:50.174191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a8a8-6fe6-4ffc-a7f9-e8f180f9321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:50.198715 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-25c3a8a8-6fe6-4ffc-a7f9-e8f180f9321c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:50.199910 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-25c3a8a8-6fe6-4ffc-a7f9-e8f180f9321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:50.267002 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a212a-31d7-4823-8126-62b12a53b545 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:50.269263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 23/42] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:22:50.269889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3a8a8-6fe6-4ffc-a7f9-e8f180f9321c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:50.280726 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:50.307030 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f95f74-14d9-4647-878d-5b0d82719002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:50.307908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f95f74-14d9-4647-878d-5b0d82719002 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:50.308192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f95f74-14d9-4647-878d-5b0d82719002 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:50.308501 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f95f74-14d9-4647-878d-5b0d82719002 None admin] PATH_INFO: `/v3/domains/default/users/95a76fa60149455a8ad27ef586bc5044/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:50.310486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f95f74-14d9-4647-878d-5b0d82719002 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=95a76fa60149455a8ad27ef586bc5044, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:50.311991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f95f74-14d9-4647-878d-5b0d82719002 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:50.326598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 20/43] 10.222.0.66 () {58 vars in 1361 bytes} [Fri Jul 15 20:22:50 2022] PUT /identity/v3/domains/default/users/95a76fa60149455a8ad27ef586bc5044/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:22:50.327617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f95f74-14d9-4647-878d-5b0d82719002 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:50.378374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:50.386243 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3a8a8-6fe6-4ffc-a7f9-e8f180f9321c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:50.467954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f95f74-14d9-4647-878d-5b0d82719002 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:50.513444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9d9f6-96b3-4f33-8edb-fb4532583978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:50.514543 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9d9f6-96b3-4f33-8edb-fb4532583978 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:50.515062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9d9f6-96b3-4f33-8edb-fb4532583978 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:50.515343 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9d9f6-96b3-4f33-8edb-fb4532583978 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:50.516629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9d9f6-96b3-4f33-8edb-fb4532583978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:50.518096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9d9f6-96b3-4f33-8edb-fb4532583978 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:50.519725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 21/44] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:22:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:22:50.526190 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9d9f6-96b3-4f33-8edb-fb4532583978 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:50.536567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1291b-eae3-40b8-98fc-c208b6459aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:50.537255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1291b-eae3-40b8-98fc-c208b6459aeb None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:50.537547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1291b-eae3-40b8-98fc-c208b6459aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:50.537831 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1291b-eae3-40b8-98fc-c208b6459aeb None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:50.538643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1291b-eae3-40b8-98fc-c208b6459aeb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:50.541294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1291b-eae3-40b8-98fc-c208b6459aeb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:50.556842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 24/45] 10.222.0.66 () {60 vars in 1131 bytes} [Fri Jul 15 20:22:50 2022] POST /identity/v3/roles => generated 223 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:22:50.641057 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9d9f6-96b3-4f33-8edb-fb4532583978 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:50.642774 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:50.682093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9187b2-0e19-471c-8018-8285da98473b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:50.682786 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9187b2-0e19-471c-8018-8285da98473b None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:50.683080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9187b2-0e19-471c-8018-8285da98473b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:50.683369 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9187b2-0e19-471c-8018-8285da98473b None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:50.684155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9187b2-0e19-471c-8018-8285da98473b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:50.685695 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9187b2-0e19-471c-8018-8285da98473b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:50.722635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 22/46] 10.222.0.66 () {60 vars in 1141 bytes} [Fri Jul 15 20:22:50 2022] POST /identity/v3/projects => generated 312 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:22:52.358518 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa45c8-92f8-4f02-9cbd-9a436d53e02b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:52.359026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa45c8-92f8-4f02-9cbd-9a436d53e02b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:52.359181 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa45c8-92f8-4f02-9cbd-9a436d53e02b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:52.360609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 25/47] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:22:52.365755 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4108db-a368-4c67-b5af-59ab056c5039 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:52.366166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4108db-a368-4c67-b5af-59ab056c5039 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:52.366320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4108db-a368-4c67-b5af-59ab056c5039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:52.383569 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0b4108db-a368-4c67-b5af-59ab056c5039 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:52.385322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0b4108db-a368-4c67-b5af-59ab056c5039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:52.450659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 23/48] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:22:52.473589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa45c8-92f8-4f02-9cbd-9a436d53e02b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:52.540101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:52.575557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa45c8-92f8-4f02-9cbd-9a436d53e02b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:52.608231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8206508-320f-477f-bf9e-e5583061e910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:52.609098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8206508-320f-477f-bf9e-e5583061e910 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:52.609337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8206508-320f-477f-bf9e-e5583061e910 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:52.609614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8206508-320f-477f-bf9e-e5583061e910 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:52.620357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8206508-320f-477f-bf9e-e5583061e910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c8206508-320f-477f-bf9e-e5583061e910 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:22:52.628027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:22:52.628991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:22:52.629973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:22:52.629973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:22:52.629973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:22:52.629973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:22:52.629973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:22:52.629973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:22:52.629973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:22:52.629973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:22:52.629973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:22:52.629973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:22:52.629973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:22:52.629973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:22:52.629973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 26/49] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:22:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:22:52.635315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4108db-a368-4c67-b5af-59ab056c5039 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:52.718003 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:52.735566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4108db-a368-4c67-b5af-59ab056c5039 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:52.766020 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01acca3-de41-4e34-8d3f-75be91e778c7 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:52.766325 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01acca3-de41-4e34-8d3f-75be91e778c7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:52.766614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01acca3-de41-4e34-8d3f-75be91e778c7 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:52.768002 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 27/50] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:22:52.768616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e4e83-dc21-481f-9cc5-2dfe579cca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:52.769347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4e83-dc21-481f-9cc5-2dfe579cca7a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:52.769640 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4e83-dc21-481f-9cc5-2dfe579cca7a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:52.769919 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4e83-dc21-481f-9cc5-2dfe579cca7a None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:52.770662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e4e83-dc21-481f-9cc5-2dfe579cca7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:22:52.770972 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e4e83-dc21-481f-9cc5-2dfe579cca7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:52.772525 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e4e83-dc21-481f-9cc5-2dfe579cca7a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:52.772899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec137c-f260-41a8-aa0a-98ff0df500f3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:52.773196 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec137c-f260-41a8-aa0a-98ff0df500f3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:52.774025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec137c-f260-41a8-aa0a-98ff0df500f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:52.785160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 24/51] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:22:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:22:52.787289 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e4e83-dc21-481f-9cc5-2dfe579cca7a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:52.791597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9fec137c-f260-41a8-aa0a-98ff0df500f3 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:52.792867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9fec137c-f260-41a8-aa0a-98ff0df500f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:52.860063 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 28/52] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:22:52.882315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec137c-f260-41a8-aa0a-98ff0df500f3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:52.886921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e4e83-dc21-481f-9cc5-2dfe579cca7a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:52.922199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1cd25-a907-4077-935b-2b6c50478927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:52.923067 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1cd25-a907-4077-935b-2b6c50478927 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:52.923357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1cd25-a907-4077-935b-2b6c50478927 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:52.923640 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1cd25-a907-4077-935b-2b6c50478927 None admin] PATH_INFO: `/v3/users/95a76fa60149455a8ad27ef586bc5044` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:52.924892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1cd25-a907-4077-935b-2b6c50478927 None admin] RBAC: Authorizing `identity:get_user(user_id=95a76fa60149455a8ad27ef586bc5044)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:52.926365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1cd25-a907-4077-935b-2b6c50478927 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:52.928000 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 25/53] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:22:52 2022] GET /identity/v3/users/95a76fa60149455a8ad27ef586bc5044 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:22:52.933952 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1cd25-a907-4077-935b-2b6c50478927 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:52.940406 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:52.949888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:52.983098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec137c-f260-41a8-aa0a-98ff0df500f3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:53.017037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7e118-8ddf-4abd-84c0-e35b1ed97026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:53.017838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e118-8ddf-4abd-84c0-e35b1ed97026 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:53.018237 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e118-8ddf-4abd-84c0-e35b1ed97026 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:53.018415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e118-8ddf-4abd-84c0-e35b1ed97026 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:53.019601 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7e118-8ddf-4abd-84c0-e35b1ed97026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:53.021096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7e118-8ddf-4abd-84c0-e35b1ed97026 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:53.022719 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 29/54] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:22:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:22:53.028998 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7e118-8ddf-4abd-84c0-e35b1ed97026 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:53.037675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1cd25-a907-4077-935b-2b6c50478927 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:53.072349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52755db6-3e3e-4c29-a3a0-5ea15e82af04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:53.073176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52755db6-3e3e-4c29-a3a0-5ea15e82af04 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:53.073466 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52755db6-3e3e-4c29-a3a0-5ea15e82af04 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:53.073748 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52755db6-3e3e-4c29-a3a0-5ea15e82af04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:53.074972 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52755db6-3e3e-4c29-a3a0-5ea15e82af04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:53.076462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52755db6-3e3e-4c29-a3a0-5ea15e82af04 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:53.078099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 26/55] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:22:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:22:53.083730 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52755db6-3e3e-4c29-a3a0-5ea15e82af04 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:53.130084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7e118-8ddf-4abd-84c0-e35b1ed97026 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:53.156549 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:53.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c475b18-aecb-4358-889c-fd7b5d650681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:53.168054 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c475b18-aecb-4358-889c-fd7b5d650681 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:53.168345 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c475b18-aecb-4358-889c-fd7b5d650681 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:53.168748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c475b18-aecb-4358-889c-fd7b5d650681 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:53.169474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c475b18-aecb-4358-889c-fd7b5d650681 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:53.170966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c475b18-aecb-4358-889c-fd7b5d650681 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:53.171606 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:53.191813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52755db6-3e3e-4c29-a3a0-5ea15e82af04 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:53.197461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 30/56] 10.222.0.66 () {60 vars in 1140 bytes} [Fri Jul 15 20:22:53 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:22:53.234572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5542345-b96e-4b3b-8c8d-780bd9af530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:53.235253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5542345-b96e-4b3b-8c8d-780bd9af530e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:53.235545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5542345-b96e-4b3b-8c8d-780bd9af530e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:53.235830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5542345-b96e-4b3b-8c8d-780bd9af530e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:53.236750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5542345-b96e-4b3b-8c8d-780bd9af530e None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.domain.id=default, user.id=95a76fa60149455a8ad27ef586bc5044) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:22:53.237041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5542345-b96e-4b3b-8c8d-780bd9af530e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:53.238533 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5542345-b96e-4b3b-8c8d-780bd9af530e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:53.246054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 27/57] 10.222.0.66 () {56 vars in 1322 bytes} [Fri Jul 15 20:22:53 2022] GET /identity/v3/role_assignments?user.id=95a76fa60149455a8ad27ef586bc5044&scope.domain.id=default&role.id=43e0afe364894278be44a97662ca6f8e => generated 530 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:22:55.205587 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6dc87-128e-477f-96dc-8dd6a0ac4728 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:55.206120 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6dc87-128e-477f-96dc-8dd6a0ac4728 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:55.206208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6dc87-128e-477f-96dc-8dd6a0ac4728 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:55.207548 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 31/58] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:22:55.213288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc5255-3c6b-4a96-a868-e01bae46e10c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:55.213667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc5255-3c6b-4a96-a868-e01bae46e10c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:55.213847 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc5255-3c6b-4a96-a868-e01bae46e10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:55.230761 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-83bc5255-3c6b-4a96-a868-e01bae46e10c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:55.231938 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-83bc5255-3c6b-4a96-a868-e01bae46e10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:55.297847 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 28/59] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:22:55.321423 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6dc87-128e-477f-96dc-8dd6a0ac4728 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:55.421642 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6dc87-128e-477f-96dc-8dd6a0ac4728 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:55.455971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b6c83-fdf9-4fd1-b61b-2b8ff621122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:55.456731 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b6c83-fdf9-4fd1-b61b-2b8ff621122a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:55.457026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b6c83-fdf9-4fd1-b61b-2b8ff621122a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:55.457681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b6c83-fdf9-4fd1-b61b-2b8ff621122a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:55.458488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b6c83-fdf9-4fd1-b61b-2b8ff621122a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:55.459943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b6c83-fdf9-4fd1-b61b-2b8ff621122a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:55.462534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 32/60] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:22:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:22:55.468113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc5255-3c6b-4a96-a868-e01bae46e10c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:55.544989 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:55.567916 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc5255-3c6b-4a96-a868-e01bae46e10c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:55.601795 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884461cd-205f-42a1-99fe-7921b556fdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:55.602464 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884461cd-205f-42a1-99fe-7921b556fdb5 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:55.602755 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884461cd-205f-42a1-99fe-7921b556fdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:55.603040 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884461cd-205f-42a1-99fe-7921b556fdb5 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:55.603757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884461cd-205f-42a1-99fe-7921b556fdb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:55.605238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884461cd-205f-42a1-99fe-7921b556fdb5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:55.629427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 29/61] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:22:55 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:22:58.623376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f4f8b-e7fe-4d3c-bbeb-5431e864d735 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:58.623899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f4f8b-e7fe-4d3c-bbeb-5431e864d735 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:58.623975 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f4f8b-e7fe-4d3c-bbeb-5431e864d735 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:58.625516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 33/62] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:22:58.638651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d749b57-05db-4963-9463-8ba71ad3818a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:58.639104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d749b57-05db-4963-9463-8ba71ad3818a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:58.639209 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d749b57-05db-4963-9463-8ba71ad3818a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:58.665747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1d749b57-05db-4963-9463-8ba71ad3818a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:58.666965 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1d749b57-05db-4963-9463-8ba71ad3818a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:58.744731 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162eca-e7d3-4ebe-a88d-f2c35b3e06fe None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:58.745013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162eca-e7d3-4ebe-a88d-f2c35b3e06fe None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:58.745234 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162eca-e7d3-4ebe-a88d-f2c35b3e06fe None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:58.746767 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 34/63] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:22:58.750488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 30/64] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:22:58.755743 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126edc8f-80e9-4de3-8988-2106c8009327 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:58.756038 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126edc8f-80e9-4de3-8988-2106c8009327 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:58.756324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126edc8f-80e9-4de3-8988-2106c8009327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:58.775878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d749b57-05db-4963-9463-8ba71ad3818a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:58.785582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-126edc8f-80e9-4de3-8988-2106c8009327 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:58.786810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-126edc8f-80e9-4de3-8988-2106c8009327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:58.861804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:58.867650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:58.893525 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d749b57-05db-4963-9463-8ba71ad3818a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:58.924727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 35/65] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:22:58.944437 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a04c-734f-4e87-9678-09dfe4871484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:58.945607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a04c-734f-4e87-9678-09dfe4871484 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:58.946052 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a04c-734f-4e87-9678-09dfe4871484 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:58.946491 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a04c-734f-4e87-9678-09dfe4871484 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:58.957336 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61a04c-734f-4e87-9678-09dfe4871484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-2d61a04c-734f-4e87-9678-09dfe4871484 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:22:58.969612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:22:58.970655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:22:58.971663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:22:58.971663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:22:58.971663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:22:58.971663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:22:58.971663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:22:58.971663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:22:58.971663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:22:58.971663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:22:58.971663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:22:58.971663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:22:58.971663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:22:58.971663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:22:58.973694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 31/66] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:22:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:22:58.981520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126edc8f-80e9-4de3-8988-2106c8009327 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:58.982609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a04c-734f-4e87-9678-09dfe4871484 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:59.090782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a04c-734f-4e87-9678-09dfe4871484 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:59.121070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:59.127153 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2f0bc-7095-4ee6-8b0c-f5e574353a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:59.128172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2f0bc-7095-4ee6-8b0c-f5e574353a2a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:59.128658 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2f0bc-7095-4ee6-8b0c-f5e574353a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:59.129148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2f0bc-7095-4ee6-8b0c-f5e574353a2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:59.142433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2f0bc-7095-4ee6-8b0c-f5e574353a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-64c2f0bc-7095-4ee6-8b0c-f5e574353a2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:22:59.150619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:22:59.151478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:22:59.152231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:22:59.152231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:22:59.152231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:22:59.152231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:22:59.152231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:22:59.152231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:22:59.152231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:22:59.152231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:22:59.152231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:22:59.152231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:22:59.152231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:22:59.152231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:22:59.154667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 32/67] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:22:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:22:59.170441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2f0bc-7095-4ee6-8b0c-f5e574353a2a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:59.190481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126edc8f-80e9-4de3-8988-2106c8009327 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:59.252879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37f6db-8a06-4b85-8189-a82b238dfcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:59.253566 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f6db-8a06-4b85-8189-a82b238dfcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:59.253915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f6db-8a06-4b85-8189-a82b238dfcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:59.254203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f6db-8a06-4b85-8189-a82b238dfcb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:59.254963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37f6db-8a06-4b85-8189-a82b238dfcb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:22:59.255277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37f6db-8a06-4b85-8189-a82b238dfcb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:59.256763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37f6db-8a06-4b85-8189-a82b238dfcb2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:59.267452 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 36/68] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:22:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:22:59.268946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf39570-6cda-496b-8708-e255bbf62e5c None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:59.269501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf39570-6cda-496b-8708-e255bbf62e5c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:59.269937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf39570-6cda-496b-8708-e255bbf62e5c None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:59.271406 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 37/69] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:22:59.277058 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf39570-6cda-496b-8708-e255bbf62e5c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:59.317618 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2f0bc-7095-4ee6-8b0c-f5e574353a2a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:59.327134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:59.355889 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5440c-b4a4-4e7e-9acb-ed2cf9eb7c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:59.356531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5440c-b4a4-4e7e-9acb-ed2cf9eb7c90 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:59.356824 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5440c-b4a4-4e7e-9acb-ed2cf9eb7c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:59.357111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5440c-b4a4-4e7e-9acb-ed2cf9eb7c90 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:59.357862 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5440c-b4a4-4e7e-9acb-ed2cf9eb7c90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:22:59.358177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5440c-b4a4-4e7e-9acb-ed2cf9eb7c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:59.359583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5440c-b4a4-4e7e-9acb-ed2cf9eb7c90 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:59.369619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 33/70] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:22:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:22:59.371063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4caa95-148f-41cb-a361-c41d38e78f09 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:59.371546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4caa95-148f-41cb-a361-c41d38e78f09 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:59.371997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4caa95-148f-41cb-a361-c41d38e78f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:59.390680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0a4caa95-148f-41cb-a361-c41d38e78f09 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:59.392364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0a4caa95-148f-41cb-a361-c41d38e78f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:59.399205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf39570-6cda-496b-8708-e255bbf62e5c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:59.435175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fbdba-32b4-4579-8bd6-b6f7f7630c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:59.436861 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fbdba-32b4-4579-8bd6-b6f7f7630c4d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:59.437160 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fbdba-32b4-4579-8bd6-b6f7f7630c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:59.437447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fbdba-32b4-4579-8bd6-b6f7f7630c4d None admin] PATH_INFO: `/v3/users/b4aad040a05d4df4a45e2326d9581c12` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:59.441892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:59.458709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fbdba-32b4-4579-8bd6-b6f7f7630c4d None admin] RBAC: Authorizing `identity:get_user(user_id=b4aad040a05d4df4a45e2326d9581c12)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:59.461256 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fbdba-32b4-4579-8bd6-b6f7f7630c4d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:59.467987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 38/71] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:22:59 2022] GET /identity/v3/users/b4aad040a05d4df4a45e2326d9581c12 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:22:59.467987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c80dd5-9272-4728-8e76-56556ec3ee95 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:59.467987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c80dd5-9272-4728-8e76-56556ec3ee95 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:59.467987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c80dd5-9272-4728-8e76-56556ec3ee95 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:59.468649 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 39/72] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:22:59.469741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c80dd5-9272-4728-8e76-56556ec3ee95 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:59.475670 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 34/73] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:22:59.477707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4caa95-148f-41cb-a361-c41d38e78f09 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:59.569522 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:59.577040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c80dd5-9272-4728-8e76-56556ec3ee95 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:59.578578 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4caa95-148f-41cb-a361-c41d38e78f09 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:59.611532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f56fa5-de8f-464e-b42b-5e00b888d823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:59.612343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f56fa5-de8f-464e-b42b-5e00b888d823 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:59.612675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f56fa5-de8f-464e-b42b-5e00b888d823 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:59.612961 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f56fa5-de8f-464e-b42b-5e00b888d823 None admin] PATH_INFO: `/v3/users/95a76fa60149455a8ad27ef586bc5044` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:59.614108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6096b4-6ea5-42e0-85f0-e8eff5ca9029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:59.614219 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f56fa5-de8f-464e-b42b-5e00b888d823 None admin] RBAC: Authorizing `identity:get_user(user_id=95a76fa60149455a8ad27ef586bc5044)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:59.614763 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6096b4-6ea5-42e0-85f0-e8eff5ca9029 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:59.615053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6096b4-6ea5-42e0-85f0-e8eff5ca9029 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:59.615336 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6096b4-6ea5-42e0-85f0-e8eff5ca9029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:59.615594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f56fa5-de8f-464e-b42b-5e00b888d823 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:59.618010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 40/74] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:22:59 2022] GET /identity/v3/users/95a76fa60149455a8ad27ef586bc5044 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:22:59.619036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc6fa3-c228-4d27-8a00-62f02cfe984c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:59.619339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc6fa3-c228-4d27-8a00-62f02cfe984c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:59.619623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc6fa3-c228-4d27-8a00-62f02cfe984c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:59.635346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-15dc6fa3-c228-4d27-8a00-62f02cfe984c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:59.636591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-15dc6fa3-c228-4d27-8a00-62f02cfe984c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:59.660423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:59.686881 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6096b4-6ea5-42e0-85f0-e8eff5ca9029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:22:59.688348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6096b4-6ea5-42e0-85f0-e8eff5ca9029 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:22:59.705785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 41/75] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:22:59.707259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518ecfb-5ee3-4dc1-9e8c-3602b839f7db None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:59.707561 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518ecfb-5ee3-4dc1-9e8c-3602b839f7db None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:59.707848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518ecfb-5ee3-4dc1-9e8c-3602b839f7db None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:59.709167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 42/76] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:22:59.713489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518ecfb-5ee3-4dc1-9e8c-3602b839f7db None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:59.798363 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 35/77] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:22:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:22:59.799250 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6096b4-6ea5-42e0-85f0-e8eff5ca9029 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:22:59.805476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:59.812977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518ecfb-5ee3-4dc1-9e8c-3602b839f7db None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:59.846802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38af11-d4e4-4cf2-929f-354cc8f6df64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:59.847615 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38af11-d4e4-4cf2-929f-354cc8f6df64 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:59.847905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38af11-d4e4-4cf2-929f-354cc8f6df64 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:59.848187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38af11-d4e4-4cf2-929f-354cc8f6df64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:59.858922 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38af11-d4e4-4cf2-929f-354cc8f6df64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2b38af11-d4e4-4cf2-929f-354cc8f6df64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:22:59.867651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:22:59.868484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:22:59.869239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:22:59.869239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:22:59.869239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:22:59.869239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:22:59.869239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:22:59.869239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:22:59.869239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:22:59.869239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:22:59.869239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:22:59.869239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:22:59.869239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:22:59.869239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:22:59.869239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 43/78] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:22:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:22:59.870061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2de81-9605-4203-8fb7-92ba8edd79df None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:59.870313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2de81-9605-4203-8fb7-92ba8edd79df None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:59.870592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2de81-9605-4203-8fb7-92ba8edd79df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:59.882344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:22:59.888054 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-93e2de81-9605-4203-8fb7-92ba8edd79df None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:22:59.889286 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-93e2de81-9605-4203-8fb7-92ba8edd79df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:22:59.908405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6096b4-6ea5-42e0-85f0-e8eff5ca9029 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:22:59.942091 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a6d3f-70f6-4271-bded-41208760b59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:22:59.942942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a6d3f-70f6-4271-bded-41208760b59d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:22:59.943232 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a6d3f-70f6-4271-bded-41208760b59d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:22:59.943517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a6d3f-70f6-4271-bded-41208760b59d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:22:59.955909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 44/79] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:22:59.956769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2de81-9605-4203-8fb7-92ba8edd79df None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:00.022427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a6d3f-70f6-4271-bded-41208760b59d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:00.024424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a6d3f-70f6-4271-bded-41208760b59d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:00.040811 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:00.057242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2de81-9605-4203-8fb7-92ba8edd79df None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:00.090615 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2062d-8b01-4dad-8797-a3060d644f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:00.091415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2062d-8b01-4dad-8797-a3060d644f4a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:00.091708 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2062d-8b01-4dad-8797-a3060d644f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:00.091994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2062d-8b01-4dad-8797-a3060d644f4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:00.099562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:00.103406 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2062d-8b01-4dad-8797-a3060d644f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-7cd2062d-8b01-4dad-8797-a3060d644f4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:00.111123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:00.112144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:00.113383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:00.113383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:00.113383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:00.113383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:00.113383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:00.113383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:00.113383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:00.113383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:00.113383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:00.113383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:00.113383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:00.113383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:00.113383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 45/80] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:22:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:00.113383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2062d-8b01-4dad-8797-a3060d644f4a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:00.131414 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 36/81] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:22:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:00.132188 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a6d3f-70f6-4271-bded-41208760b59d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:00.212620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2062d-8b01-4dad-8797-a3060d644f4a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:00.231526 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a6d3f-70f6-4271-bded-41208760b59d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:00.246239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80421a-61b1-4468-b4a0-b00309a0d34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:00.247100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80421a-61b1-4468-b4a0-b00309a0d34d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:00.247390 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80421a-61b1-4468-b4a0-b00309a0d34d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:00.247675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80421a-61b1-4468-b4a0-b00309a0d34d None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:00.248904 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80421a-61b1-4468-b4a0-b00309a0d34d None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:00.250377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80421a-61b1-4468-b4a0-b00309a0d34d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:00.252075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 46/82] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:00 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:00.252873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80421a-61b1-4468-b4a0-b00309a0d34d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:00.264992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a92451-ba49-4c41-be66-886b91fad8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:00.265665 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a92451-ba49-4c41-be66-886b91fad8fd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:00.265955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a92451-ba49-4c41-be66-886b91fad8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:00.266238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a92451-ba49-4c41-be66-886b91fad8fd None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:00.266988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a92451-ba49-4c41-be66-886b91fad8fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:00.267302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a92451-ba49-4c41-be66-886b91fad8fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:00.268719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a92451-ba49-4c41-be66-886b91fad8fd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:00.269308 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:00.277525 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 37/83] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:00.278318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a92451-ba49-4c41-be66-886b91fad8fd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:00.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:00.361887 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80421a-61b1-4468-b4a0-b00309a0d34d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:00.375790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a92451-ba49-4c41-be66-886b91fad8fd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:00.396779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d544d-50de-481a-947a-6f575b4ba3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:00.397536 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d544d-50de-481a-947a-6f575b4ba3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:00.397820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d544d-50de-481a-947a-6f575b4ba3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:00.398172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d544d-50de-481a-947a-6f575b4ba3b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:00.399384 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d544d-50de-481a-947a-6f575b4ba3b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:00.400864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d544d-50de-481a-947a-6f575b4ba3b0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:00.402473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 47/84] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:00.403227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d544d-50de-481a-947a-6f575b4ba3b0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:00.416765 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447788b-48bb-4047-b61b-fc6094f7131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:00.417431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447788b-48bb-4047-b61b-fc6094f7131b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:00.417712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447788b-48bb-4047-b61b-fc6094f7131b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:00.417989 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447788b-48bb-4047-b61b-fc6094f7131b None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:00.418737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447788b-48bb-4047-b61b-fc6094f7131b None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:00.419051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447788b-48bb-4047-b61b-fc6094f7131b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:00.420439 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447788b-48bb-4047-b61b-fc6094f7131b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:00.428487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 38/85] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:00.429821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447788b-48bb-4047-b61b-fc6094f7131b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:00.488798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:00.508740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d544d-50de-481a-947a-6f575b4ba3b0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:00.528274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:00.532713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447788b-48bb-4047-b61b-fc6094f7131b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:00.542088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae949c-ec0a-4952-9fff-9ee00fa05318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:00.542955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae949c-ec0a-4952-9fff-9ee00fa05318 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:00.543254 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae949c-ec0a-4952-9fff-9ee00fa05318 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:00.543540 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae949c-ec0a-4952-9fff-9ee00fa05318 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:00.544751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae949c-ec0a-4952-9fff-9ee00fa05318 None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:00.546199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae949c-ec0a-4952-9fff-9ee00fa05318 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:00.547893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 48/86] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:00 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:00.548691 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae949c-ec0a-4952-9fff-9ee00fa05318 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:00.567786 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785794ce-97c1-4af3-a990-084649495c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:00.568470 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785794ce-97c1-4af3-a990-084649495c52 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:00.568762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785794ce-97c1-4af3-a990-084649495c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:00.569041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785794ce-97c1-4af3-a990-084649495c52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:00.569911 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785794ce-97c1-4af3-a990-084649495c52 None admin] RBAC: Adding query filter params (role.id=83a7ac2bd20743b78fe0f4689037d83b, scope.project.id=1658f1fcd1984324979b5dde1834d62e, user.id=b4aad040a05d4df4a45e2326d9581c12) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:00.570327 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785794ce-97c1-4af3-a990-084649495c52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:00.571850 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785794ce-97c1-4af3-a990-084649495c52 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:00.577358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 39/87] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:00 2022] GET /identity/v3/role_assignments?user.id=b4aad040a05d4df4a45e2326d9581c12&scope.project.id=1658f1fcd1984324979b5dde1834d62e&role.id=83a7ac2bd20743b78fe0f4689037d83b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:00.577953 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785794ce-97c1-4af3-a990-084649495c52 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:00.655324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae949c-ec0a-4952-9fff-9ee00fa05318 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:00.692434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831960c-3da9-4015-a760-d7aa08bb73e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:00.693330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831960c-3da9-4015-a760-d7aa08bb73e4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:00.693621 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831960c-3da9-4015-a760-d7aa08bb73e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:00.693905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831960c-3da9-4015-a760-d7aa08bb73e4 None admin] PATH_INFO: `/v3/users/b4aad040a05d4df4a45e2326d9581c12` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:00.695237 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831960c-3da9-4015-a760-d7aa08bb73e4 None admin] RBAC: Authorizing `identity:get_user(user_id=b4aad040a05d4df4a45e2326d9581c12)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:00.696870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831960c-3da9-4015-a760-d7aa08bb73e4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:00.703097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 49/88] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:00 2022] GET /identity/v3/users/b4aad040a05d4df4a45e2326d9581c12 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:00.703097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831960c-3da9-4015-a760-d7aa08bb73e4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:00.718055 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785794ce-97c1-4af3-a990-084649495c52 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:00.722392 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:00.758417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bec43f-642d-4585-b421-2be428d48d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:00.759098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec43f-642d-4585-b421-2be428d48d18 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:00.759392 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec43f-642d-4585-b421-2be428d48d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:00.759674 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec43f-642d-4585-b421-2be428d48d18 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:00.760406 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bec43f-642d-4585-b421-2be428d48d18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:00.761905 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bec43f-642d-4585-b421-2be428d48d18 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:00.781975 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 40/89] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:23:00 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:23:00.783079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bec43f-642d-4585-b421-2be428d48d18 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:00.818902 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:00.832415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831960c-3da9-4015-a760-d7aa08bb73e4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:00.875440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd942679-9bcd-4a79-8411-06bc4373fd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:00.876495 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd942679-9bcd-4a79-8411-06bc4373fd75 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:00.876860 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd942679-9bcd-4a79-8411-06bc4373fd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:00.877208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd942679-9bcd-4a79-8411-06bc4373fd75 None admin] PATH_INFO: `/v3/users/b4aad040a05d4df4a45e2326d9581c12` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:00.878752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd942679-9bcd-4a79-8411-06bc4373fd75 None admin] RBAC: Authorizing `identity:get_user(user_id=b4aad040a05d4df4a45e2326d9581c12)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:00.880514 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd942679-9bcd-4a79-8411-06bc4373fd75 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:00.882485 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 50/90] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:00 2022] GET /identity/v3/users/b4aad040a05d4df4a45e2326d9581c12 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:00.888181 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd942679-9bcd-4a79-8411-06bc4373fd75 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:00.934960 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bec43f-642d-4585-b421-2be428d48d18 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:00.985124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0cc84-b0c3-4d54-af13-f5163808dde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:00.986309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0cc84-b0c3-4d54-af13-f5163808dde2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:00.986768 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0cc84-b0c3-4d54-af13-f5163808dde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:00.987115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:00.987339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0cc84-b0c3-4d54-af13-f5163808dde2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:00.989469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0cc84-b0c3-4d54-af13-f5163808dde2 None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=1658f1fcd1984324979b5dde1834d62e, user.id=95a76fa60149455a8ad27ef586bc5044) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:00.989803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0cc84-b0c3-4d54-af13-f5163808dde2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:00.991224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0cc84-b0c3-4d54-af13-f5163808dde2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:01.000241 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 41/91] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:00 2022] GET /identity/v3/role_assignments?user.id=95a76fa60149455a8ad27ef586bc5044&scope.project.id=1658f1fcd1984324979b5dde1834d62e&role.id=43e0afe364894278be44a97662ca6f8e => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:01.004556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0cc84-b0c3-4d54-af13-f5163808dde2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:01.008170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd942679-9bcd-4a79-8411-06bc4373fd75 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:01.062328 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b54864-7543-4d77-b0d7-e095624f989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:01.063023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b54864-7543-4d77-b0d7-e095624f989a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:01.063320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b54864-7543-4d77-b0d7-e095624f989a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:01.063601 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b54864-7543-4d77-b0d7-e095624f989a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:01.149004 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:01.161678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0cc84-b0c3-4d54-af13-f5163808dde2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:01.190237 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b54864-7543-4d77-b0d7-e095624f989a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:01.191675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b54864-7543-4d77-b0d7-e095624f989a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:01.206889 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5ffe-a19a-4fdc-934f-960e9e59a913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:01.207695 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5ffe-a19a-4fdc-934f-960e9e59a913 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:01.207985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5ffe-a19a-4fdc-934f-960e9e59a913 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:01.208271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5ffe-a19a-4fdc-934f-960e9e59a913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:01.307526 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f5ffe-a19a-4fdc-934f-960e9e59a913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:01.310271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f5ffe-a19a-4fdc-934f-960e9e59a913 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:01.326796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:01.350179 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 51/92] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:01.356581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b54864-7543-4d77-b0d7-e095624f989a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:01.426959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:01.453718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 42/93] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:01.458915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5ffe-a19a-4fdc-934f-960e9e59a913 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:01.530627 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b54864-7543-4d77-b0d7-e095624f989a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:01.573690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5ffe-a19a-4fdc-934f-960e9e59a913 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:01.614127 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799a319-e1ab-4e85-9dfb-4ce494060079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:01.615426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a319-e1ab-4e85-9dfb-4ce494060079 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:01.616066 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a319-e1ab-4e85-9dfb-4ce494060079 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:01.616717 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a319-e1ab-4e85-9dfb-4ce494060079 None admin] PATH_INFO: `/v3/projects/abe7d8bbe677453da68da20b6f6cac57` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:01.618262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799a319-e1ab-4e85-9dfb-4ce494060079 None admin] RBAC: Authorizing `identity:get_project(project_id=abe7d8bbe677453da68da20b6f6cac57)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:01.619963 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799a319-e1ab-4e85-9dfb-4ce494060079 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:01.621112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753887d1-cebe-4db7-83ff-0aa0a4cdcfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:01.621997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753887d1-cebe-4db7-83ff-0aa0a4cdcfcc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:01.622297 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753887d1-cebe-4db7-83ff-0aa0a4cdcfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:01.622602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753887d1-cebe-4db7-83ff-0aa0a4cdcfcc None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:01.623016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 43/94] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:01 2022] GET /identity/v3/projects/abe7d8bbe677453da68da20b6f6cac57 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:01.623934 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753887d1-cebe-4db7-83ff-0aa0a4cdcfcc None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:01.628415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753887d1-cebe-4db7-83ff-0aa0a4cdcfcc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:01.628415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 52/95] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:01 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:01.629763 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799a319-e1ab-4e85-9dfb-4ce494060079 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:01.645775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753887d1-cebe-4db7-83ff-0aa0a4cdcfcc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:01.734964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:01.778032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:01.811662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799a319-e1ab-4e85-9dfb-4ce494060079 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:01.861348 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753887d1-cebe-4db7-83ff-0aa0a4cdcfcc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:01.904325 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46a28c-a981-4ba7-8a68-daebe0ff8f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:01.905357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46a28c-a981-4ba7-8a68-daebe0ff8f48 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:01.905875 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46a28c-a981-4ba7-8a68-daebe0ff8f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:01.906355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46a28c-a981-4ba7-8a68-daebe0ff8f48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:01.907397 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46a28c-a981-4ba7-8a68-daebe0ff8f48 None admin] RBAC: Adding query filter params (role.id=e97c8dedb3a147c6ab5d98229f5a000c, scope.project.id=1658f1fcd1984324979b5dde1834d62e, user.id=b4aad040a05d4df4a45e2326d9581c12) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:01.907932 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46a28c-a981-4ba7-8a68-daebe0ff8f48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:01.909702 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024f5bf-4497-4488-9643-db861c06568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:01.909973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46a28c-a981-4ba7-8a68-daebe0ff8f48 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:01.910381 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024f5bf-4497-4488-9643-db861c06568d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:01.910680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024f5bf-4497-4488-9643-db861c06568d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:01.910966 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024f5bf-4497-4488-9643-db861c06568d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:01.911820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024f5bf-4497-4488-9643-db861c06568d None admin] RBAC: Adding query filter params (role.id=83a7ac2bd20743b78fe0f4689037d83b, scope.project.id=abe7d8bbe677453da68da20b6f6cac57, user.id=b4aad040a05d4df4a45e2326d9581c12) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:01.912143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024f5bf-4497-4488-9643-db861c06568d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:01.913679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024f5bf-4497-4488-9643-db861c06568d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:01.921985 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 53/96] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:01 2022] GET /identity/v3/role_assignments?user.id=b4aad040a05d4df4a45e2326d9581c12&scope.project.id=1658f1fcd1984324979b5dde1834d62e&role.id=e97c8dedb3a147c6ab5d98229f5a000c => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:01.931953 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 44/97] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:01 2022] GET /identity/v3/role_assignments?user.id=b4aad040a05d4df4a45e2326d9581c12&scope.project.id=abe7d8bbe677453da68da20b6f6cac57&role.id=83a7ac2bd20743b78fe0f4689037d83b => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:03.512026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c90e6-082b-49bc-a82d-dd404481f165 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:03.512566 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c90e6-082b-49bc-a82d-dd404481f165 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:03.512639 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c90e6-082b-49bc-a82d-dd404481f165 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:03.513996 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 54/98] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:03.530076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf423-eec3-48c4-9efc-e3d41cbdb677 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:03.530549 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf423-eec3-48c4-9efc-e3d41cbdb677 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:03.530745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf423-eec3-48c4-9efc-e3d41cbdb677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:03.557069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-aefbf423-eec3-48c4-9efc-e3d41cbdb677 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:03.558287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aefbf423-eec3-48c4-9efc-e3d41cbdb677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:03.637794 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 45/99] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:03.652618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a4c6c-326f-49bb-b912-6f4c37f653c0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:03.652917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a4c6c-326f-49bb-b912-6f4c37f653c0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:03.653202 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a4c6c-326f-49bb-b912-6f4c37f653c0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:03.654587 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 55/100] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:03.668683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318689-2cc1-4030-9eea-6101d16c0ef0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:03.668981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318689-2cc1-4030-9eea-6101d16c0ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:03.669268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318689-2cc1-4030-9eea-6101d16c0ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:03.686550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-22318689-2cc1-4030-9eea-6101d16c0ef0 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:03.687689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a4c6c-326f-49bb-b912-6f4c37f653c0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:03.689483 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-22318689-2cc1-4030-9eea-6101d16c0ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:03.746336 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:03.797810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 46/101] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:03.833419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22318689-2cc1-4030-9eea-6101d16c0ef0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:03.917595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a4c6c-326f-49bb-b912-6f4c37f653c0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:03.943056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:03.976688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa68d-c9f3-44b1-8b52-2b0674a459c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:03.977617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa68d-c9f3-44b1-8b52-2b0674a459c7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:03.977919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa68d-c9f3-44b1-8b52-2b0674a459c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:03.978208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa68d-c9f3-44b1-8b52-2b0674a459c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:03.998151 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aa68d-c9f3-44b1-8b52-2b0674a459c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a04aa68d-c9f3-44b1-8b52-2b0674a459c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:04.013902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:04.014789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:04.015604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:04.015604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:04.015604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:04.015604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:04.015604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:04.015604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:04.015604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:04.015604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:04.015604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:04.015604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:04.015604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:04.015604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:04.015604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 56/102] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:04.022476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa68d-c9f3-44b1-8b52-2b0674a459c7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:04.048347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22318689-2cc1-4030-9eea-6101d16c0ef0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:04.103840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa5c5a-2ecc-4db2-98c9-32e54147ef79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:04.104672 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa5c5a-2ecc-4db2-98c9-32e54147ef79 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.104957 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa5c5a-2ecc-4db2-98c9-32e54147ef79 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.105232 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa5c5a-2ecc-4db2-98c9-32e54147ef79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:04.123093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa5c5a-2ecc-4db2-98c9-32e54147ef79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f6aa5c5a-2ecc-4db2-98c9-32e54147ef79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:04.130798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:04.131641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:04.132456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:04.132456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:04.132456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:04.132456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:04.132456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:04.132456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:04.132456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:04.132456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:04.132456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:04.132456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:04.132456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:04.132456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:04.133237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 47/103] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:23:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:04.133828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd20246-a879-4c8a-98a9-d56744c41e1e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.134342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd20246-a879-4c8a-98a9-d56744c41e1e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.134628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd20246-a879-4c8a-98a9-d56744c41e1e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:04.136129 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 48/104] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:04.139728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd20246-a879-4c8a-98a9-d56744c41e1e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:04.180903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:04.234112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa68d-c9f3-44b1-8b52-2b0674a459c7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:04.249266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd20246-a879-4c8a-98a9-d56744c41e1e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:04.285793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a1ece-f684-4047-97fb-8ee5d85becae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:04.286163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a1ece-f684-4047-97fb-8ee5d85becae None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.286452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a1ece-f684-4047-97fb-8ee5d85becae None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.286731 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a1ece-f684-4047-97fb-8ee5d85becae None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:04.287517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a1ece-f684-4047-97fb-8ee5d85becae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:04.287788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a1ece-f684-4047-97fb-8ee5d85becae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:04.289348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a1ece-f684-4047-97fb-8ee5d85becae None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:04.298912 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 49/105] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:04.300410 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7008e-5f17-4cb5-8625-44e3d4b0c49e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.300716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7008e-5f17-4cb5-8625-44e3d4b0c49e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.300999 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7008e-5f17-4cb5-8625-44e3d4b0c49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:04.305900 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de0d4e-f0c4-40b2-8fb8-298fd54eeb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:04.306853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de0d4e-f0c4-40b2-8fb8-298fd54eeb2b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.307340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de0d4e-f0c4-40b2-8fb8-298fd54eeb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.307817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de0d4e-f0c4-40b2-8fb8-298fd54eeb2b None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:04.308911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de0d4e-f0c4-40b2-8fb8-298fd54eeb2b None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:04.309421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de0d4e-f0c4-40b2-8fb8-298fd54eeb2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:04.311048 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de0d4e-f0c4-40b2-8fb8-298fd54eeb2b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:04.324416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-29a7008e-5f17-4cb5-8625-44e3d4b0c49e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:04.324416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-29a7008e-5f17-4cb5-8625-44e3d4b0c49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:04.329310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 57/106] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:04.330390 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de0d4e-f0c4-40b2-8fb8-298fd54eeb2b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:04.396798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 50/107] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:04.396798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7008e-5f17-4cb5-8625-44e3d4b0c49e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:04.404317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:04.435639 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:04.493454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de0d4e-f0c4-40b2-8fb8-298fd54eeb2b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:04.513337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7008e-5f17-4cb5-8625-44e3d4b0c49e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:04.532886 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27951136-56b4-4923-a71b-b14b4fdfa429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:04.533775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27951136-56b4-4923-a71b-b14b4fdfa429 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.534168 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27951136-56b4-4923-a71b-b14b4fdfa429 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.534453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27951136-56b4-4923-a71b-b14b4fdfa429 None admin] PATH_INFO: `/v3/users/95a76fa60149455a8ad27ef586bc5044` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:04.535694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27951136-56b4-4923-a71b-b14b4fdfa429 None admin] RBAC: Authorizing `identity:get_user(user_id=95a76fa60149455a8ad27ef586bc5044)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:04.537388 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27951136-56b4-4923-a71b-b14b4fdfa429 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:04.541011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 58/108] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:04 2022] GET /identity/v3/users/95a76fa60149455a8ad27ef586bc5044 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:04.542434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193b503-3052-4d64-8a53-3e3a3a12bf33 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.542734 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193b503-3052-4d64-8a53-3e3a3a12bf33 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.543020 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193b503-3052-4d64-8a53-3e3a3a12bf33 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:04.544382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 59/109] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:04.549237 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193b503-3052-4d64-8a53-3e3a3a12bf33 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:04.550221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef886132-0548-4572-9b9f-b26603be83e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:04.551104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef886132-0548-4572-9b9f-b26603be83e3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.551389 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef886132-0548-4572-9b9f-b26603be83e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.551664 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef886132-0548-4572-9b9f-b26603be83e3 None admin] PATH_INFO: `/v3/users/b4aad040a05d4df4a45e2326d9581c12` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:04.552924 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef886132-0548-4572-9b9f-b26603be83e3 None admin] RBAC: Authorizing `identity:get_user(user_id=b4aad040a05d4df4a45e2326d9581c12)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:04.554551 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef886132-0548-4572-9b9f-b26603be83e3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:04.556547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 51/110] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:04 2022] GET /identity/v3/users/b4aad040a05d4df4a45e2326d9581c12 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:04.557387 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef886132-0548-4572-9b9f-b26603be83e3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:04.655634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:04.664206 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef886132-0548-4572-9b9f-b26603be83e3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:04.667409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193b503-3052-4d64-8a53-3e3a3a12bf33 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:04.675219 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:04.700064 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc44b8-ddf6-40f2-afdc-80985e93c6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:04.700952 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc44b8-ddf6-40f2-afdc-80985e93c6cd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.701237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc44b8-ddf6-40f2-afdc-80985e93c6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.701507 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc44b8-ddf6-40f2-afdc-80985e93c6cd None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:04.702741 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc44b8-ddf6-40f2-afdc-80985e93c6cd None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:04.704131 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc44b8-ddf6-40f2-afdc-80985e93c6cd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:04.706191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 52/111] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:04 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:04.707398 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682587cd-2b17-44c0-8dbe-e0b3c2bc9fbe None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.707687 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682587cd-2b17-44c0-8dbe-e0b3c2bc9fbe None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.707967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682587cd-2b17-44c0-8dbe-e0b3c2bc9fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:04.709406 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b28086-7f30-43a3-95b9-781bd6e88292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:04.711041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b28086-7f30-43a3-95b9-781bd6e88292 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.712120 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b28086-7f30-43a3-95b9-781bd6e88292 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.712426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b28086-7f30-43a3-95b9-781bd6e88292 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:04.724379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b28086-7f30-43a3-95b9-781bd6e88292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:04.725964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-682587cd-2b17-44c0-8dbe-e0b3c2bc9fbe None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:04.727715 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-682587cd-2b17-44c0-8dbe-e0b3c2bc9fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c9b28086-7f30-43a3-95b9-781bd6e88292 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:04.733635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:04.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:04.735218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:04.735218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:04.735218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:04.735218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:04.735218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:04.735218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:04.735218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:04.735218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:04.735218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:04.735218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:04.735218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:04.735218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:04.735218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 60/112] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:04.740303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b28086-7f30-43a3-95b9-781bd6e88292 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:04.808503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 53/113] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:04.808503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aa326-0991-4571-a05e-003d5e25f1db None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.808503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aa326-0991-4571-a05e-003d5e25f1db None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.808503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aa326-0991-4571-a05e-003d5e25f1db None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:04.808503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 54/114] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:04.808503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aa326-0991-4571-a05e-003d5e25f1db None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:04.878449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b28086-7f30-43a3-95b9-781bd6e88292 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:04.905721 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:04.917062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aa326-0991-4571-a05e-003d5e25f1db None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:04.922084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563be077-eb04-4901-901a-fe79a8c36cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:04.922962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563be077-eb04-4901-901a-fe79a8c36cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.923251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563be077-eb04-4901-901a-fe79a8c36cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.923534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563be077-eb04-4901-901a-fe79a8c36cc1 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:04.925178 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563be077-eb04-4901-901a-fe79a8c36cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:04.927029 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563be077-eb04-4901-901a-fe79a8c36cc1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:04.934363 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 61/115] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:04 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:04.934363 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563be077-eb04-4901-901a-fe79a8c36cc1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:04.957647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bae67-c892-4abc-8111-b12508bab404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:04.958560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bae67-c892-4abc-8111-b12508bab404 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.958850 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bae67-c892-4abc-8111-b12508bab404 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.959127 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bae67-c892-4abc-8111-b12508bab404 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e/users/95a76fa60149455a8ad27ef586bc5044/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:04.961191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bae67-c892-4abc-8111-b12508bab404 None admin] RBAC: Authorizing `identity:create_grant(project_id=1658f1fcd1984324979b5dde1834d62e, user_id=95a76fa60149455a8ad27ef586bc5044, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:04.962603 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bae67-c892-4abc-8111-b12508bab404 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:04.973153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:04.977554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 55/116] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:23:04 2022] PUT /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e/users/95a76fa60149455a8ad27ef586bc5044/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:23:04.978815 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adcc4c-a0c5-4f37-80d2-6a68dda4160a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:04.979110 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adcc4c-a0c5-4f37-80d2-6a68dda4160a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:04.979403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adcc4c-a0c5-4f37-80d2-6a68dda4160a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:05.001296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e7adcc4c-a0c5-4f37-80d2-6a68dda4160a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:05.002640 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e7adcc4c-a0c5-4f37-80d2-6a68dda4160a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:05.065451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563be077-eb04-4901-901a-fe79a8c36cc1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:05.088244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 56/117] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:05.089166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adcc4c-a0c5-4f37-80d2-6a68dda4160a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:05.120442 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72bc0f-2f7c-4b74-8182-8115918d48f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:05.121135 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72bc0f-2f7c-4b74-8182-8115918d48f6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:05.121424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72bc0f-2f7c-4b74-8182-8115918d48f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:05.121706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72bc0f-2f7c-4b74-8182-8115918d48f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:05.122466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72bc0f-2f7c-4b74-8182-8115918d48f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:05.122776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72bc0f-2f7c-4b74-8182-8115918d48f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:05.124184 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72bc0f-2f7c-4b74-8182-8115918d48f6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:05.134180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 62/118] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:05.134980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72bc0f-2f7c-4b74-8182-8115918d48f6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:05.186481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:05.209522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adcc4c-a0c5-4f37-80d2-6a68dda4160a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:05.238724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:05.246079 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72bc0f-2f7c-4b74-8182-8115918d48f6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:05.247654 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e6172-540d-4bda-bb62-a769905bcd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:05.248597 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e6172-540d-4bda-bb62-a769905bcd96 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:05.248893 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e6172-540d-4bda-bb62-a769905bcd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:05.249180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e6172-540d-4bda-bb62-a769905bcd96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:05.250384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e6172-540d-4bda-bb62-a769905bcd96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:05.251862 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e6172-540d-4bda-bb62-a769905bcd96 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:05.253705 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 57/119] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:05.258525 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98373-db1a-4e61-b0a1-1e29d6aefffe None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:05.258808 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98373-db1a-4e61-b0a1-1e29d6aefffe None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:05.259087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98373-db1a-4e61-b0a1-1e29d6aefffe None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:05.260403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 58/120] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:05.265173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e98373-db1a-4e61-b0a1-1e29d6aefffe None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:05.290828 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03fe26-60ef-4644-acf9-18ce940f6d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:05.291842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03fe26-60ef-4644-acf9-18ce940f6d16 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:05.292205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03fe26-60ef-4644-acf9-18ce940f6d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:05.292601 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03fe26-60ef-4644-acf9-18ce940f6d16 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e/users/b4aad040a05d4df4a45e2326d9581c12/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:05.294705 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03fe26-60ef-4644-acf9-18ce940f6d16 None admin] RBAC: Authorizing `identity:create_grant(project_id=1658f1fcd1984324979b5dde1834d62e, user_id=b4aad040a05d4df4a45e2326d9581c12, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:05.296236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03fe26-60ef-4644-acf9-18ce940f6d16 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:05.316562 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 63/121] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:23:05 2022] PUT /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e/users/b4aad040a05d4df4a45e2326d9581c12/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:23:05.317529 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03fe26-60ef-4644-acf9-18ce940f6d16 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:05.418088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e98373-db1a-4e61-b0a1-1e29d6aefffe None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:05.451076 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03fe26-60ef-4644-acf9-18ce940f6d16 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:05.480374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815275cc-e8a5-45cb-b5db-80904afe669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:05.481479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815275cc-e8a5-45cb-b5db-80904afe669b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:05.481906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815275cc-e8a5-45cb-b5db-80904afe669b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:05.482345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815275cc-e8a5-45cb-b5db-80904afe669b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:05.497272 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815275cc-e8a5-45cb-b5db-80904afe669b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:05.506430 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19814f-7df0-4777-b314-188105453711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-815275cc-e8a5-45cb-b5db-80904afe669b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:05.506675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:05.507562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:05.508542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:05.508542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:05.508542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:05.508542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:05.508542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:05.508542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:05.508542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:05.508542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:05.508542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:05.508542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:05.508542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:05.508542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:05.509151 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 59/122] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:05.509708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815275cc-e8a5-45cb-b5db-80904afe669b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:05.510934 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19814f-7df0-4777-b314-188105453711 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:05.511433 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19814f-7df0-4777-b314-188105453711 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:05.511899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19814f-7df0-4777-b314-188105453711 None admin] PATH_INFO: `/v3/users/8ac1be4994164ee890b9cd85ced52afe` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:05.526261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:05.537158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19814f-7df0-4777-b314-188105453711 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac1be4994164ee890b9cd85ced52afe)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:05.541043 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19814f-7df0-4777-b314-188105453711 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:05.543799 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 64/123] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:05 2022] GET /identity/v3/users/8ac1be4994164ee890b9cd85ced52afe => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:05.545486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d12e5d-c19c-4bf1-b384-9d70a9723dad None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:05.546171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d12e5d-c19c-4bf1-b384-9d70a9723dad None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:05.547014 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d12e5d-c19c-4bf1-b384-9d70a9723dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:05.568553 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e7d12e5d-c19c-4bf1-b384-9d70a9723dad None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:05.570620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e7d12e5d-c19c-4bf1-b384-9d70a9723dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:05.583728 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:05.635736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815275cc-e8a5-45cb-b5db-80904afe669b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:05.655361 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 65/124] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:05.662456 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d12e5d-c19c-4bf1-b384-9d70a9723dad None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:05.687481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e79659-0523-45eb-a097-67313f6e2968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:05.688207 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e79659-0523-45eb-a097-67313f6e2968 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:05.688533 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e79659-0523-45eb-a097-67313f6e2968 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:05.688817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e79659-0523-45eb-a097-67313f6e2968 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:05.689647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e79659-0523-45eb-a097-67313f6e2968 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:05.691063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e79659-0523-45eb-a097-67313f6e2968 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:05.728555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 60/125] 10.222.0.66 () {60 vars in 1141 bytes} [Fri Jul 15 20:23:05 2022] POST /identity/v3/projects => generated 302 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:23:05.729854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e79659-0523-45eb-a097-67313f6e2968 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:05.850095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d12e5d-c19c-4bf1-b384-9d70a9723dad None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:05.869843 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:05.910737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45aa7bb-0307-4f73-9bca-466da3ab67e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:05.911436 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aa7bb-0307-4f73-9bca-466da3ab67e8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:05.911737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aa7bb-0307-4f73-9bca-466da3ab67e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:05.912023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aa7bb-0307-4f73-9bca-466da3ab67e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:05.912819 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45aa7bb-0307-4f73-9bca-466da3ab67e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:05.913134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45aa7bb-0307-4f73-9bca-466da3ab67e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:05.915534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45aa7bb-0307-4f73-9bca-466da3ab67e8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:05.927202 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 66/126] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:05.928313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45aa7bb-0307-4f73-9bca-466da3ab67e8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:05.944528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:05.954415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e79659-0523-45eb-a097-67313f6e2968 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:06.004821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dd889-fff3-48aa-8e75-38fd1fbee4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:06.006111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dd889-fff3-48aa-8e75-38fd1fbee4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:06.007024 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dd889-fff3-48aa-8e75-38fd1fbee4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:06.008037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dd889-fff3-48aa-8e75-38fd1fbee4f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:06.066482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45aa7bb-0307-4f73-9bca-466da3ab67e8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:06.103720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dd889-fff3-48aa-8e75-38fd1fbee4f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:06.105076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dd889-fff3-48aa-8e75-38fd1fbee4f2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:06.117883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e34b9-dd7d-4b98-8a6b-67754c1c81c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:06.119298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e34b9-dd7d-4b98-8a6b-67754c1c81c9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:06.119787 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e34b9-dd7d-4b98-8a6b-67754c1c81c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:06.120565 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e34b9-dd7d-4b98-8a6b-67754c1c81c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:06.133160 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e34b9-dd7d-4b98-8a6b-67754c1c81c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c24e34b9-dd7d-4b98-8a6b-67754c1c81c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:06.142880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:06.143748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:06.145194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:06.145194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:06.145194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:06.145194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:06.145194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:06.145194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:06.145194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:06.145194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:06.145194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:06.145194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:06.145194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:06.145194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:06.145781 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 67/127] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:23:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:06.146127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e34b9-dd7d-4b98-8a6b-67754c1c81c9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:06.225460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:06.241284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:06.269996 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e34b9-dd7d-4b98-8a6b-67754c1c81c9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:06.307693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c428c-f743-4699-ab20-f88466064f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:06.309108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c428c-f743-4699-ab20-f88466064f47 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:06.309600 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c428c-f743-4699-ab20-f88466064f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:06.310078 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c428c-f743-4699-ab20-f88466064f47 None admin] PATH_INFO: `/v3/users/b4aad040a05d4df4a45e2326d9581c12` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:06.311602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c428c-f743-4699-ab20-f88466064f47 None admin] RBAC: Authorizing `identity:get_user(user_id=b4aad040a05d4df4a45e2326d9581c12)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:06.313304 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c428c-f743-4699-ab20-f88466064f47 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:06.315337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 68/128] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:06 2022] GET /identity/v3/users/b4aad040a05d4df4a45e2326d9581c12 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:06.316303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c428c-f743-4699-ab20-f88466064f47 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:06.349680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 61/129] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:06.350673 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dd889-fff3-48aa-8e75-38fd1fbee4f2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:06.445347 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c428c-f743-4699-ab20-f88466064f47 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:06.482333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b88b5-0f91-4d1f-b835-f274c57bfbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:06.483016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b88b5-0f91-4d1f-b835-f274c57bfbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:06.483307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b88b5-0f91-4d1f-b835-f274c57bfbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:06.483589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b88b5-0f91-4d1f-b835-f274c57bfbe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:06.484487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b88b5-0f91-4d1f-b835-f274c57bfbe2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:06.484807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b88b5-0f91-4d1f-b835-f274c57bfbe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:06.486249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b88b5-0f91-4d1f-b835-f274c57bfbe2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:06.487581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:06.496580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 69/130] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:06.497420 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b88b5-0f91-4d1f-b835-f274c57bfbe2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:06.594570 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dd889-fff3-48aa-8e75-38fd1fbee4f2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:06.604513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b88b5-0f91-4d1f-b835-f274c57bfbe2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:06.645201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cedcd-cfc9-47f7-badb-ff71be7d93d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:06.646080 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cedcd-cfc9-47f7-badb-ff71be7d93d1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:06.646372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cedcd-cfc9-47f7-badb-ff71be7d93d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:06.646654 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cedcd-cfc9-47f7-badb-ff71be7d93d1 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:06.648287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cedcd-cfc9-47f7-badb-ff71be7d93d1 None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:06.649637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cedcd-cfc9-47f7-badb-ff71be7d93d1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:06.656441 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 70/131] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:06 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:06.656441 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cedcd-cfc9-47f7-badb-ff71be7d93d1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:06.683001 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee63936-abf6-4542-9733-e72db0010f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:06.684628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee63936-abf6-4542-9733-e72db0010f2f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:06.685141 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee63936-abf6-4542-9733-e72db0010f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:06.685630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee63936-abf6-4542-9733-e72db0010f2f None admin] PATH_INFO: `/v3/projects/abe7d8bbe677453da68da20b6f6cac57` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:06.693272 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee63936-abf6-4542-9733-e72db0010f2f None admin] RBAC: Authorizing `identity:get_project(project_id=abe7d8bbe677453da68da20b6f6cac57)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:06.695708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee63936-abf6-4542-9733-e72db0010f2f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:06.697842 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 62/132] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:06 2022] GET /identity/v3/projects/abe7d8bbe677453da68da20b6f6cac57 => generated 312 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:06.698855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee63936-abf6-4542-9733-e72db0010f2f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:06.718185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:06.759559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cedcd-cfc9-47f7-badb-ff71be7d93d1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:06.782239 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:06.797165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d54d0-c820-4c5e-835f-f4033413a1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:06.798050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d54d0-c820-4c5e-835f-f4033413a1bc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:06.798341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d54d0-c820-4c5e-835f-f4033413a1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:06.798623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d54d0-c820-4c5e-835f-f4033413a1bc None admin] PATH_INFO: `/v3/users/b4aad040a05d4df4a45e2326d9581c12` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:06.799843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d54d0-c820-4c5e-835f-f4033413a1bc None admin] RBAC: Authorizing `identity:get_user(user_id=b4aad040a05d4df4a45e2326d9581c12)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:06.801366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d54d0-c820-4c5e-835f-f4033413a1bc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:06.803167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 71/133] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:06 2022] GET /identity/v3/users/b4aad040a05d4df4a45e2326d9581c12 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:06.803747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d54d0-c820-4c5e-835f-f4033413a1bc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:06.911586 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d54d0-c820-4c5e-835f-f4033413a1bc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:06.942257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:06.949683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d94d07-63f0-47b7-8f6b-bb98400b44a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:06.950510 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d94d07-63f0-47b7-8f6b-bb98400b44a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:06.950807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d94d07-63f0-47b7-8f6b-bb98400b44a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:06.951088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d94d07-63f0-47b7-8f6b-bb98400b44a2 None admin] PATH_INFO: `/v3/projects/abe7d8bbe677453da68da20b6f6cac57/users/b4aad040a05d4df4a45e2326d9581c12/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:06.953129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d94d07-63f0-47b7-8f6b-bb98400b44a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=abe7d8bbe677453da68da20b6f6cac57, user_id=b4aad040a05d4df4a45e2326d9581c12, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:06.954592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d94d07-63f0-47b7-8f6b-bb98400b44a2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:06.969246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 72/134] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:23:06 2022] PUT /identity/v3/projects/abe7d8bbe677453da68da20b6f6cac57/users/b4aad040a05d4df4a45e2326d9581c12/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:23:06.970446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d94d07-63f0-47b7-8f6b-bb98400b44a2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:06.974969 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee63936-abf6-4542-9733-e72db0010f2f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:07.119233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860efae9-0a05-4727-a75b-787c100d3b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:07.119936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860efae9-0a05-4727-a75b-787c100d3b75 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:07.120228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860efae9-0a05-4727-a75b-787c100d3b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:07.120730 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860efae9-0a05-4727-a75b-787c100d3b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:07.123818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860efae9-0a05-4727-a75b-787c100d3b75 None admin] RBAC: Adding query filter params (role.id=26266094acc24302b4e409ca0f585710, scope.project.id=1658f1fcd1984324979b5dde1834d62e, user.id=8ac1be4994164ee890b9cd85ced52afe) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:07.124151 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860efae9-0a05-4727-a75b-787c100d3b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:07.125694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860efae9-0a05-4727-a75b-787c100d3b75 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:07.129638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d94d07-63f0-47b7-8f6b-bb98400b44a2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:07.146975 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 63/135] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:06 2022] GET /identity/v3/role_assignments?user.id=8ac1be4994164ee890b9cd85ced52afe&scope.project.id=1658f1fcd1984324979b5dde1834d62e&role.id=26266094acc24302b4e409ca0f585710 => generated 259 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:07.185851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1571e0e-8f3d-4043-b1c7-ce07f1d17e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:07.186758 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1571e0e-8f3d-4043-b1c7-ce07f1d17e59 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:07.187049 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1571e0e-8f3d-4043-b1c7-ce07f1d17e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:07.187332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1571e0e-8f3d-4043-b1c7-ce07f1d17e59 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:07.189074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1571e0e-8f3d-4043-b1c7-ce07f1d17e59 None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:07.190611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1571e0e-8f3d-4043-b1c7-ce07f1d17e59 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:07.192575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 73/136] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:06 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:07.199206 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860efae9-0a05-4727-a75b-787c100d3b75 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:07.352741 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:07.359864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860efae9-0a05-4727-a75b-787c100d3b75 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:07.406111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff6fdd-a22e-4002-b89a-4dcaa4f6256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:07.407026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff6fdd-a22e-4002-b89a-4dcaa4f6256b None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:07.407372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff6fdd-a22e-4002-b89a-4dcaa4f6256b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:07.407662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff6fdd-a22e-4002-b89a-4dcaa4f6256b None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e/users/b4aad040a05d4df4a45e2326d9581c12/roles/e97c8dedb3a147c6ab5d98229f5a000c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:07.410071 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff6fdd-a22e-4002-b89a-4dcaa4f6256b None admin] RBAC: Authorizing `identity:create_grant(project_id=1658f1fcd1984324979b5dde1834d62e, user_id=b4aad040a05d4df4a45e2326d9581c12, role_id=e97c8dedb3a147c6ab5d98229f5a000c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:07.411551 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff6fdd-a22e-4002-b89a-4dcaa4f6256b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:07.433590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 64/137] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:23:07 2022] PUT /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e/users/b4aad040a05d4df4a45e2326d9581c12/roles/e97c8dedb3a147c6ab5d98229f5a000c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:23:07.622558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd1216-3cbf-46e1-b3ae-1d7772b9f1dd None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:07.623057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd1216-3cbf-46e1-b3ae-1d7772b9f1dd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:07.623057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd1216-3cbf-46e1-b3ae-1d7772b9f1dd None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:07.624584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 74/138] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:07.630146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9850bf-c854-4272-b0a9-1bc81b1fed00 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:07.630440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9850bf-c854-4272-b0a9-1bc81b1fed00 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:07.630729 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9850bf-c854-4272-b0a9-1bc81b1fed00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:07.653656 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-af9850bf-c854-4272-b0a9-1bc81b1fed00 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:07.654910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-af9850bf-c854-4272-b0a9-1bc81b1fed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:07.743512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 65/139] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:07.787680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd1216-3cbf-46e1-b3ae-1d7772b9f1dd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:07.865120 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:07.909326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eb2b2-76c9-4f03-bd48-378e56a95491 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:07.909625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eb2b2-76c9-4f03-bd48-378e56a95491 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:07.909903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eb2b2-76c9-4f03-bd48-378e56a95491 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:07.911414 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 66/140] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:07.917104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651ab4b-8656-40ff-9114-394e0f138704 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:07.917406 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651ab4b-8656-40ff-9114-394e0f138704 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:07.917695 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651ab4b-8656-40ff-9114-394e0f138704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:07.927317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd1216-3cbf-46e1-b3ae-1d7772b9f1dd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:07.962087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d651ab4b-8656-40ff-9114-394e0f138704 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:07.963309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d651ab4b-8656-40ff-9114-394e0f138704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:07.967113 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b490fe-00b6-4560-842c-4e09be079295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:07.968183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b490fe-00b6-4560-842c-4e09be079295 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:07.968706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b490fe-00b6-4560-842c-4e09be079295 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:07.969194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b490fe-00b6-4560-842c-4e09be079295 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:07.981549 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b490fe-00b6-4560-842c-4e09be079295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a4b490fe-00b6-4560-842c-4e09be079295 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:07.990242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:07.991091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:07.992410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:07.992410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:07.992410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:07.992410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:07.992410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:07.992410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:07.992410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:07.992410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:07.992410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:07.992410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:07.992410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:07.992410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:07.995364 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 75/141] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:23:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:08.000872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b490fe-00b6-4560-842c-4e09be079295 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:08.111638 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 67/142] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:08.121800 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b490fe-00b6-4560-842c-4e09be079295 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:08.147000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:08.161393 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a16dd6-2d95-4158-930f-4910a9234187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:08.162007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a16dd6-2d95-4158-930f-4910a9234187 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:08.162293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a16dd6-2d95-4158-930f-4910a9234187 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:08.162623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a16dd6-2d95-4158-930f-4910a9234187 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:08.163931 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a16dd6-2d95-4158-930f-4910a9234187 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:08.164441 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a16dd6-2d95-4158-930f-4910a9234187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:08.166231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a16dd6-2d95-4158-930f-4910a9234187 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:08.175424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 76/143] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:08.175812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651ab4b-8656-40ff-9114-394e0f138704 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:08.182746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a16dd6-2d95-4158-930f-4910a9234187 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:08.201958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:08.321662 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a16dd6-2d95-4158-930f-4910a9234187 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:08.387089 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe62578-b5f6-4672-8519-ca240679e4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:08.387972 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe62578-b5f6-4672-8519-ca240679e4bc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:08.388253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe62578-b5f6-4672-8519-ca240679e4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:08.388554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe62578-b5f6-4672-8519-ca240679e4bc None admin] PATH_INFO: `/v3/users/95a76fa60149455a8ad27ef586bc5044` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:08.390878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651ab4b-8656-40ff-9114-394e0f138704 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:08.392893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe62578-b5f6-4672-8519-ca240679e4bc None admin] RBAC: Authorizing `identity:get_user(user_id=95a76fa60149455a8ad27ef586bc5044)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:08.394331 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe62578-b5f6-4672-8519-ca240679e4bc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:08.395958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 77/144] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:08 2022] GET /identity/v3/users/95a76fa60149455a8ad27ef586bc5044 => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:08.398197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febc17d-22f6-48ed-b1b6-3c7b717b1c43 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:08.398468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febc17d-22f6-48ed-b1b6-3c7b717b1c43 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:08.398745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febc17d-22f6-48ed-b1b6-3c7b717b1c43 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:08.404849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 78/145] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:08.405611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febc17d-22f6-48ed-b1b6-3c7b717b1c43 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:08.459443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482515d8-b1e2-45e7-a03e-ad5d06c485df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:08.459443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482515d8-b1e2-45e7-a03e-ad5d06c485df None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:08.459443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482515d8-b1e2-45e7-a03e-ad5d06c485df None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:08.459443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482515d8-b1e2-45e7-a03e-ad5d06c485df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:08.481380 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482515d8-b1e2-45e7-a03e-ad5d06c485df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-482515d8-b1e2-45e7-a03e-ad5d06c485df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:08.496416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:08.497342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:08.498105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:08.498105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:08.498105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:08.498105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:08.498105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:08.498105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:08.498105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:08.498105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:08.498105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:08.498105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:08.498105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:08.498105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:08.500758 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 68/146] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:23:08.500875 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:08.502333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3ec92-eefa-4889-ba0f-b85d99b8fb07 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:08.502825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3ec92-eefa-4889-ba0f-b85d99b8fb07 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:08.503304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3ec92-eefa-4889-ba0f-b85d99b8fb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:08.541426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-87b3ec92-eefa-4889-ba0f-b85d99b8fb07 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:08.542940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-87b3ec92-eefa-4889-ba0f-b85d99b8fb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:08.547232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febc17d-22f6-48ed-b1b6-3c7b717b1c43 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:08.583238 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86966c6-882f-4ebc-9341-98430b259fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:08.583992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86966c6-882f-4ebc-9341-98430b259fad None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:08.584344 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86966c6-882f-4ebc-9341-98430b259fad None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:08.584721 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86966c6-882f-4ebc-9341-98430b259fad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:08.658300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86966c6-882f-4ebc-9341-98430b259fad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:08.659867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86966c6-882f-4ebc-9341-98430b259fad None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:08.716833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:08.749773 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 69/147] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:08.751201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3ec92-eefa-4889-ba0f-b85d99b8fb07 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:08.763079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:08.768130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 79/148] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:08.773854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86966c6-882f-4ebc-9341-98430b259fad None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:08.891180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3ec92-eefa-4889-ba0f-b85d99b8fb07 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:08.934845 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0ae5f-f09c-42da-bcc7-8657763ea722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:08.935526 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0ae5f-f09c-42da-bcc7-8657763ea722 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:08.936806 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0ae5f-f09c-42da-bcc7-8657763ea722 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:08.937097 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0ae5f-f09c-42da-bcc7-8657763ea722 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:08.937889 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0ae5f-f09c-42da-bcc7-8657763ea722 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:08.938204 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0ae5f-f09c-42da-bcc7-8657763ea722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:08.939722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0ae5f-f09c-42da-bcc7-8657763ea722 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:08.959982 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 70/149] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:08.960928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0ae5f-f09c-42da-bcc7-8657763ea722 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:09.008915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86966c6-882f-4ebc-9341-98430b259fad None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:09.062588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:09.089687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b57875-8b49-4ea8-9959-cd097a8349f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:09.090555 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b57875-8b49-4ea8-9959-cd097a8349f1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:09.090884 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b57875-8b49-4ea8-9959-cd097a8349f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:09.091164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b57875-8b49-4ea8-9959-cd097a8349f1 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:09.093199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b57875-8b49-4ea8-9959-cd097a8349f1 None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:09.094656 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b57875-8b49-4ea8-9959-cd097a8349f1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:09.102560 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 80/150] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:08 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:09.103340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b57875-8b49-4ea8-9959-cd097a8349f1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:09.124693 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0ae5f-f09c-42da-bcc7-8657763ea722 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:09.144855 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:09.189810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a78205-a8b6-40c0-b28d-ee7ca0177d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:09.190619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a78205-a8b6-40c0-b28d-ee7ca0177d8e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:09.190905 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a78205-a8b6-40c0-b28d-ee7ca0177d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:09.191191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a78205-a8b6-40c0-b28d-ee7ca0177d8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:09.193263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a78205-a8b6-40c0-b28d-ee7ca0177d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:09.196174 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a78205-a8b6-40c0-b28d-ee7ca0177d8e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:09.197986 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 71/151] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:09.200239 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a78205-a8b6-40c0-b28d-ee7ca0177d8e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:09.307797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b57875-8b49-4ea8-9959-cd097a8349f1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:09.345194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19d20e-dd4b-4891-a2a5-6518d5ce63c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:09.346084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19d20e-dd4b-4891-a2a5-6518d5ce63c5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:09.346368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19d20e-dd4b-4891-a2a5-6518d5ce63c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:09.346644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19d20e-dd4b-4891-a2a5-6518d5ce63c5 None admin] PATH_INFO: `/v3/users/b4aad040a05d4df4a45e2326d9581c12` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:09.348013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19d20e-dd4b-4891-a2a5-6518d5ce63c5 None admin] RBAC: Authorizing `identity:get_user(user_id=b4aad040a05d4df4a45e2326d9581c12)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:09.349606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19d20e-dd4b-4891-a2a5-6518d5ce63c5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:09.351492 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 81/152] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:09 2022] GET /identity/v3/users/b4aad040a05d4df4a45e2326d9581c12 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:09.356844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19d20e-dd4b-4891-a2a5-6518d5ce63c5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:09.363522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a78205-a8b6-40c0-b28d-ee7ca0177d8e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:09.425126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc55f09-8a14-4e8c-9f89-5dfb14939d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:09.425798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc55f09-8a14-4e8c-9f89-5dfb14939d28 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:09.426079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc55f09-8a14-4e8c-9f89-5dfb14939d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:09.426357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc55f09-8a14-4e8c-9f89-5dfb14939d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:09.427211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc55f09-8a14-4e8c-9f89-5dfb14939d28 None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=1658f1fcd1984324979b5dde1834d62e, user.id=95a76fa60149455a8ad27ef586bc5044) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:09.427507 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc55f09-8a14-4e8c-9f89-5dfb14939d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:09.429503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc55f09-8a14-4e8c-9f89-5dfb14939d28 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:09.431509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:09.438414 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 72/153] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:09 2022] GET /identity/v3/role_assignments?user.id=95a76fa60149455a8ad27ef586bc5044&scope.project.id=1658f1fcd1984324979b5dde1834d62e&role.id=43e0afe364894278be44a97662ca6f8e => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:09.439239 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc55f09-8a14-4e8c-9f89-5dfb14939d28 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:09.468796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:09.489055 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19d20e-dd4b-4891-a2a5-6518d5ce63c5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:09.557218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a046d76-8678-4125-9027-83c7865a0874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:09.557980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a046d76-8678-4125-9027-83c7865a0874 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:09.558212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a046d76-8678-4125-9027-83c7865a0874 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:09.558490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a046d76-8678-4125-9027-83c7865a0874 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:09.559222 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a046d76-8678-4125-9027-83c7865a0874 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:09.560733 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a046d76-8678-4125-9027-83c7865a0874 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:09.592041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc55f09-8a14-4e8c-9f89-5dfb14939d28 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:09.607412 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 82/154] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:23:09 2022] POST /identity/v3/users => generated 283 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:23:09.631100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10973ae-75dc-4e8c-afcf-ff712b507077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:09.631784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10973ae-75dc-4e8c-afcf-ff712b507077 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:09.632657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10973ae-75dc-4e8c-afcf-ff712b507077 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:09.633130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10973ae-75dc-4e8c-afcf-ff712b507077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:09.707749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:09.711417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10973ae-75dc-4e8c-afcf-ff712b507077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:09.713428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10973ae-75dc-4e8c-afcf-ff712b507077 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:09.821687 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 73/155] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:09.829144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a046d76-8678-4125-9027-83c7865a0874 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:09.938682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a046d76-8678-4125-9027-83c7865a0874 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:09.978887 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7edd57-89ae-4a56-9cd9-5b8d6c1524f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:09.980063 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7edd57-89ae-4a56-9cd9-5b8d6c1524f8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:09.980554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7edd57-89ae-4a56-9cd9-5b8d6c1524f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:09.981054 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7edd57-89ae-4a56-9cd9-5b8d6c1524f8 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:09.982490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7edd57-89ae-4a56-9cd9-5b8d6c1524f8 None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:09.984137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7edd57-89ae-4a56-9cd9-5b8d6c1524f8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:09.986347 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 83/156] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:09 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:09.993250 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10973ae-75dc-4e8c-afcf-ff712b507077 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:10.050228 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4050681-e2ff-4a85-baf4-402bd05c5b9d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:10.050833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4050681-e2ff-4a85-baf4-402bd05c5b9d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:10.051289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4050681-e2ff-4a85-baf4-402bd05c5b9d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:10.052856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 84/157] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:23:10.058755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cc7aa-0c48-4732-92d9-2ee6fe1a4f8e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:10.059746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cc7aa-0c48-4732-92d9-2ee6fe1a4f8e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:10.061509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cc7aa-0c48-4732-92d9-2ee6fe1a4f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:10.080160 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-567cc7aa-0c48-4732-92d9-2ee6fe1a4f8e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:10.082183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-567cc7aa-0c48-4732-92d9-2ee6fe1a4f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:10.086490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:10.126581 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:10.131933 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10973ae-75dc-4e8c-afcf-ff712b507077 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:10.169888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341bf32-af08-4a89-bb32-5a0b9b2485a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:10.170559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341bf32-af08-4a89-bb32-5a0b9b2485a3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:10.170847 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341bf32-af08-4a89-bb32-5a0b9b2485a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:10.171128 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341bf32-af08-4a89-bb32-5a0b9b2485a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:10.171977 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341bf32-af08-4a89-bb32-5a0b9b2485a3 None admin] RBAC: Adding query filter params (role.id=83a7ac2bd20743b78fe0f4689037d83b, scope.project.id=1658f1fcd1984324979b5dde1834d62e, user.id=b4aad040a05d4df4a45e2326d9581c12) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:10.172292 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341bf32-af08-4a89-bb32-5a0b9b2485a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:10.173789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341bf32-af08-4a89-bb32-5a0b9b2485a3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:10.180892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 74/158] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:09 2022] GET /identity/v3/role_assignments?user.id=b4aad040a05d4df4a45e2326d9581c12&scope.project.id=1658f1fcd1984324979b5dde1834d62e&role.id=83a7ac2bd20743b78fe0f4689037d83b => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:10.182198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7c78e-fde7-4278-8bfe-c99c9d436f34 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:10.182493 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7c78e-fde7-4278-8bfe-c99c9d436f34 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:10.182778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7c78e-fde7-4278-8bfe-c99c9d436f34 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:10.184375 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 75/159] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:10.186504 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 85/160] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:10.190033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8129af-8af2-452b-92cf-ef3d4dac7233 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:10.190326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8129af-8af2-452b-92cf-ef3d4dac7233 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:10.190612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8129af-8af2-452b-92cf-ef3d4dac7233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:10.211410 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ae8129af-8af2-452b-92cf-ef3d4dac7233 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:10.212678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ae8129af-8af2-452b-92cf-ef3d4dac7233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:10.215941 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cc7aa-0c48-4732-92d9-2ee6fe1a4f8e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:10.308682 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 76/161] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:10.310318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d30f34-fb37-4df7-97b2-5e9b82a54399 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:10.310608 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d30f34-fb37-4df7-97b2-5e9b82a54399 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:10.310889 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d30f34-fb37-4df7-97b2-5e9b82a54399 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:10.312505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 77/162] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:10.320196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad095f-064c-45ae-8633-2a48f583d38a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:10.320526 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad095f-064c-45ae-8633-2a48f583d38a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:10.320813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad095f-064c-45ae-8633-2a48f583d38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:10.344771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-afad095f-064c-45ae-8633-2a48f583d38a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:10.345442 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cc7aa-0c48-4732-92d9-2ee6fe1a4f8e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:10.345921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-afad095f-064c-45ae-8633-2a48f583d38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:10.389749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f17ac4-1ef1-4505-acbc-ca07e3e84820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:10.390661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f17ac4-1ef1-4505-acbc-ca07e3e84820 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:10.390954 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f17ac4-1ef1-4505-acbc-ca07e3e84820 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:10.391232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f17ac4-1ef1-4505-acbc-ca07e3e84820 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:10.402612 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:10.406345 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f17ac4-1ef1-4505-acbc-ca07e3e84820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-01f17ac4-1ef1-4505-acbc-ca07e3e84820 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:10.415427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:10.416333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:10.417252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:10.417252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:10.417252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:10.417252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:10.417252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:10.417252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:10.417252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:10.417252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:10.417252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:10.417252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:10.417252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:10.417252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:10.417252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 86/163] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:10.421221 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f17ac4-1ef1-4505-acbc-ca07e3e84820 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:10.457829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 78/164] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:10.458822 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad095f-064c-45ae-8633-2a48f583d38a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:10.489256 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:10.582413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f17ac4-1ef1-4505-acbc-ca07e3e84820 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:10.597427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad095f-064c-45ae-8633-2a48f583d38a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:10.627178 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db86f7d-03df-4dd5-91d0-93333d46c0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:10.628738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db86f7d-03df-4dd5-91d0-93333d46c0ff None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:10.629333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db86f7d-03df-4dd5-91d0-93333d46c0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:10.629700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db86f7d-03df-4dd5-91d0-93333d46c0ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:10.639782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c85d86-d5cb-4b0f-8395-ec3e8651a660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:10.640479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c85d86-d5cb-4b0f-8395-ec3e8651a660 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:10.641271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c85d86-d5cb-4b0f-8395-ec3e8651a660 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:10.641271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c85d86-d5cb-4b0f-8395-ec3e8651a660 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:10.641782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c85d86-d5cb-4b0f-8395-ec3e8651a660 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:10.642090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c85d86-d5cb-4b0f-8395-ec3e8651a660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:10.643473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c85d86-d5cb-4b0f-8395-ec3e8651a660 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:10.646088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db86f7d-03df-4dd5-91d0-93333d46c0ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:10.653197 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 79/165] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-1db86f7d-03df-4dd5-91d0-93333d46c0ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:10.654823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:10.655651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:10.656502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:10.656502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:10.656502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:10.656502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:10.656502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:10.656502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:10.656502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:10.656502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:10.656502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:10.656502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:10.656502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:10.656502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:10.656502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 87/166] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:10.657340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c85d86-d5cb-4b0f-8395-ec3e8651a660 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:10.661326 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db86f7d-03df-4dd5-91d0-93333d46c0ff None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:10.731676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:10.776094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db86f7d-03df-4dd5-91d0-93333d46c0ff None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:10.787803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:10.812832 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7e7d6-fdd0-4f8b-8fd6-338f842670ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:10.814074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7e7d6-fdd0-4f8b-8fd6-338f842670ef None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:10.814567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7e7d6-fdd0-4f8b-8fd6-338f842670ef None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:10.815052 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7e7d6-fdd0-4f8b-8fd6-338f842670ef None admin] PATH_INFO: `/v3/users/b4aad040a05d4df4a45e2326d9581c12` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:10.816472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7e7d6-fdd0-4f8b-8fd6-338f842670ef None admin] RBAC: Authorizing `identity:get_user(user_id=b4aad040a05d4df4a45e2326d9581c12)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:10.818127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7e7d6-fdd0-4f8b-8fd6-338f842670ef None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:10.820204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 88/167] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:10 2022] GET /identity/v3/users/b4aad040a05d4df4a45e2326d9581c12 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:10.821277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7e7d6-fdd0-4f8b-8fd6-338f842670ef None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:10.830866 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c85d86-d5cb-4b0f-8395-ec3e8651a660 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:10.905129 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556de4a-86fd-4991-a703-7ab595fe7eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:10.905964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556de4a-86fd-4991-a703-7ab595fe7eee None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:10.906249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556de4a-86fd-4991-a703-7ab595fe7eee None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:10.906529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556de4a-86fd-4991-a703-7ab595fe7eee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:10.927453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7e7d6-fdd0-4f8b-8fd6-338f842670ef None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:10.936607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556de4a-86fd-4991-a703-7ab595fe7eee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8556de4a-86fd-4991-a703-7ab595fe7eee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:10.953605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:10.954513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:10.955356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:10.955356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:10.955356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:10.955356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:10.955356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:10.955356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:10.955356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:10.955356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:10.955356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:10.955356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:10.955356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:10.955356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:10.955356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 80/168] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:23:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:10.956603 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556de4a-86fd-4991-a703-7ab595fe7eee None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:10.959066 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:10.968199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8878e-3f24-48b8-9f46-e11e2c399e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:10.969207 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8878e-3f24-48b8-9f46-e11e2c399e95 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:10.969722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8878e-3f24-48b8-9f46-e11e2c399e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:10.970200 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8878e-3f24-48b8-9f46-e11e2c399e95 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:10.971150 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8878e-3f24-48b8-9f46-e11e2c399e95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:10.971645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8878e-3f24-48b8-9f46-e11e2c399e95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:10.973340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8878e-3f24-48b8-9f46-e11e2c399e95 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:10.983662 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 89/169] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:10.984879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8878e-3f24-48b8-9f46-e11e2c399e95 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:11.094937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8878e-3f24-48b8-9f46-e11e2c399e95 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:11.133082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e324d-6cd1-430c-ab82-e43c1e3d1ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:11.134285 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e324d-6cd1-430c-ab82-e43c1e3d1ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:11.134785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e324d-6cd1-430c-ab82-e43c1e3d1ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:11.135290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e324d-6cd1-430c-ab82-e43c1e3d1ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:11.136275 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e324d-6cd1-430c-ab82-e43c1e3d1ff1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:11.136792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e324d-6cd1-430c-ab82-e43c1e3d1ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:11.138375 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e324d-6cd1-430c-ab82-e43c1e3d1ff1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:11.147225 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 90/170] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:11.149254 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e324d-6cd1-430c-ab82-e43c1e3d1ff1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:11.155001 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556de4a-86fd-4991-a703-7ab595fe7eee None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:11.205878 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:11.221892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfb7e5-3723-45fb-9879-faf72d6df756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:11.222559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfb7e5-3723-45fb-9879-faf72d6df756 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:11.222848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfb7e5-3723-45fb-9879-faf72d6df756 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:11.223133 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfb7e5-3723-45fb-9879-faf72d6df756 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:11.255137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:11.258737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e324d-6cd1-430c-ab82-e43c1e3d1ff1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:11.294124 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6fc24-5c63-485c-9205-d05e029b71d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:11.295430 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6fc24-5c63-485c-9205-d05e029b71d3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:11.295921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6fc24-5c63-485c-9205-d05e029b71d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:11.296430 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6fc24-5c63-485c-9205-d05e029b71d3 None admin] PATH_INFO: `/v3/users/8ac1be4994164ee890b9cd85ced52afe` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:11.297894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6fc24-5c63-485c-9205-d05e029b71d3 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac1be4994164ee890b9cd85ced52afe)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:11.299559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6fc24-5c63-485c-9205-d05e029b71d3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:11.301871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 91/171] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:11 2022] GET /identity/v3/users/8ac1be4994164ee890b9cd85ced52afe => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:11.302828 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6fc24-5c63-485c-9205-d05e029b71d3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:11.341000 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfb7e5-3723-45fb-9879-faf72d6df756 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:11.342790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfb7e5-3723-45fb-9879-faf72d6df756 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:11.476817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 81/172] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:11.478375 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfb7e5-3723-45fb-9879-faf72d6df756 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:11.529778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:11.578530 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6fc24-5c63-485c-9205-d05e029b71d3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:11.587840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfb7e5-3723-45fb-9879-faf72d6df756 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:11.623960 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fb91c-a748-4c4d-a6a4-8bd745913b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:11.625146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fb91c-a748-4c4d-a6a4-8bd745913b97 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:11.625620 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fb91c-a748-4c4d-a6a4-8bd745913b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:11.626057 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fb91c-a748-4c4d-a6a4-8bd745913b97 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:11.627394 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fb91c-a748-4c4d-a6a4-8bd745913b97 None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:11.629013 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fb91c-a748-4c4d-a6a4-8bd745913b97 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:11.630886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 82/173] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:11 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:11.631635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:11.637741 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fb91c-a748-4c4d-a6a4-8bd745913b97 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:11.717380 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea19d3-6fc3-44f3-b6fe-4967cec4bdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:11.717974 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea19d3-6fc3-44f3-b6fe-4967cec4bdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:11.718267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea19d3-6fc3-44f3-b6fe-4967cec4bdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:11.718548 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea19d3-6fc3-44f3-b6fe-4967cec4bdd1 None admin] PATH_INFO: `/v3/users/b4aad040a05d4df4a45e2326d9581c12` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:11.725134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea19d3-6fc3-44f3-b6fe-4967cec4bdd1 None admin] RBAC: Authorizing `identity:get_user(user_id=b4aad040a05d4df4a45e2326d9581c12)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:11.726764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea19d3-6fc3-44f3-b6fe-4967cec4bdd1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:11.728436 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 92/174] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:11 2022] GET /identity/v3/users/b4aad040a05d4df4a45e2326d9581c12 => generated 275 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:11.729188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea19d3-6fc3-44f3-b6fe-4967cec4bdd1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:11.744297 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fb91c-a748-4c4d-a6a4-8bd745913b97 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:11.760761 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:11.784668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a679f6-9731-4c4a-a6aa-b0e4de98a321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:11.785767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a679f6-9731-4c4a-a6aa-b0e4de98a321 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:11.786224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a679f6-9731-4c4a-a6aa-b0e4de98a321 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:11.786649 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a679f6-9731-4c4a-a6aa-b0e4de98a321 None admin] PATH_INFO: `/v3/projects/abe7d8bbe677453da68da20b6f6cac57` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:11.788026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a679f6-9731-4c4a-a6aa-b0e4de98a321 None admin] RBAC: Authorizing `identity:get_project(project_id=abe7d8bbe677453da68da20b6f6cac57)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:11.790238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a679f6-9731-4c4a-a6aa-b0e4de98a321 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:11.792247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 83/175] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:11 2022] GET /identity/v3/projects/abe7d8bbe677453da68da20b6f6cac57 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:11.793282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a679f6-9731-4c4a-a6aa-b0e4de98a321 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:11.853007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea19d3-6fc3-44f3-b6fe-4967cec4bdd1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:11.889688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c63ee-ddc4-4e02-a444-6e07e85c31ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:11.892793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c63ee-ddc4-4e02-a444-6e07e85c31ad None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:11.893086 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c63ee-ddc4-4e02-a444-6e07e85c31ad None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:11.893370 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c63ee-ddc4-4e02-a444-6e07e85c31ad None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e/users/8ac1be4994164ee890b9cd85ced52afe/roles/26266094acc24302b4e409ca0f585710` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:11.901086 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c63ee-ddc4-4e02-a444-6e07e85c31ad None admin] RBAC: Authorizing `identity:create_grant(project_id=1658f1fcd1984324979b5dde1834d62e, user_id=8ac1be4994164ee890b9cd85ced52afe, role_id=26266094acc24302b4e409ca0f585710)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:11.902565 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c63ee-ddc4-4e02-a444-6e07e85c31ad None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:11.927397 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 93/176] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:23:11 2022] PUT /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e/users/8ac1be4994164ee890b9cd85ced52afe/roles/26266094acc24302b4e409ca0f585710 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:23:11.928281 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c63ee-ddc4-4e02-a444-6e07e85c31ad None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:11.955247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a679f6-9731-4c4a-a6aa-b0e4de98a321 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:12.005270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:12.022951 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb91196-866d-46fe-b853-9f5439020ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:12.023979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb91196-866d-46fe-b853-9f5439020ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:12.024497 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb91196-866d-46fe-b853-9f5439020ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:12.025003 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb91196-866d-46fe-b853-9f5439020ce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:12.068444 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c63ee-ddc4-4e02-a444-6e07e85c31ad None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:12.118897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:12.125146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ebf35-d2cf-4578-9a27-bd8abfa43a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:12.125841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ebf35-d2cf-4578-9a27-bd8abfa43a21 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:12.126133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ebf35-d2cf-4578-9a27-bd8abfa43a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:12.126414 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ebf35-d2cf-4578-9a27-bd8abfa43a21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:12.127293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ebf35-d2cf-4578-9a27-bd8abfa43a21 None admin] RBAC: Adding query filter params (role.id=83a7ac2bd20743b78fe0f4689037d83b, scope.project.id=abe7d8bbe677453da68da20b6f6cac57, user.id=b4aad040a05d4df4a45e2326d9581c12) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:12.127607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ebf35-d2cf-4578-9a27-bd8abfa43a21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:12.129105 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ebf35-d2cf-4578-9a27-bd8abfa43a21 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:12.140420 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 94/177] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:11 2022] GET /identity/v3/role_assignments?user.id=b4aad040a05d4df4a45e2326d9581c12&scope.project.id=abe7d8bbe677453da68da20b6f6cac57&role.id=83a7ac2bd20743b78fe0f4689037d83b => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:12.160323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb91196-866d-46fe-b853-9f5439020ce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:12.163904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb91196-866d-46fe-b853-9f5439020ce9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:12.286453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 84/178] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:12.292870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ebf35-d2cf-4578-9a27-bd8abfa43a21 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:12.441843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ebf35-d2cf-4578-9a27-bd8abfa43a21 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:12.461151 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:12.490195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6c902-912b-4e91-b90c-8bb562e1a844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:12.491075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6c902-912b-4e91-b90c-8bb562e1a844 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:12.491900 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6c902-912b-4e91-b90c-8bb562e1a844 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:12.492181 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6c902-912b-4e91-b90c-8bb562e1a844 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:12.493408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6c902-912b-4e91-b90c-8bb562e1a844 None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:12.494860 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6c902-912b-4e91-b90c-8bb562e1a844 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:12.496593 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 95/179] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:12 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:12.502776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb91196-866d-46fe-b853-9f5439020ce9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:12.622377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:12.643650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb91196-866d-46fe-b853-9f5439020ce9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:12.680147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e3970-e6b6-456e-8a47-6cf6aa0af5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:12.680844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e3970-e6b6-456e-8a47-6cf6aa0af5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:12.681128 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e3970-e6b6-456e-8a47-6cf6aa0af5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:12.681406 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e3970-e6b6-456e-8a47-6cf6aa0af5a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:12.682246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e3970-e6b6-456e-8a47-6cf6aa0af5a4 None admin] RBAC: Adding query filter params (role.id=e97c8dedb3a147c6ab5d98229f5a000c, scope.project.id=1658f1fcd1984324979b5dde1834d62e, user.id=b4aad040a05d4df4a45e2326d9581c12) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:12.682558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e3970-e6b6-456e-8a47-6cf6aa0af5a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:12.684082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e3970-e6b6-456e-8a47-6cf6aa0af5a4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:12.690786 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 85/180] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:12 2022] GET /identity/v3/role_assignments?user.id=b4aad040a05d4df4a45e2326d9581c12&scope.project.id=1658f1fcd1984324979b5dde1834d62e&role.id=e97c8dedb3a147c6ab5d98229f5a000c => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:12.698520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67799e-c7e3-448d-991f-78f6bf35a7e1 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:12.698820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67799e-c7e3-448d-991f-78f6bf35a7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:12.699084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67799e-c7e3-448d-991f-78f6bf35a7e1 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:12.700866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 96/181] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:12.706505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41519da-0a2d-42ab-8fe6-c749a39b434e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:12.706810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41519da-0a2d-42ab-8fe6-c749a39b434e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:12.707070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41519da-0a2d-42ab-8fe6-c749a39b434e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:12.725182 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d41519da-0a2d-42ab-8fe6-c749a39b434e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:12.727003 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d41519da-0a2d-42ab-8fe6-c749a39b434e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:12.809691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 86/182] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:12.849936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67799e-c7e3-448d-991f-78f6bf35a7e1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:12.988649 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67799e-c7e3-448d-991f-78f6bf35a7e1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:13.025775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86c0fa-d812-4d78-990c-941d974e39b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:13.026569 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86c0fa-d812-4d78-990c-941d974e39b4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:13.026909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86c0fa-d812-4d78-990c-941d974e39b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:13.027186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86c0fa-d812-4d78-990c-941d974e39b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:13.037542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86c0fa-d812-4d78-990c-941d974e39b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2b86c0fa-d812-4d78-990c-941d974e39b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:13.045881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:13.046780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:13.047545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:13.047545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:13.047545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:13.047545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:13.047545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:13.047545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:13.047545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:13.047545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:13.047545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:13.047545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:13.047545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:13.047545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:13.047545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 97/183] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:23:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:13.054756 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41519da-0a2d-42ab-8fe6-c749a39b434e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:13.108024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c2972-e60b-44e8-84a3-36a9a089eaf2 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:13.108326 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c2972-e60b-44e8-84a3-36a9a089eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:13.108600 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c2972-e60b-44e8-84a3-36a9a089eaf2 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:13.110234 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 98/184] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:23:13.115206 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85b030-30f2-4256-af20-b08f7602a202 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:13.115612 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85b030-30f2-4256-af20-b08f7602a202 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:13.115788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85b030-30f2-4256-af20-b08f7602a202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:13.136664 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1b85b030-30f2-4256-af20-b08f7602a202 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:13.137866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1b85b030-30f2-4256-af20-b08f7602a202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:13.168100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:13.196217 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:13.200984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41519da-0a2d-42ab-8fe6-c749a39b434e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:13.236508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 99/185] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:13.242028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463696b5-e4ab-440f-bb2c-24bddd84e769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:13.242632 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463696b5-e4ab-440f-bb2c-24bddd84e769 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:13.242919 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463696b5-e4ab-440f-bb2c-24bddd84e769 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:13.243199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463696b5-e4ab-440f-bb2c-24bddd84e769 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:13.244053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463696b5-e4ab-440f-bb2c-24bddd84e769 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:13.244372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463696b5-e4ab-440f-bb2c-24bddd84e769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:13.245811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463696b5-e4ab-440f-bb2c-24bddd84e769 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:13.254359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 87/186] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:13.260866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85b030-30f2-4256-af20-b08f7602a202 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:13.262634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463696b5-e4ab-440f-bb2c-24bddd84e769 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:13.372514 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85b030-30f2-4256-af20-b08f7602a202 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:13.375786 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463696b5-e4ab-440f-bb2c-24bddd84e769 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:13.408541 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41280e57-a1f3-41b3-99cb-2f75b1f97483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:13.409424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41280e57-a1f3-41b3-99cb-2f75b1f97483 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:13.409535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c1e5f-3d89-4767-8d91-5b6afd238305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:13.409732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41280e57-a1f3-41b3-99cb-2f75b1f97483 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:13.409977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41280e57-a1f3-41b3-99cb-2f75b1f97483 None admin] PATH_INFO: `/v3/users/11a2a2649aab41798ed4755463e7973e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:13.410274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c1e5f-3d89-4767-8d91-5b6afd238305 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:13.410554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c1e5f-3d89-4767-8d91-5b6afd238305 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:13.410829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c1e5f-3d89-4767-8d91-5b6afd238305 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:13.414587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:13.423083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c1e5f-3d89-4767-8d91-5b6afd238305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:13.426159 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41280e57-a1f3-41b3-99cb-2f75b1f97483 None admin] RBAC: Authorizing `identity:get_user(user_id=11a2a2649aab41798ed4755463e7973e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:13.427655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41280e57-a1f3-41b3-99cb-2f75b1f97483 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:13.429713 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 100/187] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:13 2022] GET /identity/v3/users/11a2a2649aab41798ed4755463e7973e => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:13.430791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e21a6-258c-490a-9a4c-518e379794a5 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:13.431083 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e21a6-258c-490a-9a4c-518e379794a5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:13.431364 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e21a6-258c-490a-9a4c-518e379794a5 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:13.432763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 101/188] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:13.434804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e21a6-258c-490a-9a4c-518e379794a5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-fc6c1e5f-3d89-4767-8d91-5b6afd238305 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:13.435920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:13.436830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:13.440923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:13.440923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:13.440923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:13.440923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:13.440923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:13.440923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:13.440923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:13.440923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:13.440923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:13.440923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:13.440923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:13.440923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:13.440923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 88/189] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:23:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:13.445181 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e4b9f-f697-4c90-9294-ccb2d000fbad None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:13.445547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e4b9f-f697-4c90-9294-ccb2d000fbad None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:13.445741 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e4b9f-f697-4c90-9294-ccb2d000fbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:13.462891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-377e4b9f-f697-4c90-9294-ccb2d000fbad None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:13.464100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-377e4b9f-f697-4c90-9294-ccb2d000fbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:13.473599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:13.539860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 89/190] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:13.540725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e4b9f-f697-4c90-9294-ccb2d000fbad None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:13.570041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e21a6-258c-490a-9a4c-518e379794a5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:13.606734 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db693b-1651-436f-b9fe-473c119af5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:13.607396 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db693b-1651-436f-b9fe-473c119af5dd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:13.607684 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db693b-1651-436f-b9fe-473c119af5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:13.607961 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db693b-1651-436f-b9fe-473c119af5dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:13.649065 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e4b9f-f697-4c90-9294-ccb2d000fbad None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:13.676901 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:13.682045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db693b-1651-436f-b9fe-473c119af5dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:13.683501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db693b-1651-436f-b9fe-473c119af5dd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:13.689237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326033a2-91b3-4288-bad0-850419453e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:13.690172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326033a2-91b3-4288-bad0-850419453e16 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:13.690584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326033a2-91b3-4288-bad0-850419453e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:13.691482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326033a2-91b3-4288-bad0-850419453e16 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:13.692374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326033a2-91b3-4288-bad0-850419453e16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:13.692852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326033a2-91b3-4288-bad0-850419453e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:13.694349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326033a2-91b3-4288-bad0-850419453e16 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:13.702882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 90/191] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:13.703819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326033a2-91b3-4288-bad0-850419453e16 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:13.716522 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:13.791633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 102/192] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:23:13.792498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db693b-1651-436f-b9fe-473c119af5dd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:13.815861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326033a2-91b3-4288-bad0-850419453e16 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:13.852065 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bd66a-4316-4656-8a2f-e3fb929a535a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:13.852882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bd66a-4316-4656-8a2f-e3fb929a535a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:13.853164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bd66a-4316-4656-8a2f-e3fb929a535a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:13.853509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bd66a-4316-4656-8a2f-e3fb929a535a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:13.854588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bd66a-4316-4656-8a2f-e3fb929a535a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:13.856041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bd66a-4316-4656-8a2f-e3fb929a535a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:13.857838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 91/193] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:13.861523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bd66a-4316-4656-8a2f-e3fb929a535a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:13.895570 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db693b-1651-436f-b9fe-473c119af5dd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:13.922557 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:13.924187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:13.934700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d92b88-7804-4899-9d91-ae4e65175f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:13.935896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d92b88-7804-4899-9d91-ae4e65175f88 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:13.936355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d92b88-7804-4899-9d91-ae4e65175f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:13.936893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d92b88-7804-4899-9d91-ae4e65175f88 None admin] PATH_INFO: `/v3/users/11a2a2649aab41798ed4755463e7973e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:13.938387 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d92b88-7804-4899-9d91-ae4e65175f88 None admin] RBAC: Authorizing `identity:get_user(user_id=11a2a2649aab41798ed4755463e7973e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:13.940054 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d92b88-7804-4899-9d91-ae4e65175f88 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:13.941911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 103/194] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:13 2022] GET /identity/v3/users/11a2a2649aab41798ed4755463e7973e => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:13.945557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d92b88-7804-4899-9d91-ae4e65175f88 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:13.972151 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bd66a-4316-4656-8a2f-e3fb929a535a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:14.008633 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a07bf3-34be-4067-95c6-a459463df21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:14.009498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07bf3-34be-4067-95c6-a459463df21c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:14.009772 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07bf3-34be-4067-95c6-a459463df21c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:14.010053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07bf3-34be-4067-95c6-a459463df21c None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:14.011234 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a07bf3-34be-4067-95c6-a459463df21c None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:14.012733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a07bf3-34be-4067-95c6-a459463df21c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:14.019039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 92/195] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:13 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:14.019039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a07bf3-34be-4067-95c6-a459463df21c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:14.060263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d92b88-7804-4899-9d91-ae4e65175f88 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:14.096482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e835719-a501-4f73-b880-eaef6dd17c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:14.097097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e835719-a501-4f73-b880-eaef6dd17c1a None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:14.097554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e835719-a501-4f73-b880-eaef6dd17c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:14.097864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e835719-a501-4f73-b880-eaef6dd17c1a None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:14.098554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e835719-a501-4f73-b880-eaef6dd17c1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:14.100021 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e835719-a501-4f73-b880-eaef6dd17c1a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:14.122617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 104/196] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:23:13 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:23:14.122845 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a07bf3-34be-4067-95c6-a459463df21c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:14.133630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e835719-a501-4f73-b880-eaef6dd17c1a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:14.153605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:14.169220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15a786-52ab-422f-ab54-30b2ce6c02df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:14.170332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15a786-52ab-422f-ab54-30b2ce6c02df None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:14.170843 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15a786-52ab-422f-ab54-30b2ce6c02df None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:14.171329 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15a786-52ab-422f-ab54-30b2ce6c02df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:14.212918 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:14.260722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15a786-52ab-422f-ab54-30b2ce6c02df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:14.262423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15a786-52ab-422f-ab54-30b2ce6c02df None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:14.278227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e835719-a501-4f73-b880-eaef6dd17c1a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:14.321762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6b34a-ae8a-4cdf-89b0-0d77e8ad1244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:14.322360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b34a-ae8a-4cdf-89b0-0d77e8ad1244 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:14.322648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b34a-ae8a-4cdf-89b0-0d77e8ad1244 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:14.322923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b34a-ae8a-4cdf-89b0-0d77e8ad1244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:14.323765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6b34a-ae8a-4cdf-89b0-0d77e8ad1244 None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6, user.id=11a2a2649aab41798ed4755463e7973e) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:14.324075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6b34a-ae8a-4cdf-89b0-0d77e8ad1244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:14.325812 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6b34a-ae8a-4cdf-89b0-0d77e8ad1244 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:14.332136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 105/197] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:14 2022] GET /identity/v3/role_assignments?user.id=11a2a2649aab41798ed4755463e7973e&scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6&role.id=43e0afe364894278be44a97662ca6f8e => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:14.394368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 93/198] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:14.400832 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6b34a-ae8a-4cdf-89b0-0d77e8ad1244 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:14.422099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc740d38-4753-45b8-b4cc-f1319775c87f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:14.422529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc740d38-4753-45b8-b4cc-f1319775c87f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:14.422926 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc740d38-4753-45b8-b4cc-f1319775c87f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:14.424771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 94/199] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:14.430578 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a6c8f-546b-4a70-b16c-4b48d9ad8a40 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:14.431093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a6c8f-546b-4a70-b16c-4b48d9ad8a40 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:14.431519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a6c8f-546b-4a70-b16c-4b48d9ad8a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:14.455499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-908a6c8f-546b-4a70-b16c-4b48d9ad8a40 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:14.455499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-908a6c8f-546b-4a70-b16c-4b48d9ad8a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:14.478887 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:14.530500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6b34a-ae8a-4cdf-89b0-0d77e8ad1244 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:14.538048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 95/200] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:14.550954 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:14.563179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a6c8f-546b-4a70-b16c-4b48d9ad8a40 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:14.573895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc4180-f821-436c-b45d-5f0ffa6284df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:14.574853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc4180-f821-436c-b45d-5f0ffa6284df None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:14.575145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc4180-f821-436c-b45d-5f0ffa6284df None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:14.575476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc4180-f821-436c-b45d-5f0ffa6284df None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:14.576785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc4180-f821-436c-b45d-5f0ffa6284df None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:14.578335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc4180-f821-436c-b45d-5f0ffa6284df None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:14.584498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 106/201] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:14 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:14.587618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc4180-f821-436c-b45d-5f0ffa6284df None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:14.726256 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a6c8f-546b-4a70-b16c-4b48d9ad8a40 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:14.744227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc4180-f821-436c-b45d-5f0ffa6284df None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:14.790664 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24972b-d20a-449a-9587-a0d266f69a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:14.791467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24972b-d20a-449a-9587-a0d266f69a53 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:14.791748 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24972b-d20a-449a-9587-a0d266f69a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:14.792018 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24972b-d20a-449a-9587-a0d266f69a53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:14.807823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a95947-eb85-4257-bf19-b59200f379a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:14.808565 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a95947-eb85-4257-bf19-b59200f379a6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:14.808849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a95947-eb85-4257-bf19-b59200f379a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:14.809123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a95947-eb85-4257-bf19-b59200f379a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:14.809961 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a95947-eb85-4257-bf19-b59200f379a6 None admin] RBAC: Adding query filter params (role.id=e97c8dedb3a147c6ab5d98229f5a000c, scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6, user.id=11a2a2649aab41798ed4755463e7973e) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:14.810271 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a95947-eb85-4257-bf19-b59200f379a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:14.811712 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a95947-eb85-4257-bf19-b59200f379a6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:14.816339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24972b-d20a-449a-9587-a0d266f69a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0f24972b-d20a-449a-9587-a0d266f69a53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:14.826681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:14.827647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:14.828429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:14.828429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:14.828429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:14.828429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:14.828429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:14.828429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:14.828429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:14.828429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:14.828429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:14.828429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:14.828429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:14.828429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:14.828429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 96/202] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:14.834269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 107/203] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:14 2022] GET /identity/v3/role_assignments?user.id=11a2a2649aab41798ed4755463e7973e&scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6&role.id=e97c8dedb3a147c6ab5d98229f5a000c => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:14.835600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24972b-d20a-449a-9587-a0d266f69a53 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:14.863073 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:14.980624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24972b-d20a-449a-9587-a0d266f69a53 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:15.034225 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f278d-8027-4c28-8f07-9da71c6338af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:15.034909 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f278d-8027-4c28-8f07-9da71c6338af None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:15.035196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f278d-8027-4c28-8f07-9da71c6338af None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:15.035477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f278d-8027-4c28-8f07-9da71c6338af None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:15.036237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f278d-8027-4c28-8f07-9da71c6338af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:15.036709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f278d-8027-4c28-8f07-9da71c6338af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:15.038125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f278d-8027-4c28-8f07-9da71c6338af None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:15.055372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 97/204] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:15.060981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a95947-eb85-4257-bf19-b59200f379a6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:15.139519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:15.208529 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a95947-eb85-4257-bf19-b59200f379a6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:15.247247 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a5414-3657-4c97-bfac-1fabd4f6e500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:15.248181 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a5414-3657-4c97-bfac-1fabd4f6e500 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:15.248569 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a5414-3657-4c97-bfac-1fabd4f6e500 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:15.248898 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a5414-3657-4c97-bfac-1fabd4f6e500 None admin] PATH_INFO: `/v3/users/8ac1be4994164ee890b9cd85ced52afe` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:15.250109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a5414-3657-4c97-bfac-1fabd4f6e500 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac1be4994164ee890b9cd85ced52afe)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:15.251549 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a5414-3657-4c97-bfac-1fabd4f6e500 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:15.253388 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 108/205] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:15 2022] GET /identity/v3/users/8ac1be4994164ee890b9cd85ced52afe => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:15.259776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f278d-8027-4c28-8f07-9da71c6338af None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:15.341861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:15.365802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f278d-8027-4c28-8f07-9da71c6338af None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:15.401632 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e2869-28c9-4bb4-aa60-d77528d9208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:15.402340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e2869-28c9-4bb4-aa60-d77528d9208c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:15.402624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e2869-28c9-4bb4-aa60-d77528d9208c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:15.402893 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e2869-28c9-4bb4-aa60-d77528d9208c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:15.473822 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e2869-28c9-4bb4-aa60-d77528d9208c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:15.475523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e2869-28c9-4bb4-aa60-d77528d9208c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:15.553238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:15.582547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 98/206] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:15.583896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a5414-3657-4c97-bfac-1fabd4f6e500 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:15.750693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a5414-3657-4c97-bfac-1fabd4f6e500 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:15.768226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:15.798168 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae274dd-bd3a-48d6-9f50-b0d521f530a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:15.799395 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae274dd-bd3a-48d6-9f50-b0d521f530a1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:15.799875 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae274dd-bd3a-48d6-9f50-b0d521f530a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:15.800340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae274dd-bd3a-48d6-9f50-b0d521f530a1 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:15.801768 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae274dd-bd3a-48d6-9f50-b0d521f530a1 None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:15.803459 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae274dd-bd3a-48d6-9f50-b0d521f530a1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:15.805442 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 109/207] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:15 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:15.811504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e2869-28c9-4bb4-aa60-d77528d9208c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:15.931625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e2869-28c9-4bb4-aa60-d77528d9208c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:15.966810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51226554-74a0-40ca-a75e-4d4f75b82fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:15.967490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226554-74a0-40ca-a75e-4d4f75b82fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:15.967775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226554-74a0-40ca-a75e-4d4f75b82fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:15.968056 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226554-74a0-40ca-a75e-4d4f75b82fb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:15.968950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51226554-74a0-40ca-a75e-4d4f75b82fb6 None admin] RBAC: Adding query filter params (role.id=26266094acc24302b4e409ca0f585710, scope.project.id=1658f1fcd1984324979b5dde1834d62e, user.id=8ac1be4994164ee890b9cd85ced52afe) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:15.969264 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51226554-74a0-40ca-a75e-4d4f75b82fb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:15.970756 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51226554-74a0-40ca-a75e-4d4f75b82fb6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:15.984563 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 99/208] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:15 2022] GET /identity/v3/role_assignments?user.id=8ac1be4994164ee890b9cd85ced52afe&scope.project.id=1658f1fcd1984324979b5dde1834d62e&role.id=26266094acc24302b4e409ca0f585710 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:16.712950 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dc1a8-df26-40a9-b038-78622a3ad489 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:16.713946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dc1a8-df26-40a9-b038-78622a3ad489 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:16.714428 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dc1a8-df26-40a9-b038-78622a3ad489 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:16.716003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 110/209] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:16.721491 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393efc5-809c-4478-8918-cf589f831f6c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:16.722277 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393efc5-809c-4478-8918-cf589f831f6c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:16.722749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393efc5-809c-4478-8918-cf589f831f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:16.739812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f393efc5-809c-4478-8918-cf589f831f6c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:16.741839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f393efc5-809c-4478-8918-cf589f831f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:16.761958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969aa85-0dee-4eaf-a230-409ee559bee5 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:16.762270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969aa85-0dee-4eaf-a230-409ee559bee5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:16.762512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969aa85-0dee-4eaf-a230-409ee559bee5 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:16.764017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 111/210] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:23:16.769280 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dacc0e-acf8-4c3c-85e4-b3a5cd449e3d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:16.769826 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dacc0e-acf8-4c3c-85e4-b3a5cd449e3d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:16.770309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dacc0e-acf8-4c3c-85e4-b3a5cd449e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:16.782791 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:16.788861 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c8dacc0e-acf8-4c3c-85e4-b3a5cd449e3d None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:16.790740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c8dacc0e-acf8-4c3c-85e4-b3a5cd449e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:16.825361 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 100/211] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:16.846982 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393efc5-809c-4478-8918-cf589f831f6c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:16.863266 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 112/212] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:16.886765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dacc0e-acf8-4c3c-85e4-b3a5cd449e3d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:16.961695 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393efc5-809c-4478-8918-cf589f831f6c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:16.997236 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1dd96-c9ec-46d5-82fe-afa8c3e03a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:16.997943 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1dd96-c9ec-46d5-82fe-afa8c3e03a8c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:16.998224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1dd96-c9ec-46d5-82fe-afa8c3e03a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:16.998502 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1dd96-c9ec-46d5-82fe-afa8c3e03a8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.012094 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1dd96-c9ec-46d5-82fe-afa8c3e03a8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:17.018198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dacc0e-acf8-4c3c-85e4-b3a5cd449e3d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-aab1dd96-c9ec-46d5-82fe-afa8c3e03a8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:17.020307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:17.021176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:17.021936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:17.021936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:17.021936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:17.021936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:17.021936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:17.021936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:17.021936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:17.021936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:17.021936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:17.021936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:17.021936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:17.021936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:17.021936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 101/213] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:23:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:23:17.023909 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df6785-4736-47b5-969b-a31ce676b25b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:17.023909 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df6785-4736-47b5-969b-a31ce676b25b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:17.023909 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df6785-4736-47b5-969b-a31ce676b25b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.028685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 102/214] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:17.028685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df6785-4736-47b5-969b-a31ce676b25b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:17.039336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:17.062201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78744f-a829-471b-9430-fbd39e7d2c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:17.063004 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78744f-a829-471b-9430-fbd39e7d2c0f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:17.063289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78744f-a829-471b-9430-fbd39e7d2c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:17.063577 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78744f-a829-471b-9430-fbd39e7d2c0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.066538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:17.075055 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78744f-a829-471b-9430-fbd39e7d2c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-5f78744f-a829-471b-9430-fbd39e7d2c0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:17.083197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:17.084100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:17.084930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:17.084930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:17.084930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:17.084930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:17.084930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:17.084930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:17.084930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:17.084930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:17.084930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:17.084930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:17.084930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:17.084930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:17.086126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 113/215] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:23:17.087126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96fdce-2ae4-42ec-9e86-efbc07f22e12 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:17.087421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96fdce-2ae4-42ec-9e86-efbc07f22e12 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:17.087704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96fdce-2ae4-42ec-9e86-efbc07f22e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.106598 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cc96fdce-2ae4-42ec-9e86-efbc07f22e12 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:17.107795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cc96fdce-2ae4-42ec-9e86-efbc07f22e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:17.152600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df6785-4736-47b5-969b-a31ce676b25b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:17.177863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 114/216] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:17.179082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96fdce-2ae4-42ec-9e86-efbc07f22e12 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:17.205612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5472fb-5d55-4dc8-abdc-16fffc6229c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:17.206452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5472fb-5d55-4dc8-abdc-16fffc6229c8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:17.206743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5472fb-5d55-4dc8-abdc-16fffc6229c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:17.207029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5472fb-5d55-4dc8-abdc-16fffc6229c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.207799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5472fb-5d55-4dc8-abdc-16fffc6229c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:17.208109 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5472fb-5d55-4dc8-abdc-16fffc6229c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:17.209562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5472fb-5d55-4dc8-abdc-16fffc6229c8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:17.219525 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 103/217] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:17.220178 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5472fb-5d55-4dc8-abdc-16fffc6229c8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:17.294824 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96fdce-2ae4-42ec-9e86-efbc07f22e12 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:17.297681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:17.320370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:17.329280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5472fb-5d55-4dc8-abdc-16fffc6229c8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:17.330460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3f0dd-3d5a-4e11-8835-ca3296159ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:17.331137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3f0dd-3d5a-4e11-8835-ca3296159ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:17.331425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3f0dd-3d5a-4e11-8835-ca3296159ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:17.331705 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3f0dd-3d5a-4e11-8835-ca3296159ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.332489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3f0dd-3d5a-4e11-8835-ca3296159ed7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:17.332800 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3f0dd-3d5a-4e11-8835-ca3296159ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:17.334204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3f0dd-3d5a-4e11-8835-ca3296159ed7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:17.343126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 115/218] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:17.343913 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3f0dd-3d5a-4e11-8835-ca3296159ed7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:17.363464 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29369934-c0fb-44e3-8b91-45b3b012a016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:17.364255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369934-c0fb-44e3-8b91-45b3b012a016 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:17.364572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369934-c0fb-44e3-8b91-45b3b012a016 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:17.364851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369934-c0fb-44e3-8b91-45b3b012a016 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.366020 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29369934-c0fb-44e3-8b91-45b3b012a016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:17.367777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29369934-c0fb-44e3-8b91-45b3b012a016 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:17.369422 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 104/219] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:17.370708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea1154-4614-4c4a-8f11-8575c79ae551 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:17.371006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea1154-4614-4c4a-8f11-8575c79ae551 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:17.371285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea1154-4614-4c4a-8f11-8575c79ae551 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.372666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 105/220] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:17.377376 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea1154-4614-4c4a-8f11-8575c79ae551 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:17.446967 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3f0dd-3d5a-4e11-8835-ca3296159ed7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:17.479618 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea1154-4614-4c4a-8f11-8575c79ae551 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:17.481075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1a8ac-42e8-43f4-b2ae-4cb6254995ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:17.481958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1a8ac-42e8-43f4-b2ae-4cb6254995ad None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:17.482246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1a8ac-42e8-43f4-b2ae-4cb6254995ad None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:17.482578 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1a8ac-42e8-43f4-b2ae-4cb6254995ad None admin] PATH_INFO: `/v3/users/11a2a2649aab41798ed4755463e7973e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.483805 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1a8ac-42e8-43f4-b2ae-4cb6254995ad None admin] RBAC: Authorizing `identity:get_user(user_id=11a2a2649aab41798ed4755463e7973e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:17.485307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1a8ac-42e8-43f4-b2ae-4cb6254995ad None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:17.487101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 116/221] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:17 2022] GET /identity/v3/users/11a2a2649aab41798ed4755463e7973e => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:17.487685 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1a8ac-42e8-43f4-b2ae-4cb6254995ad None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:17.516944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a0c24-c1c9-4ee9-a9ce-a0f0bb4372c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:17.517815 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a0c24-c1c9-4ee9-a9ce-a0f0bb4372c2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:17.518099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a0c24-c1c9-4ee9-a9ce-a0f0bb4372c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:17.518389 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a0c24-c1c9-4ee9-a9ce-a0f0bb4372c2 None admin] PATH_INFO: `/v3/users/22a9f5e88a7a4cae958ab387f9779786` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.522036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:17.531956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a0c24-c1c9-4ee9-a9ce-a0f0bb4372c2 None admin] RBAC: Authorizing `identity:get_user(user_id=22a9f5e88a7a4cae958ab387f9779786)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:17.533450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a0c24-c1c9-4ee9-a9ce-a0f0bb4372c2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:17.535282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 106/222] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:17 2022] GET /identity/v3/users/22a9f5e88a7a4cae958ab387f9779786 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:17.536460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ed9ae-6502-4009-89f5-2bf938484c80 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:17.536747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ed9ae-6502-4009-89f5-2bf938484c80 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:17.537023 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ed9ae-6502-4009-89f5-2bf938484c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.553060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-127ed9ae-6502-4009-89f5-2bf938484c80 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:17.554691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-127ed9ae-6502-4009-89f5-2bf938484c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:17.567616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:17.593138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1a8ac-42e8-43f4-b2ae-4cb6254995ad None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:17.621372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 107/223] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:17.622199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ed9ae-6502-4009-89f5-2bf938484c80 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:17.630869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe14a9a-cc96-424a-9d92-e09eb2d49303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:17.632047 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe14a9a-cc96-424a-9d92-e09eb2d49303 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:17.632358 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe14a9a-cc96-424a-9d92-e09eb2d49303 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:17.632677 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe14a9a-cc96-424a-9d92-e09eb2d49303 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.633977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe14a9a-cc96-424a-9d92-e09eb2d49303 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:17.635846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe14a9a-cc96-424a-9d92-e09eb2d49303 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:17.658558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 117/224] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:23:17 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:23:17.659387 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe14a9a-cc96-424a-9d92-e09eb2d49303 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:17.731538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ed9ae-6502-4009-89f5-2bf938484c80 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:17.761495 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:17.770469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6ad42-370e-451a-ba34-9f204db10fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:17.771352 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6ad42-370e-451a-ba34-9f204db10fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:17.771635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6ad42-370e-451a-ba34-9f204db10fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:17.771911 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6ad42-370e-451a-ba34-9f204db10fb7 None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.773728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6ad42-370e-451a-ba34-9f204db10fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:17.775329 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6ad42-370e-451a-ba34-9f204db10fb7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:17.782443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 108/225] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:17 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:17.782621 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe14a9a-cc96-424a-9d92-e09eb2d49303 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:17.782725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6ad42-370e-451a-ba34-9f204db10fb7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:17.800735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:17.822253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39d3ca-4557-4d7e-a0f9-467e35083be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:17.822832 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39d3ca-4557-4d7e-a0f9-467e35083be8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:17.823124 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39d3ca-4557-4d7e-a0f9-467e35083be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:17.823403 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39d3ca-4557-4d7e-a0f9-467e35083be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.903671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6ad42-370e-451a-ba34-9f204db10fb7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:17.904370 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39d3ca-4557-4d7e-a0f9-467e35083be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:17.905866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39d3ca-4557-4d7e-a0f9-467e35083be8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:17.953300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1b397-8b45-403b-8028-151ab82d97c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:17.954209 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1b397-8b45-403b-8028-151ab82d97c8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:17.954561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1b397-8b45-403b-8028-151ab82d97c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:17.954915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1b397-8b45-403b-8028-151ab82d97c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:17.968253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1b397-8b45-403b-8028-151ab82d97c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-caa1b397-8b45-403b-8028-151ab82d97c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:17.977388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:17.978488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:17.979476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:17.979476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:17.979476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:17.979476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:17.979476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:17.979476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:17.979476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:17.979476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:17.979476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:17.979476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:17.979476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:17.979476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:17.981548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 109/226] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:23:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:17.982455 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1b397-8b45-403b-8028-151ab82d97c8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:18.032029 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:18.044348 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 118/227] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:18.045449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39d3ca-4557-4d7e-a0f9-467e35083be8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:18.095577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:18.127666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1b397-8b45-403b-8028-151ab82d97c8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:18.164494 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8c5e1-e29d-4310-9492-8ff63f2c6bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:18.165746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8c5e1-e29d-4310-9492-8ff63f2c6bc0 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:18.166032 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8c5e1-e29d-4310-9492-8ff63f2c6bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:18.166306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8c5e1-e29d-4310-9492-8ff63f2c6bc0 None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6/users/11a2a2649aab41798ed4755463e7973e/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:18.168470 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8c5e1-e29d-4310-9492-8ff63f2c6bc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6062fb0a5e0f441192aaef82d7fd14e6, user_id=11a2a2649aab41798ed4755463e7973e, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:18.168762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39d3ca-4557-4d7e-a0f9-467e35083be8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:18.169944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8c5e1-e29d-4310-9492-8ff63f2c6bc0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:18.186304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 110/228] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:23:17 2022] PUT /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6/users/11a2a2649aab41798ed4755463e7973e/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:23:18.193511 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8c5e1-e29d-4310-9492-8ff63f2c6bc0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:18.217125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aada67b-a465-428a-a074-9b67a86e1b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:18.217820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aada67b-a465-428a-a074-9b67a86e1b7a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:18.218164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aada67b-a465-428a-a074-9b67a86e1b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:18.218449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aada67b-a465-428a-a074-9b67a86e1b7a None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:18.219317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aada67b-a465-428a-a074-9b67a86e1b7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:18.220463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aada67b-a465-428a-a074-9b67a86e1b7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:18.224144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aada67b-a465-428a-a074-9b67a86e1b7a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:18.243708 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 119/229] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:18.250239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aada67b-a465-428a-a074-9b67a86e1b7a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:18.340611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:18.395269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aada67b-a465-428a-a074-9b67a86e1b7a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:18.401388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8c5e1-e29d-4310-9492-8ff63f2c6bc0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:18.433618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f84425-238e-4b58-a332-2a6cd06e8a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:18.434516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f84425-238e-4b58-a332-2a6cd06e8a85 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:18.434802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f84425-238e-4b58-a332-2a6cd06e8a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:18.435085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f84425-238e-4b58-a332-2a6cd06e8a85 None admin] PATH_INFO: `/v3/users/11a2a2649aab41798ed4755463e7973e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:18.437892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f84425-238e-4b58-a332-2a6cd06e8a85 None admin] RBAC: Authorizing `identity:get_user(user_id=11a2a2649aab41798ed4755463e7973e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:18.441873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f84425-238e-4b58-a332-2a6cd06e8a85 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:18.445542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 120/230] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:18 2022] GET /identity/v3/users/11a2a2649aab41798ed4755463e7973e => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:18.457418 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f84425-238e-4b58-a332-2a6cd06e8a85 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:18.471963 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0121cb-dc84-48e1-bfac-d27bb78cb172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:18.472874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0121cb-dc84-48e1-bfac-d27bb78cb172 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:18.473162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0121cb-dc84-48e1-bfac-d27bb78cb172 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:18.473441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0121cb-dc84-48e1-bfac-d27bb78cb172 None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:18.475903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0121cb-dc84-48e1-bfac-d27bb78cb172 None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:18.479477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0121cb-dc84-48e1-bfac-d27bb78cb172 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:18.479477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 111/231] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:18 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:18.485313 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0121cb-dc84-48e1-bfac-d27bb78cb172 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:18.502832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:18.632413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f84425-238e-4b58-a332-2a6cd06e8a85 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:18.655492 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:18.670426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0121cb-dc84-48e1-bfac-d27bb78cb172 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:18.689372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461da8cf-4b56-4137-8648-58386e157a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:18.690245 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461da8cf-4b56-4137-8648-58386e157a25 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:18.690532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461da8cf-4b56-4137-8648-58386e157a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:18.690814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461da8cf-4b56-4137-8648-58386e157a25 None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:18.692657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461da8cf-4b56-4137-8648-58386e157a25 None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:18.694122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461da8cf-4b56-4137-8648-58386e157a25 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:18.698725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 121/232] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:18 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:18.705140 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461da8cf-4b56-4137-8648-58386e157a25 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:18.746099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739b507-a73f-43fb-a841-77c934e0486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:18.748159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739b507-a73f-43fb-a841-77c934e0486f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:18.749285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739b507-a73f-43fb-a841-77c934e0486f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:18.749785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739b507-a73f-43fb-a841-77c934e0486f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:18.750973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739b507-a73f-43fb-a841-77c934e0486f None admin] RBAC: Adding query filter params (role.id=83a7ac2bd20743b78fe0f4689037d83b, scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6, user.id=22a9f5e88a7a4cae958ab387f9779786) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:18.752532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739b507-a73f-43fb-a841-77c934e0486f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:18.754857 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739b507-a73f-43fb-a841-77c934e0486f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:18.763958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 112/233] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:18 2022] GET /identity/v3/role_assignments?user.id=22a9f5e88a7a4cae958ab387f9779786&scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6&role.id=83a7ac2bd20743b78fe0f4689037d83b => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:18.886651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461da8cf-4b56-4137-8648-58386e157a25 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:18.933910 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f3dd2-0e6a-40c9-a640-7a5f9071b762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:18.935165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f3dd2-0e6a-40c9-a640-7a5f9071b762 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:18.935646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f3dd2-0e6a-40c9-a640-7a5f9071b762 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:18.936112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f3dd2-0e6a-40c9-a640-7a5f9071b762 None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6/users/11a2a2649aab41798ed4755463e7973e/roles/e97c8dedb3a147c6ab5d98229f5a000c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:18.938652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f3dd2-0e6a-40c9-a640-7a5f9071b762 None admin] RBAC: Authorizing `identity:create_grant(project_id=6062fb0a5e0f441192aaef82d7fd14e6, user_id=11a2a2649aab41798ed4755463e7973e, role_id=e97c8dedb3a147c6ab5d98229f5a000c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:18.940367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f3dd2-0e6a-40c9-a640-7a5f9071b762 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:18.965772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 122/234] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:23:18 2022] PUT /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6/users/11a2a2649aab41798ed4755463e7973e/roles/e97c8dedb3a147c6ab5d98229f5a000c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:23:20.084187 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265e2eb-10ed-4bc1-a184-01e8596b1b5a None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:20.084747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265e2eb-10ed-4bc1-a184-01e8596b1b5a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:20.085136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265e2eb-10ed-4bc1-a184-01e8596b1b5a None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:20.086974 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 113/235] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:20.092562 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a10978-0ea8-4ae1-b856-57600d465677 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:20.092971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a10978-0ea8-4ae1-b856-57600d465677 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:20.093139 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a10978-0ea8-4ae1-b856-57600d465677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:20.118330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-60a10978-0ea8-4ae1-b856-57600d465677 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:20.119544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-60a10978-0ea8-4ae1-b856-57600d465677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:20.133493 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bf14b-e7ce-4af4-9c9e-24e2f34840b6 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:20.133777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bf14b-e7ce-4af4-9c9e-24e2f34840b6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:20.134058 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bf14b-e7ce-4af4-9c9e-24e2f34840b6 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:20.135692 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 114/236] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:20.140582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3101b30-809f-4939-979f-e05a185fb801 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:20.140872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3101b30-809f-4939-979f-e05a185fb801 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:20.141159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3101b30-809f-4939-979f-e05a185fb801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:20.162068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b3101b30-809f-4939-979f-e05a185fb801 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:20.163938 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b3101b30-809f-4939-979f-e05a185fb801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:20.180084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:20.223428 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 123/237] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:20.247156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a10978-0ea8-4ae1-b856-57600d465677 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:20.298702 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:20.318711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 115/238] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:20.354005 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a10978-0ea8-4ae1-b856-57600d465677 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:20.356518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3101b30-809f-4939-979f-e05a185fb801 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:20.390574 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b7a35-bff7-466c-93aa-67bf8afadad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:20.391376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b7a35-bff7-466c-93aa-67bf8afadad7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:20.391658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b7a35-bff7-466c-93aa-67bf8afadad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:20.391931 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b7a35-bff7-466c-93aa-67bf8afadad7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:20.403003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b7a35-bff7-466c-93aa-67bf8afadad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-887b7a35-bff7-466c-93aa-67bf8afadad7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:20.410776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:20.411643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:20.412863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:20.412863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:20.412863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:20.412863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:20.412863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:20.412863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:20.412863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:20.412863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:20.412863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:20.412863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:20.412863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:20.412863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:20.412863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 124/239] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:20.419008 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b7a35-bff7-466c-93aa-67bf8afadad7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:20.461585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:20.524432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b7a35-bff7-466c-93aa-67bf8afadad7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:20.561159 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb37c5-cf28-4562-b76b-de28c95644ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:20.562244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb37c5-cf28-4562-b76b-de28c95644ca None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:20.562732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb37c5-cf28-4562-b76b-de28c95644ca None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:20.563216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb37c5-cf28-4562-b76b-de28c95644ca None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:20.564165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb37c5-cf28-4562-b76b-de28c95644ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:20.564702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb37c5-cf28-4562-b76b-de28c95644ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:20.566320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb37c5-cf28-4562-b76b-de28c95644ca None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:20.575788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 125/240] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:20.581576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb37c5-cf28-4562-b76b-de28c95644ca None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:20.596220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3101b30-809f-4939-979f-e05a185fb801 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:20.633216 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d4cda-62a0-46e2-bb5b-b937d52cdac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:20.634319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d4cda-62a0-46e2-bb5b-b937d52cdac3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:20.634776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d4cda-62a0-46e2-bb5b-b937d52cdac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:20.635236 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d4cda-62a0-46e2-bb5b-b937d52cdac3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:20.636637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d4cda-62a0-46e2-bb5b-b937d52cdac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:20.638266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d4cda-62a0-46e2-bb5b-b937d52cdac3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:20.640098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 116/241] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:20.649643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d4cda-62a0-46e2-bb5b-b937d52cdac3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:20.688822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:20.691616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb37c5-cf28-4562-b76b-de28c95644ca None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:20.731039 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7957ee5-3c47-4720-9762-ef2890b1b723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:20.732266 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957ee5-3c47-4720-9762-ef2890b1b723 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:20.733050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957ee5-3c47-4720-9762-ef2890b1b723 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:20.733471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957ee5-3c47-4720-9762-ef2890b1b723 None admin] PATH_INFO: `/v3/users/54e09fd61e0d42ddac73ddec7e28d3f2` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:20.763386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7957ee5-3c47-4720-9762-ef2890b1b723 None admin] RBAC: Authorizing `identity:get_user(user_id=54e09fd61e0d42ddac73ddec7e28d3f2)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:20.765821 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7957ee5-3c47-4720-9762-ef2890b1b723 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:20.768322 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 126/242] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:20 2022] GET /identity/v3/users/54e09fd61e0d42ddac73ddec7e28d3f2 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:20.774462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7957ee5-3c47-4720-9762-ef2890b1b723 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:20.800713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:20.845711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d4cda-62a0-46e2-bb5b-b937d52cdac3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:20.885017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7957ee5-3c47-4720-9762-ef2890b1b723 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:20.901752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6a19a-bf4d-4bf7-a765-4cc0fb2b0fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:20.902913 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6a19a-bf4d-4bf7-a765-4cc0fb2b0fdf None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:20.903207 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6a19a-bf4d-4bf7-a765-4cc0fb2b0fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:20.903488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6a19a-bf4d-4bf7-a765-4cc0fb2b0fdf None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:20.904529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6a19a-bf4d-4bf7-a765-4cc0fb2b0fdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:20.906264 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6a19a-bf4d-4bf7-a765-4cc0fb2b0fdf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:20.926619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d181d-debe-4c0b-801d-68b74e7ff37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:20.927623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d181d-debe-4c0b-801d-68b74e7ff37d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:20.928241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d181d-debe-4c0b-801d-68b74e7ff37d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:20.929335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d181d-debe-4c0b-801d-68b74e7ff37d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:20.937148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 117/243] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:23:20 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:23:20.938488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c31402-6a1a-4ebe-854c-6cacfc74f575 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:20.938780 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c31402-6a1a-4ebe-854c-6cacfc74f575 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:20.939099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c31402-6a1a-4ebe-854c-6cacfc74f575 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:20.940384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 118/244] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:20.948308 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92245d6-d7b3-4afa-8a0c-acb6704a18cd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:20.948568 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92245d6-d7b3-4afa-8a0c-acb6704a18cd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:20.948865 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92245d6-d7b3-4afa-8a0c-acb6704a18cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:20.966870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e92245d6-d7b3-4afa-8a0c-acb6704a18cd None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:20.968115 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e92245d6-d7b3-4afa-8a0c-acb6704a18cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:20.969072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:21.051685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 119/245] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:21.057481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d181d-debe-4c0b-801d-68b74e7ff37d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:21.059366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d181d-debe-4c0b-801d-68b74e7ff37d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:21.080418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92245d6-d7b3-4afa-8a0c-acb6704a18cd None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:21.137501 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:21.199303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92245d6-d7b3-4afa-8a0c-acb6704a18cd None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:21.208242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 127/246] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:23:21.215266 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d181d-debe-4c0b-801d-68b74e7ff37d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:21.238286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f071b72-20d4-40b4-8857-8d2b4635558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:21.239550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f071b72-20d4-40b4-8857-8d2b4635558c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:21.240034 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f071b72-20d4-40b4-8857-8d2b4635558c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:21.240560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f071b72-20d4-40b4-8857-8d2b4635558c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:21.253646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f071b72-20d4-40b4-8857-8d2b4635558c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-2f071b72-20d4-40b4-8857-8d2b4635558c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:21.262680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:21.263653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:21.264456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:21.264456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:21.264456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:21.264456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:21.264456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:21.264456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:21.264456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:21.264456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:21.264456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:21.264456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:21.264456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:21.264456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:21.267207 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 120/247] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:23:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:23:21.275400 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f071b72-20d4-40b4-8857-8d2b4635558c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:21.295775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:21.354552 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d181d-debe-4c0b-801d-68b74e7ff37d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:21.399026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d629d-d7c7-451e-8d85-8abd67c91bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:21.399829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d629d-d7c7-451e-8d85-8abd67c91bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:21.400115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d629d-d7c7-451e-8d85-8abd67c91bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:21.400407 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d629d-d7c7-451e-8d85-8abd67c91bd0 None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:21.401600 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d629d-d7c7-451e-8d85-8abd67c91bd0 None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:21.403564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d629d-d7c7-451e-8d85-8abd67c91bd0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:21.405354 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 128/248] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:21 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:21.407011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f071b72-20d4-40b4-8857-8d2b4635558c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:21.407152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27f748-0fa5-427c-b5d9-91b2f53539bf None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:21.407152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27f748-0fa5-427c-b5d9-91b2f53539bf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:21.407152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27f748-0fa5-427c-b5d9-91b2f53539bf None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:21.409909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 129/249] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:21.413161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27f748-0fa5-427c-b5d9-91b2f53539bf None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:21.423063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:21.457693 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f1048-c3fa-40d3-b74a-c4a7e77bb5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:21.458442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f1048-c3fa-40d3-b74a-c4a7e77bb5da None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:21.458735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f1048-c3fa-40d3-b74a-c4a7e77bb5da None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:21.459512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f1048-c3fa-40d3-b74a-c4a7e77bb5da None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:21.460288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f1048-c3fa-40d3-b74a-c4a7e77bb5da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:21.461487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f1048-c3fa-40d3-b74a-c4a7e77bb5da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:21.462018 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f1048-c3fa-40d3-b74a-c4a7e77bb5da None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:21.476245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 121/250] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:21.478639 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa622d-2f9b-4901-97eb-ef381a6bc36f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:21.479173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa622d-2f9b-4901-97eb-ef381a6bc36f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:21.479953 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa622d-2f9b-4901-97eb-ef381a6bc36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:21.501019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-befa622d-2f9b-4901-97eb-ef381a6bc36f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:21.502679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-befa622d-2f9b-4901-97eb-ef381a6bc36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:21.556984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27f748-0fa5-427c-b5d9-91b2f53539bf None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:21.594262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 122/251] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:21.595112 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa622d-2f9b-4901-97eb-ef381a6bc36f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:21.610287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:21.634614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25be468-bc2a-4512-a299-a6e8cc3fb012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:21.635297 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25be468-bc2a-4512-a299-a6e8cc3fb012 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:21.635588 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25be468-bc2a-4512-a299-a6e8cc3fb012 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:21.635864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25be468-bc2a-4512-a299-a6e8cc3fb012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:21.636745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25be468-bc2a-4512-a299-a6e8cc3fb012 None admin] RBAC: Adding query filter params (role.id=26266094acc24302b4e409ca0f585710, scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6, user.id=54e09fd61e0d42ddac73ddec7e28d3f2) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:21.637062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25be468-bc2a-4512-a299-a6e8cc3fb012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:21.638619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25be468-bc2a-4512-a299-a6e8cc3fb012 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:21.658746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 130/252] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:21 2022] GET /identity/v3/role_assignments?user.id=54e09fd61e0d42ddac73ddec7e28d3f2&scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6&role.id=26266094acc24302b4e409ca0f585710 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:21.659626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25be468-bc2a-4512-a299-a6e8cc3fb012 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:21.747426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa622d-2f9b-4901-97eb-ef381a6bc36f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:21.750301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:21.806479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987e761-3024-4d2c-8465-7982d85edb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:21.807755 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987e761-3024-4d2c-8465-7982d85edb12 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:21.808229 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987e761-3024-4d2c-8465-7982d85edb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:21.808711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987e761-3024-4d2c-8465-7982d85edb12 None admin] PATH_INFO: `/v3/users/11a2a2649aab41798ed4755463e7973e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:21.816420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987e761-3024-4d2c-8465-7982d85edb12 None admin] RBAC: Authorizing `identity:get_user(user_id=11a2a2649aab41798ed4755463e7973e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:21.818407 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987e761-3024-4d2c-8465-7982d85edb12 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:21.820988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 123/253] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:21 2022] GET /identity/v3/users/11a2a2649aab41798ed4755463e7973e => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:21.827352 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987e761-3024-4d2c-8465-7982d85edb12 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:21.921378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25be468-bc2a-4512-a299-a6e8cc3fb012 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:21.988775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987e761-3024-4d2c-8465-7982d85edb12 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:21.995922 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e03dd8-ec2f-4c29-aeb0-92458ac1a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:21.996766 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e03dd8-ec2f-4c29-aeb0-92458ac1a8fe None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:21.997057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e03dd8-ec2f-4c29-aeb0-92458ac1a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:21.997337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e03dd8-ec2f-4c29-aeb0-92458ac1a8fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:22.012489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e03dd8-ec2f-4c29-aeb0-92458ac1a8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-43e03dd8-ec2f-4c29-aeb0-92458ac1a8fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:22.020232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:22.021114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:22.021893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:22.021893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:22.021893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:22.021893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:22.021893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:22.021893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:22.021893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:22.021893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:22.021893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:22.021893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:22.021893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:22.021893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:22.029714 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 131/254] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:22.031041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe97db-ffad-4797-85eb-1fa477666768 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:22.031329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe97db-ffad-4797-85eb-1fa477666768 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:22.031607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe97db-ffad-4797-85eb-1fa477666768 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:22.034734 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 132/255] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:22.042889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe97db-ffad-4797-85eb-1fa477666768 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:22.059108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33794c86-a0b9-4c04-8471-293d8a69088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:22.059762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33794c86-a0b9-4c04-8471-293d8a69088a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:22.060047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33794c86-a0b9-4c04-8471-293d8a69088a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:22.060323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33794c86-a0b9-4c04-8471-293d8a69088a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:22.128759 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:22.141818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:22.177041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33794c86-a0b9-4c04-8471-293d8a69088a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:22.178952 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33794c86-a0b9-4c04-8471-293d8a69088a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:22.239339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe97db-ffad-4797-85eb-1fa477666768 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:22.278791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a4b1e-283e-4c21-8661-4b11a7515e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:22.279483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a4b1e-283e-4c21-8661-4b11a7515e00 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:22.279771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a4b1e-283e-4c21-8661-4b11a7515e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:22.280252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a4b1e-283e-4c21-8661-4b11a7515e00 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:22.283856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a4b1e-283e-4c21-8661-4b11a7515e00 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:22.284170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a4b1e-283e-4c21-8661-4b11a7515e00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:22.285880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a4b1e-283e-4c21-8661-4b11a7515e00 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:22.306538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 133/256] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:22.307848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddf90d-b36f-4139-966c-1e4594a4b2df None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:22.308141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddf90d-b36f-4139-966c-1e4594a4b2df None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:22.308434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddf90d-b36f-4139-966c-1e4594a4b2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:22.342096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e0ddf90d-b36f-4139-966c-1e4594a4b2df None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:22.343303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e0ddf90d-b36f-4139-966c-1e4594a4b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:22.376594 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 124/257] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:23:22.377589 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33794c86-a0b9-4c04-8471-293d8a69088a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:22.477340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 134/258] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:22.478209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddf90d-b36f-4139-966c-1e4594a4b2df None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:22.536884 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:22.570652 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:22.602814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddf90d-b36f-4139-966c-1e4594a4b2df None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:22.638755 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33794c86-a0b9-4c04-8471-293d8a69088a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:22.640778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f9834-98f3-4cc9-a55e-cb20a1a3a3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:22.641768 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f9834-98f3-4cc9-a55e-cb20a1a3a3ed None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:22.642064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f9834-98f3-4cc9-a55e-cb20a1a3a3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:22.642346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f9834-98f3-4cc9-a55e-cb20a1a3a3ed None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:22.643554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f9834-98f3-4cc9-a55e-cb20a1a3a3ed None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:22.645145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f9834-98f3-4cc9-a55e-cb20a1a3a3ed None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:22.647035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 135/259] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:22 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:22.648240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f9834-98f3-4cc9-a55e-cb20a1a3a3ed None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:22.748315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb2037-b3df-4af1-adbf-73aadf4ff99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:22.749295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb2037-b3df-4af1-adbf-73aadf4ff99b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:22.749685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb2037-b3df-4af1-adbf-73aadf4ff99b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:22.750060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb2037-b3df-4af1-adbf-73aadf4ff99b None admin] PATH_INFO: `/v3/users/22a9f5e88a7a4cae958ab387f9779786` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:22.751366 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb2037-b3df-4af1-adbf-73aadf4ff99b None admin] RBAC: Authorizing `identity:get_user(user_id=22a9f5e88a7a4cae958ab387f9779786)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:22.757059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb2037-b3df-4af1-adbf-73aadf4ff99b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:22.758987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 125/260] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:22 2022] GET /identity/v3/users/22a9f5e88a7a4cae958ab387f9779786 => generated 297 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:22.759749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb2037-b3df-4af1-adbf-73aadf4ff99b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:22.760695 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f9834-98f3-4cc9-a55e-cb20a1a3a3ed None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:22.773689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:22.798755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426dd26-5187-4514-a314-de472f768e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:22.799722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426dd26-5187-4514-a314-de472f768e93 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:22.800065 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426dd26-5187-4514-a314-de472f768e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:22.800350 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426dd26-5187-4514-a314-de472f768e93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:22.824084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426dd26-5187-4514-a314-de472f768e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-0426dd26-5187-4514-a314-de472f768e93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:22.838746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:22.839701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:22.840521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:22.840521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:22.840521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:22.840521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:22.840521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:22.840521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:22.840521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:22.840521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:22.840521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:22.840521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:22.840521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:22.840521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:22.845318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 136/261] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:23:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:22.846145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426dd26-5187-4514-a314-de472f768e93 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:22.926134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb2037-b3df-4af1-adbf-73aadf4ff99b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:22.961643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b702d40-9d27-4fee-b71e-ef2e50a15f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:22.962312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b702d40-9d27-4fee-b71e-ef2e50a15f08 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:22.962595 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b702d40-9d27-4fee-b71e-ef2e50a15f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:22.962874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b702d40-9d27-4fee-b71e-ef2e50a15f08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:22.963725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b702d40-9d27-4fee-b71e-ef2e50a15f08 None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6, user.id=11a2a2649aab41798ed4755463e7973e) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:22.964176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b702d40-9d27-4fee-b71e-ef2e50a15f08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:22.965738 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b702d40-9d27-4fee-b71e-ef2e50a15f08 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:22.972350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 126/262] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:22 2022] GET /identity/v3/role_assignments?user.id=11a2a2649aab41798ed4755463e7973e&scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6&role.id=43e0afe364894278be44a97662ca6f8e => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:22.973284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b702d40-9d27-4fee-b71e-ef2e50a15f08 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:22.982384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:23.044750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426dd26-5187-4514-a314-de472f768e93 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:23.114266 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1ff4-ec7f-49d6-b159-dec1e445405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:23.115169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1ff4-ec7f-49d6-b159-dec1e445405d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:23.115468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1ff4-ec7f-49d6-b159-dec1e445405d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:23.115752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1ff4-ec7f-49d6-b159-dec1e445405d None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:23.121287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc1ff4-ec7f-49d6-b159-dec1e445405d None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:23.122793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc1ff4-ec7f-49d6-b159-dec1e445405d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:23.124665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 137/263] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:22 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:23.137300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1ff4-ec7f-49d6-b159-dec1e445405d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:23.161907 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b702d40-9d27-4fee-b71e-ef2e50a15f08 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:23.212127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:23.238576 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96fe83-d273-4f11-be50-0bacc26ad691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:23.239256 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96fe83-d273-4f11-be50-0bacc26ad691 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:23.239543 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96fe83-d273-4f11-be50-0bacc26ad691 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:23.239821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96fe83-d273-4f11-be50-0bacc26ad691 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:23.240613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96fe83-d273-4f11-be50-0bacc26ad691 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:23.241054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96fe83-d273-4f11-be50-0bacc26ad691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:23.242678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96fe83-d273-4f11-be50-0bacc26ad691 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:23.252506 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 127/264] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:23.260168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96fe83-d273-4f11-be50-0bacc26ad691 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:23.308536 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1ff4-ec7f-49d6-b159-dec1e445405d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:23.364269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc52fdc-c092-4f53-96db-f52c846ea6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:23.365218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc52fdc-c092-4f53-96db-f52c846ea6e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:23.365502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc52fdc-c092-4f53-96db-f52c846ea6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:23.365780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc52fdc-c092-4f53-96db-f52c846ea6e1 None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6/users/22a9f5e88a7a4cae958ab387f9779786/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:23.370816 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc52fdc-c092-4f53-96db-f52c846ea6e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6062fb0a5e0f441192aaef82d7fd14e6, user_id=22a9f5e88a7a4cae958ab387f9779786, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:23.372288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc52fdc-c092-4f53-96db-f52c846ea6e1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:23.396734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:23.397850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 138/265] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:23:23 2022] PUT /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6/users/22a9f5e88a7a4cae958ab387f9779786/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:23:23.445751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96fe83-d273-4f11-be50-0bacc26ad691 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:23.491692 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af92cc7-e699-470f-8546-839d653c0814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:23.492708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af92cc7-e699-470f-8546-839d653c0814 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:23.492979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af92cc7-e699-470f-8546-839d653c0814 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:23.493262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af92cc7-e699-470f-8546-839d653c0814 None admin] PATH_INFO: `/v3/users/11a2a2649aab41798ed4755463e7973e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:23.494514 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af92cc7-e699-470f-8546-839d653c0814 None admin] RBAC: Authorizing `identity:get_user(user_id=11a2a2649aab41798ed4755463e7973e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:23.496746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af92cc7-e699-470f-8546-839d653c0814 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:23.498671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 128/266] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:23 2022] GET /identity/v3/users/11a2a2649aab41798ed4755463e7973e => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:23.504104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc52fdc-c092-4f53-96db-f52c846ea6e1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:23.625655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:23.630499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc52fdc-c092-4f53-96db-f52c846ea6e1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:23.675112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe86f1-1918-4ee1-a305-2170d2b216f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:23.675771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe86f1-1918-4ee1-a305-2170d2b216f2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:23.676059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe86f1-1918-4ee1-a305-2170d2b216f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:23.676338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe86f1-1918-4ee1-a305-2170d2b216f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:23.759382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe86f1-1918-4ee1-a305-2170d2b216f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:23.762573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe86f1-1918-4ee1-a305-2170d2b216f2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:23.868255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:23.873915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 139/267] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:23:23.882158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af92cc7-e699-470f-8546-839d653c0814 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:23.892352 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1623e4d-11ec-48dd-891d-e20c6e7146ad None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:23.892665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1623e4d-11ec-48dd-891d-e20c6e7146ad None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:23.893341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1623e4d-11ec-48dd-891d-e20c6e7146ad None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:23.896761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 140/268] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:23 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:23.900413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466c694-4875-48d4-8af0-690722d4ddcc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:23.900708 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466c694-4875-48d4-8af0-690722d4ddcc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:23.900989 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466c694-4875-48d4-8af0-690722d4ddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:23.928488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e466c694-4875-48d4-8af0-690722d4ddcc None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:23.929704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e466c694-4875-48d4-8af0-690722d4ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:24.020163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 141/269] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:24.021823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bf9fb-63b8-4f03-9670-562f9714a7ca None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:24.022117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bf9fb-63b8-4f03-9670-562f9714a7ca None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:24.022549 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bf9fb-63b8-4f03-9670-562f9714a7ca None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:24.023947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 142/270] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:24.029377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa19be-f46c-4daf-a62c-c27dfae1cf92 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:24.029661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa19be-f46c-4daf-a62c-c27dfae1cf92 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:24.030093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa19be-f46c-4daf-a62c-c27dfae1cf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:24.046087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af92cc7-e699-470f-8546-839d653c0814 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:24.056451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5caa19be-f46c-4daf-a62c-c27dfae1cf92 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:24.058137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5caa19be-f46c-4daf-a62c-c27dfae1cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:24.085646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1931e-82aa-46ce-8d68-b78392ba1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:24.086747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1931e-82aa-46ce-8d68-b78392ba1417 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:24.087034 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1931e-82aa-46ce-8d68-b78392ba1417 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:24.087311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1931e-82aa-46ce-8d68-b78392ba1417 None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:24.088574 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1931e-82aa-46ce-8d68-b78392ba1417 None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:24.090259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1931e-82aa-46ce-8d68-b78392ba1417 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:24.092483 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 129/271] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:23 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:24.093333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1931e-82aa-46ce-8d68-b78392ba1417 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:24.095786 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:24.150820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 143/272] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:24.151899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa19be-f46c-4daf-a62c-c27dfae1cf92 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:24.224080 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:24.231848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1931e-82aa-46ce-8d68-b78392ba1417 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:24.270954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa66684-3591-4c35-8992-810559dff438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:24.271757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66684-3591-4c35-8992-810559dff438 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:24.272088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66684-3591-4c35-8992-810559dff438 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:24.272883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66684-3591-4c35-8992-810559dff438 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:24.274443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa66684-3591-4c35-8992-810559dff438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:24.276004 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa66684-3591-4c35-8992-810559dff438 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:24.280434 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 130/273] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:24.280434 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa66684-3591-4c35-8992-810559dff438 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:24.285563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa19be-f46c-4daf-a62c-c27dfae1cf92 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:24.326387 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e9d15-3afc-44f3-90f0-7c5ea4d372fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:24.327139 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9d15-3afc-44f3-90f0-7c5ea4d372fe None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:24.327348 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9d15-3afc-44f3-90f0-7c5ea4d372fe None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:24.327624 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9d15-3afc-44f3-90f0-7c5ea4d372fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:24.328476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e9d15-3afc-44f3-90f0-7c5ea4d372fe None admin] RBAC: Adding query filter params (role.id=e97c8dedb3a147c6ab5d98229f5a000c, scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6, user.id=11a2a2649aab41798ed4755463e7973e) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:24.328877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e9d15-3afc-44f3-90f0-7c5ea4d372fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:24.330314 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e9d15-3afc-44f3-90f0-7c5ea4d372fe None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:24.336631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 144/274] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:24 2022] GET /identity/v3/role_assignments?user.id=11a2a2649aab41798ed4755463e7973e&scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6&role.id=e97c8dedb3a147c6ab5d98229f5a000c => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:24.341374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e9d15-3afc-44f3-90f0-7c5ea4d372fe None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:24.367853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:24.405825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa66684-3591-4c35-8992-810559dff438 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:24.445463 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd28fd-cde0-4d55-bd7f-db8e83b321f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:24.446446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd28fd-cde0-4d55-bd7f-db8e83b321f6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:24.446665 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd28fd-cde0-4d55-bd7f-db8e83b321f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:24.446947 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd28fd-cde0-4d55-bd7f-db8e83b321f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:24.459487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd28fd-cde0-4d55-bd7f-db8e83b321f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:24.465114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e9d15-3afc-44f3-90f0-7c5ea4d372fe None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b4cd28fd-cde0-4d55-bd7f-db8e83b321f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:24.468904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:24.469817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:24.470617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:24.470617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:24.470617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:24.470617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:24.470617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:24.470617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:24.470617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:24.470617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:24.470617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:24.470617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:24.470617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:24.470617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:24.470617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 131/275] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:24.477887 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297c3ab-17bc-4c89-aa5a-172cfa025ac0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:24.478072 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297c3ab-17bc-4c89-aa5a-172cfa025ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:24.478391 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297c3ab-17bc-4c89-aa5a-172cfa025ac0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:24.479752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 132/276] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:24.484078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297c3ab-17bc-4c89-aa5a-172cfa025ac0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:24.503116 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:24.513175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e94c34-d885-4a84-86ee-13110e550aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:24.513858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e94c34-d885-4a84-86ee-13110e550aa6 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:24.514143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e94c34-d885-4a84-86ee-13110e550aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:24.514416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e94c34-d885-4a84-86ee-13110e550aa6 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:24.515131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e94c34-d885-4a84-86ee-13110e550aa6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:24.516696 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e94c34-d885-4a84-86ee-13110e550aa6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:24.541583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 145/277] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:23:24 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:23:24.543158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63f64a-cce4-4c7b-bbea-bda24988978a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:24.543452 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63f64a-cce4-4c7b-bbea-bda24988978a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:24.543733 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63f64a-cce4-4c7b-bbea-bda24988978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:24.569488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-df63f64a-cce4-4c7b-bbea-bda24988978a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:24.570665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-df63f64a-cce4-4c7b-bbea-bda24988978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:24.609803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297c3ab-17bc-4c89-aa5a-172cfa025ac0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:24.655005 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:24.656903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0d84d-6686-410c-a1db-c0960c2fd8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:24.657864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0d84d-6686-410c-a1db-c0960c2fd8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:24.658353 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0d84d-6686-410c-a1db-c0960c2fd8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:24.658848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0d84d-6686-410c-a1db-c0960c2fd8d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:24.660421 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0d84d-6686-410c-a1db-c0960c2fd8d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:24.660944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0d84d-6686-410c-a1db-c0960c2fd8d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:24.662536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0d84d-6686-410c-a1db-c0960c2fd8d9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:24.663290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 146/278] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:24.676878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 133/279] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:24.682918 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63f64a-cce4-4c7b-bbea-bda24988978a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:24.691275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0d84d-6686-410c-a1db-c0960c2fd8d9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:24.814801 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63f64a-cce4-4c7b-bbea-bda24988978a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:24.819927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0d84d-6686-410c-a1db-c0960c2fd8d9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:24.827406 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:24.863665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dabea6-1fd9-4475-aa86-cb7916fcaf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:24.864583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dabea6-1fd9-4475-aa86-cb7916fcaf37 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:24.864867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dabea6-1fd9-4475-aa86-cb7916fcaf37 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:24.865142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dabea6-1fd9-4475-aa86-cb7916fcaf37 None admin] PATH_INFO: `/v3/users/886e72951a1f467a8c054b4c2843d953` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:24.867143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b8370-2146-428f-b9a2-f662a0bb9999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:24.868245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b8370-2146-428f-b9a2-f662a0bb9999 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:24.868560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b8370-2146-428f-b9a2-f662a0bb9999 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:24.868835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b8370-2146-428f-b9a2-f662a0bb9999 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:24.880231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dabea6-1fd9-4475-aa86-cb7916fcaf37 None admin] RBAC: Authorizing `identity:get_user(user_id=886e72951a1f467a8c054b4c2843d953)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:24.882501 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b8370-2146-428f-b9a2-f662a0bb9999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:24.882957 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dabea6-1fd9-4475-aa86-cb7916fcaf37 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:24.885237 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 147/280] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:24 2022] GET /identity/v3/users/886e72951a1f467a8c054b4c2843d953 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:24.890546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dabea6-1fd9-4475-aa86-cb7916fcaf37 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4e3b8370-2146-428f-b9a2-f662a0bb9999 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:24.890667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:24.891498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:24.892294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:24.892294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:24.892294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:24.892294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:24.892294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:24.892294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:24.892294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:24.892294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:24.892294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:24.892294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:24.892294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:24.892294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:24.892294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 134/281] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:23:24.901005 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b8370-2146-428f-b9a2-f662a0bb9999 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:24.969855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:25.025250 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b8370-2146-428f-b9a2-f662a0bb9999 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:25.041311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dabea6-1fd9-4475-aa86-cb7916fcaf37 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:25.060694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbc7d2-791d-4b94-a58b-852ac2f2fb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:25.061362 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbc7d2-791d-4b94-a58b-852ac2f2fb77 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:25.061669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbc7d2-791d-4b94-a58b-852ac2f2fb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:25.061921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbc7d2-791d-4b94-a58b-852ac2f2fb77 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:25.062662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbc7d2-791d-4b94-a58b-852ac2f2fb77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:25.062970 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbc7d2-791d-4b94-a58b-852ac2f2fb77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:25.064345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbc7d2-791d-4b94-a58b-852ac2f2fb77 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:25.073621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 135/282] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:25.081424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbc7d2-791d-4b94-a58b-852ac2f2fb77 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:25.084093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b82fa-86e7-48ef-9dac-3d51db6b11a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:25.085406 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b82fa-86e7-48ef-9dac-3d51db6b11a6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:25.085942 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b82fa-86e7-48ef-9dac-3d51db6b11a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:25.086414 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b82fa-86e7-48ef-9dac-3d51db6b11a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:25.087440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b82fa-86e7-48ef-9dac-3d51db6b11a6 None admin] RBAC: Adding query filter params (role.id=83a7ac2bd20743b78fe0f4689037d83b, user.id=886e72951a1f467a8c054b4c2843d953, scope.system=all) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:25.087964 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b82fa-86e7-48ef-9dac-3d51db6b11a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:25.089680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b82fa-86e7-48ef-9dac-3d51db6b11a6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:25.095509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 148/283] 10.222.0.66 () {56 vars in 1308 bytes} [Fri Jul 15 20:23:24 2022] GET /identity/v3/role_assignments?user.id=886e72951a1f467a8c054b4c2843d953&scope.system=all&role.id=83a7ac2bd20743b78fe0f4689037d83b => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:25.197582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbc7d2-791d-4b94-a58b-852ac2f2fb77 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:25.221690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:25.235019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14790973-8c2e-46d9-a8f6-ad48d315f020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:25.235920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14790973-8c2e-46d9-a8f6-ad48d315f020 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:25.236202 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14790973-8c2e-46d9-a8f6-ad48d315f020 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:25.236588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14790973-8c2e-46d9-a8f6-ad48d315f020 None admin] PATH_INFO: `/v3/users/54e09fd61e0d42ddac73ddec7e28d3f2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:25.237853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14790973-8c2e-46d9-a8f6-ad48d315f020 None admin] RBAC: Authorizing `identity:get_user(user_id=54e09fd61e0d42ddac73ddec7e28d3f2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:25.239339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14790973-8c2e-46d9-a8f6-ad48d315f020 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:25.242112 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 136/284] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:25 2022] GET /identity/v3/users/54e09fd61e0d42ddac73ddec7e28d3f2 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:25.247591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b82fa-86e7-48ef-9dac-3d51db6b11a6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:25.302208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:25.387526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b82fa-86e7-48ef-9dac-3d51db6b11a6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:25.437723 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c868c-d20c-4509-aefd-f9a5f001d661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:25.438605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c868c-d20c-4509-aefd-f9a5f001d661 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:25.438890 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c868c-d20c-4509-aefd-f9a5f001d661 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:25.439166 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c868c-d20c-4509-aefd-f9a5f001d661 None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:25.442639 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c868c-d20c-4509-aefd-f9a5f001d661 None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:25.444127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c868c-d20c-4509-aefd-f9a5f001d661 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:25.446138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 149/285] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:25 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:25.452073 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14790973-8c2e-46d9-a8f6-ad48d315f020 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:25.576672 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14790973-8c2e-46d9-a8f6-ad48d315f020 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:25.611228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11527d-af25-4988-8d89-66dec3124550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:25.612526 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11527d-af25-4988-8d89-66dec3124550 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:25.613005 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11527d-af25-4988-8d89-66dec3124550 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:25.613474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11527d-af25-4988-8d89-66dec3124550 None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6/users/54e09fd61e0d42ddac73ddec7e28d3f2/roles/26266094acc24302b4e409ca0f585710` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:25.615650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11527d-af25-4988-8d89-66dec3124550 None admin] RBAC: Authorizing `identity:create_grant(project_id=6062fb0a5e0f441192aaef82d7fd14e6, user_id=54e09fd61e0d42ddac73ddec7e28d3f2, role_id=26266094acc24302b4e409ca0f585710)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:25.617931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11527d-af25-4988-8d89-66dec3124550 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:25.637901 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 137/286] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:23:25 2022] PUT /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6/users/54e09fd61e0d42ddac73ddec7e28d3f2/roles/26266094acc24302b4e409ca0f585710 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:23:26.058074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d023d83-f000-470d-93df-bf37dc940bfd None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:26.058442 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d023d83-f000-470d-93df-bf37dc940bfd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:26.060305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d023d83-f000-470d-93df-bf37dc940bfd None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:26.060441 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 150/287] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:26.078378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c970e3-f23a-4b6e-afa4-cf54376c6000 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:26.078960 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c970e3-f23a-4b6e-afa4-cf54376c6000 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:26.079434 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c970e3-f23a-4b6e-afa4-cf54376c6000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:26.104666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-27c970e3-f23a-4b6e-afa4-cf54376c6000 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:26.106166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-27c970e3-f23a-4b6e-afa4-cf54376c6000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:26.148063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:26.198123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 138/288] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:26.245859 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d023d83-f000-470d-93df-bf37dc940bfd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:26.348675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:26.354245 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d023d83-f000-470d-93df-bf37dc940bfd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:26.396013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a72e0-5791-48fe-a5ef-9ad0f10714f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:26.396874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a72e0-5791-48fe-a5ef-9ad0f10714f6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:26.397223 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a72e0-5791-48fe-a5ef-9ad0f10714f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:26.397506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a72e0-5791-48fe-a5ef-9ad0f10714f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:26.409050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a72e0-5791-48fe-a5ef-9ad0f10714f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c26a72e0-5791-48fe-a5ef-9ad0f10714f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:26.418032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:26.418945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:26.419925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:26.419925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:26.419925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:26.419925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:26.419925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:26.419925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:26.419925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:26.419925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:26.419925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:26.419925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:26.419925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:26.419925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:26.419925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 151/289] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:26.426831 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c970e3-f23a-4b6e-afa4-cf54376c6000 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:26.595392 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c970e3-f23a-4b6e-afa4-cf54376c6000 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:26.650820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c85a0f-10a2-421d-8c01-366ec5b53926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:26.651504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c85a0f-10a2-421d-8c01-366ec5b53926 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:26.651791 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c85a0f-10a2-421d-8c01-366ec5b53926 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:26.652074 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c85a0f-10a2-421d-8c01-366ec5b53926 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:26.652873 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c85a0f-10a2-421d-8c01-366ec5b53926 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:26.653185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c85a0f-10a2-421d-8c01-366ec5b53926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:26.654572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c85a0f-10a2-421d-8c01-366ec5b53926 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:26.669083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 139/290] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:26.675057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a72e0-5791-48fe-a5ef-9ad0f10714f6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:26.798184 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a72e0-5791-48fe-a5ef-9ad0f10714f6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:26.832448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e264077-0654-4805-afd9-1348e844e64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:26.833334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e264077-0654-4805-afd9-1348e844e64a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:26.833623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e264077-0654-4805-afd9-1348e844e64a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:26.833902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e264077-0654-4805-afd9-1348e844e64a None admin] PATH_INFO: `/v3/users/22a9f5e88a7a4cae958ab387f9779786` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:26.835180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e264077-0654-4805-afd9-1348e844e64a None admin] RBAC: Authorizing `identity:get_user(user_id=22a9f5e88a7a4cae958ab387f9779786)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:26.836761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e264077-0654-4805-afd9-1348e844e64a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:26.838716 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 152/291] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:26 2022] GET /identity/v3/users/22a9f5e88a7a4cae958ab387f9779786 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:26.844125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c85a0f-10a2-421d-8c01-366ec5b53926 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:26.944588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:27.007069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c85a0f-10a2-421d-8c01-366ec5b53926 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:27.058201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca88db-db93-4b3b-b84c-cc8e35fcea83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:27.059250 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca88db-db93-4b3b-b84c-cc8e35fcea83 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:27.059738 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca88db-db93-4b3b-b84c-cc8e35fcea83 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:27.060206 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca88db-db93-4b3b-b84c-cc8e35fcea83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:27.145062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca88db-db93-4b3b-b84c-cc8e35fcea83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:27.146896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca88db-db93-4b3b-b84c-cc8e35fcea83 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:27.185189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:27.287213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 140/292] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:27.289460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e18978-299b-4853-a309-f65ebdb933f5 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:27.290255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e18978-299b-4853-a309-f65ebdb933f5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:27.290735 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e18978-299b-4853-a309-f65ebdb933f5 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:27.292625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 153/293] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:23:27.296496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca88db-db93-4b3b-b84c-cc8e35fcea83 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:27.297938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ee674-7788-4432-b44e-44429de3de92 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:27.298432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ee674-7788-4432-b44e-44429de3de92 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:27.298909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ee674-7788-4432-b44e-44429de3de92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:27.317192 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e59ee674-7788-4432-b44e-44429de3de92 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:27.318765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e59ee674-7788-4432-b44e-44429de3de92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:27.344763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:27.392890 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 154/294] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:27.419357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ee674-7788-4432-b44e-44429de3de92 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:27.498331 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca88db-db93-4b3b-b84c-cc8e35fcea83 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:27.534803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d890402-b60f-4c5f-94d5-bd13d65c055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:27.535982 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d890402-b60f-4c5f-94d5-bd13d65c055e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:27.536436 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d890402-b60f-4c5f-94d5-bd13d65c055e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:27.536854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d890402-b60f-4c5f-94d5-bd13d65c055e None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:27.538766 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d890402-b60f-4c5f-94d5-bd13d65c055e None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:27.540778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d890402-b60f-4c5f-94d5-bd13d65c055e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:27.543192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 141/295] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:27 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:27.544630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2c49-af3a-45b4-bdc5-12956854b0e1 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:27.545103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2c49-af3a-45b4-bdc5-12956854b0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:27.545570 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2c49-af3a-45b4-bdc5-12956854b0e1 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:27.547217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 142/296] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:27.548672 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa2c49-af3a-45b4-bdc5-12956854b0e1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:27.549113 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ee674-7788-4432-b44e-44429de3de92 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:27.564745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:27.586175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6859cf-bcbe-43b8-a478-75de8237801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:27.587112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6859cf-bcbe-43b8-a478-75de8237801c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:27.587563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6859cf-bcbe-43b8-a478-75de8237801c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:27.588040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6859cf-bcbe-43b8-a478-75de8237801c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:27.598954 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6859cf-bcbe-43b8-a478-75de8237801c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-5c6859cf-bcbe-43b8-a478-75de8237801c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:27.607793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:27.608689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:27.609472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:27.609472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:27.609472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:27.609472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:27.609472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:27.609472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:27.609472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:27.609472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:27.609472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:27.609472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:27.609472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:27.609472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:27.616687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 155/297] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:27.618337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2f81a-dcf8-41c9-bbe4-6062583bb7e5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:27.618806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2f81a-dcf8-41c9-bbe4-6062583bb7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:27.619279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2f81a-dcf8-41c9-bbe4-6062583bb7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:27.637141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-42d2f81a-dcf8-41c9-bbe4-6062583bb7e5 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:27.638615 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-42d2f81a-dcf8-41c9-bbe4-6062583bb7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:27.650187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:27.659733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa2c49-af3a-45b4-bdc5-12956854b0e1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:27.697523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a3ae5-c0d7-42e7-ae99-10fbc9eab63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:27.698250 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a3ae5-c0d7-42e7-ae99-10fbc9eab63e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:27.698534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a3ae5-c0d7-42e7-ae99-10fbc9eab63e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:27.698807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a3ae5-c0d7-42e7-ae99-10fbc9eab63e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:27.699642 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a3ae5-c0d7-42e7-ae99-10fbc9eab63e None admin] RBAC: Adding query filter params (role.id=83a7ac2bd20743b78fe0f4689037d83b, scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6, user.id=22a9f5e88a7a4cae958ab387f9779786) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:27.699950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a3ae5-c0d7-42e7-ae99-10fbc9eab63e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:27.701550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a3ae5-c0d7-42e7-ae99-10fbc9eab63e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:27.708606 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 143/298] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:27 2022] GET /identity/v3/role_assignments?user.id=22a9f5e88a7a4cae958ab387f9779786&scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6&role.id=83a7ac2bd20743b78fe0f4689037d83b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:27.709274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a3ae5-c0d7-42e7-ae99-10fbc9eab63e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:27.713984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 156/299] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:27.739448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2f81a-dcf8-41c9-bbe4-6062583bb7e5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:27.820071 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:27.862853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2f81a-dcf8-41c9-bbe4-6062583bb7e5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:27.869264 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a3ae5-c0d7-42e7-ae99-10fbc9eab63e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:27.902591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122021e4-de32-4cba-8273-07d17b48f2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:27.903432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122021e4-de32-4cba-8273-07d17b48f2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:27.903721 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122021e4-de32-4cba-8273-07d17b48f2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:27.904001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122021e4-de32-4cba-8273-07d17b48f2b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:27.905461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122021e4-de32-4cba-8273-07d17b48f2b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:27.906927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122021e4-de32-4cba-8273-07d17b48f2b0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:27.909050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 157/300] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:27.915143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488da2ea-67b9-4270-9d6a-b53f4ff0aaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:27.915833 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488da2ea-67b9-4270-9d6a-b53f4ff0aaee None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:27.916240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488da2ea-67b9-4270-9d6a-b53f4ff0aaee None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:27.916643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488da2ea-67b9-4270-9d6a-b53f4ff0aaee None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:27.917046 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878abfb-1bd3-47eb-bf8a-cd5ccd2bbca0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:27.917348 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878abfb-1bd3-47eb-bf8a-cd5ccd2bbca0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:27.917635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878abfb-1bd3-47eb-bf8a-cd5ccd2bbca0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:27.917771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488da2ea-67b9-4270-9d6a-b53f4ff0aaee None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:27.918181 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488da2ea-67b9-4270-9d6a-b53f4ff0aaee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:27.918978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 158/301] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:27.919587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488da2ea-67b9-4270-9d6a-b53f4ff0aaee None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:27.919688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878abfb-1bd3-47eb-bf8a-cd5ccd2bbca0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:27.928995 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 144/302] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:27.932746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646cf4e-eddd-4131-8b9a-a9b2ecdff64a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:27.933710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646cf4e-eddd-4131-8b9a-a9b2ecdff64a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:27.934187 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646cf4e-eddd-4131-8b9a-a9b2ecdff64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:27.953275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6646cf4e-eddd-4131-8b9a-a9b2ecdff64a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:27.954877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6646cf4e-eddd-4131-8b9a-a9b2ecdff64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:27.956799 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:28.033286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 145/303] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:28.034215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646cf4e-eddd-4131-8b9a-a9b2ecdff64a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:28.049400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878abfb-1bd3-47eb-bf8a-cd5ccd2bbca0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:28.096823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5dc5f-03cf-4c91-b9a3-1a9ec1665835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:28.097422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5dc5f-03cf-4c91-b9a3-1a9ec1665835 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:28.097716 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5dc5f-03cf-4c91-b9a3-1a9ec1665835 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:28.097995 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5dc5f-03cf-4c91-b9a3-1a9ec1665835 None admin] PATH_INFO: `/v3/groups` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:28.098683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5dc5f-03cf-4c91-b9a3-1a9ec1665835 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:28.100161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5dc5f-03cf-4c91-b9a3-1a9ec1665835 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:28.103565 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:28.115620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 159/304] 10.222.0.66 () {60 vars in 1134 bytes} [Fri Jul 15 20:23:27 2022] POST /identity/v3/groups => generated 229 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:23:28.117067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5dc5f-03cf-4c91-b9a3-1a9ec1665835 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:28.168754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646cf4e-eddd-4131-8b9a-a9b2ecdff64a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:28.210632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:28.223399 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98441457-c9ae-4c1f-9439-b738ce1cef9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:28.224310 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441457-c9ae-4c1f-9439-b738ce1cef9e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:28.224629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441457-c9ae-4c1f-9439-b738ce1cef9e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:28.224932 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441457-c9ae-4c1f-9439-b738ce1cef9e None admin] PATH_INFO: `/v3/users/e4675b5b49ea40a1a5f6cfee27f663ca` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:28.239799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98441457-c9ae-4c1f-9439-b738ce1cef9e None admin] RBAC: Authorizing `identity:get_user(user_id=e4675b5b49ea40a1a5f6cfee27f663ca)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:28.241903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98441457-c9ae-4c1f-9439-b738ce1cef9e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:28.242086 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5dc5f-03cf-4c91-b9a3-1a9ec1665835 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:28.243677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 146/305] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:28 2022] GET /identity/v3/users/e4675b5b49ea40a1a5f6cfee27f663ca => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:28.249937 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14689db1-afed-4b41-8682-1cb80744ba5b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:28.250264 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14689db1-afed-4b41-8682-1cb80744ba5b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:28.250510 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14689db1-afed-4b41-8682-1cb80744ba5b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:28.251910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 147/306] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:28.252672 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14689db1-afed-4b41-8682-1cb80744ba5b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:28.282223 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2edc8-7ba0-4bf4-8d94-f78462037ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:28.283675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2edc8-7ba0-4bf4-8d94-f78462037ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:28.284144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2edc8-7ba0-4bf4-8d94-f78462037ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:28.284623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2edc8-7ba0-4bf4-8d94-f78462037ed9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:28.297703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2edc8-7ba0-4bf4-8d94-f78462037ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-53b2edc8-7ba0-4bf4-8d94-f78462037ed9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:28.306339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:28.307190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:28.308158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:28.308158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:28.308158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:28.308158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:28.308158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:28.308158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:28.308158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:28.308158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:28.308158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:28.308158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:28.308158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:28.308158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:28.308158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 160/307] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:28.309044 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fb735-2407-4ac0-9da0-07eae59ead00 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:28.310018 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fb735-2407-4ac0-9da0-07eae59ead00 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:28.310018 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fb735-2407-4ac0-9da0-07eae59ead00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:28.329634 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6d2fb735-2407-4ac0-9da0-07eae59ead00 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:28.330976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6d2fb735-2407-4ac0-9da0-07eae59ead00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:28.372504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14689db1-afed-4b41-8682-1cb80744ba5b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:28.389083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:28.408425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 161/308] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:28.408425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fb735-2407-4ac0-9da0-07eae59ead00 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:28.413306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e03c7d-cdce-4e80-84a1-202b68ad0810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:28.413977 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e03c7d-cdce-4e80-84a1-202b68ad0810 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:28.414253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e03c7d-cdce-4e80-84a1-202b68ad0810 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:28.414770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e03c7d-cdce-4e80-84a1-202b68ad0810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:28.416160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e03c7d-cdce-4e80-84a1-202b68ad0810 None admin] RBAC: Adding query filter params (role.id=26266094acc24302b4e409ca0f585710, user.id=e4675b5b49ea40a1a5f6cfee27f663ca, scope.system=all) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:28.416472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e03c7d-cdce-4e80-84a1-202b68ad0810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:28.418412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e03c7d-cdce-4e80-84a1-202b68ad0810 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:28.427271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 148/309] 10.222.0.66 () {56 vars in 1308 bytes} [Fri Jul 15 20:23:28 2022] GET /identity/v3/role_assignments?user.id=e4675b5b49ea40a1a5f6cfee27f663ca&scope.system=all&role.id=26266094acc24302b4e409ca0f585710 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:28.431989 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e03c7d-cdce-4e80-84a1-202b68ad0810 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:28.482495 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:28.529383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fb735-2407-4ac0-9da0-07eae59ead00 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:28.552444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e03c7d-cdce-4e80-84a1-202b68ad0810 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:28.569951 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f9d46-871f-46c9-9ac8-d68fa48b83b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:28.570641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f9d46-871f-46c9-9ac8-d68fa48b83b2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:28.570928 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f9d46-871f-46c9-9ac8-d68fa48b83b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:28.571204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f9d46-871f-46c9-9ac8-d68fa48b83b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:28.572045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f9d46-871f-46c9-9ac8-d68fa48b83b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:28.572523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f9d46-871f-46c9-9ac8-d68fa48b83b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:28.574097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f9d46-871f-46c9-9ac8-d68fa48b83b2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:28.584193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 162/310] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:28.589830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f9d46-871f-46c9-9ac8-d68fa48b83b2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:28.591709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9541563-11e7-451f-bab9-180addd6f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:28.592550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9541563-11e7-451f-bab9-180addd6f6bd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:28.592834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9541563-11e7-451f-bab9-180addd6f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:28.593143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9541563-11e7-451f-bab9-180addd6f6bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:28.606242 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9541563-11e7-451f-bab9-180addd6f6bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c9541563-11e7-451f-bab9-180addd6f6bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:28.615212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:28.616337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:28.617325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:28.617325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:28.617325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:28.617325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:28.617325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:28.617325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:28.617325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:28.617325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:28.617325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:28.617325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:28.617325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:28.617325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:28.617325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 149/311] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:23:28.623967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9541563-11e7-451f-bab9-180addd6f6bd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:28.671175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:28.726085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f9d46-871f-46c9-9ac8-d68fa48b83b2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:28.744104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9541563-11e7-451f-bab9-180addd6f6bd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:28.763014 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:28.777388 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98efbbe-4c20-4a1b-ac4a-3e77fb4f6c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:28.778871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98efbbe-4c20-4a1b-ac4a-3e77fb4f6c97 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:28.779304 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98efbbe-4c20-4a1b-ac4a-3e77fb4f6c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:28.779735 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98efbbe-4c20-4a1b-ac4a-3e77fb4f6c97 None admin] PATH_INFO: `/v3/users/886e72951a1f467a8c054b4c2843d953` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:28.781085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98efbbe-4c20-4a1b-ac4a-3e77fb4f6c97 None admin] RBAC: Authorizing `identity:get_user(user_id=886e72951a1f467a8c054b4c2843d953)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:28.782644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98efbbe-4c20-4a1b-ac4a-3e77fb4f6c97 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:28.782958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af1e73-885f-4eb4-bdc7-d8232e55b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:28.783837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1e73-885f-4eb4-bdc7-d8232e55b7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:28.784457 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 163/312] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:28 2022] GET /identity/v3/users/886e72951a1f467a8c054b4c2843d953 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:28.784819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1e73-885f-4eb4-bdc7-d8232e55b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:28.785362 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1e73-885f-4eb4-bdc7-d8232e55b7a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:28.786322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af1e73-885f-4eb4-bdc7-d8232e55b7a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:28.786827 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af1e73-885f-4eb4-bdc7-d8232e55b7a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:28.788855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af1e73-885f-4eb4-bdc7-d8232e55b7a3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:28.790180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98efbbe-4c20-4a1b-ac4a-3e77fb4f6c97 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:28.799049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 150/313] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:28.805793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af1e73-885f-4eb4-bdc7-d8232e55b7a3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:28.913769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af1e73-885f-4eb4-bdc7-d8232e55b7a3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:28.915976 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:28.924850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98efbbe-4c20-4a1b-ac4a-3e77fb4f6c97 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:28.963564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99ed16-6639-4d65-8c3e-86dc86135368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:28.964459 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99ed16-6639-4d65-8c3e-86dc86135368 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:28.964752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99ed16-6639-4d65-8c3e-86dc86135368 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:28.965032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99ed16-6639-4d65-8c3e-86dc86135368 None admin] PATH_INFO: `/v3/system/users/886e72951a1f467a8c054b4c2843d953/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:28.966355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fdf4d-343d-4d4c-b6d1-684b15a47003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:28.966510 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99ed16-6639-4d65-8c3e-86dc86135368 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=886e72951a1f467a8c054b4c2843d953, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:28.967583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fdf4d-343d-4d4c-b6d1-684b15a47003 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:28.967882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99ed16-6639-4d65-8c3e-86dc86135368 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:28.968271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fdf4d-343d-4d4c-b6d1-684b15a47003 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:28.968755 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fdf4d-343d-4d4c-b6d1-684b15a47003 None admin] PATH_INFO: `/v3/users/54e09fd61e0d42ddac73ddec7e28d3f2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:28.970190 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fdf4d-343d-4d4c-b6d1-684b15a47003 None admin] RBAC: Authorizing `identity:get_user(user_id=54e09fd61e0d42ddac73ddec7e28d3f2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:28.971978 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fdf4d-343d-4d4c-b6d1-684b15a47003 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:28.980117 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 151/314] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:28 2022] GET /identity/v3/users/54e09fd61e0d42ddac73ddec7e28d3f2 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:28.981308 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fdf4d-343d-4d4c-b6d1-684b15a47003 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:28.988902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 164/315] 10.222.0.66 () {58 vars in 1334 bytes} [Fri Jul 15 20:23:28 2022] PUT /identity/v3/system/users/886e72951a1f467a8c054b4c2843d953/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:23:29.100778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fdf4d-343d-4d4c-b6d1-684b15a47003 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:29.139287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baddf9e-93b6-4570-956a-6a2b9f3be9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:29.140360 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baddf9e-93b6-4570-956a-6a2b9f3be9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:29.140870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baddf9e-93b6-4570-956a-6a2b9f3be9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:29.141344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baddf9e-93b6-4570-956a-6a2b9f3be9a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:29.189366 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:29.220885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baddf9e-93b6-4570-956a-6a2b9f3be9a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:29.222593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baddf9e-93b6-4570-956a-6a2b9f3be9a2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:29.330128 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 152/316] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:29.335912 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99ed16-6639-4d65-8c3e-86dc86135368 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:29.403543 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:29.460848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99ed16-6639-4d65-8c3e-86dc86135368 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:29.495724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126a47f-2f6c-46ca-9fe7-98f60f37bcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:29.496618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126a47f-2f6c-46ca-9fe7-98f60f37bcd9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:29.496907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126a47f-2f6c-46ca-9fe7-98f60f37bcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:29.497187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126a47f-2f6c-46ca-9fe7-98f60f37bcd9 None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:29.498467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126a47f-2f6c-46ca-9fe7-98f60f37bcd9 None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:29.499917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126a47f-2f6c-46ca-9fe7-98f60f37bcd9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:29.502098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 165/317] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:29 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:29.507796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baddf9e-93b6-4570-956a-6a2b9f3be9a2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:29.582787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:29.619458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baddf9e-93b6-4570-956a-6a2b9f3be9a2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:29.655256 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d718962-3097-4ddf-af1b-b992d3297bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:29.655915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d718962-3097-4ddf-af1b-b992d3297bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:29.656199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d718962-3097-4ddf-af1b-b992d3297bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:29.656505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d718962-3097-4ddf-af1b-b992d3297bd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:29.657339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d718962-3097-4ddf-af1b-b992d3297bd6 None admin] RBAC: Adding query filter params (role.id=26266094acc24302b4e409ca0f585710, scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6, user.id=54e09fd61e0d42ddac73ddec7e28d3f2) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:29.657653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d718962-3097-4ddf-af1b-b992d3297bd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:29.659097 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d718962-3097-4ddf-af1b-b992d3297bd6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:29.666246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 153/318] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:29 2022] GET /identity/v3/role_assignments?user.id=54e09fd61e0d42ddac73ddec7e28d3f2&scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6&role.id=26266094acc24302b4e409ca0f585710 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:30.192994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38552ad3-e867-40f0-8d37-1ef235fdb2c7 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:30.193366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38552ad3-e867-40f0-8d37-1ef235fdb2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:30.193561 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38552ad3-e867-40f0-8d37-1ef235fdb2c7 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:30.195107 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 166/319] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:30.201023 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1396b-b711-470a-8f26-7b24d9afa769 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:30.201559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1396b-b711-470a-8f26-7b24d9afa769 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:30.201559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1396b-b711-470a-8f26-7b24d9afa769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:30.220055 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c7f1396b-b711-470a-8f26-7b24d9afa769 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:30.221292 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c7f1396b-b711-470a-8f26-7b24d9afa769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:30.293548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 154/320] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:30.315966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38552ad3-e867-40f0-8d37-1ef235fdb2c7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:30.421217 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38552ad3-e867-40f0-8d37-1ef235fdb2c7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:30.453467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:30.465494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684305d8-5b4f-43bb-9e8d-db14ff1b6cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:30.466293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684305d8-5b4f-43bb-9e8d-db14ff1b6cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:30.466572 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684305d8-5b4f-43bb-9e8d-db14ff1b6cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:30.466842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684305d8-5b4f-43bb-9e8d-db14ff1b6cc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:30.467988 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684305d8-5b4f-43bb-9e8d-db14ff1b6cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:30.469444 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684305d8-5b4f-43bb-9e8d-db14ff1b6cc2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:30.471189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 167/321] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:30.476612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1396b-b711-470a-8f26-7b24d9afa769 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:30.513400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4656c-e2d4-409c-9dc2-e75bc30ebcd5 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:30.513897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4656c-e2d4-409c-9dc2-e75bc30ebcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:30.513969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4656c-e2d4-409c-9dc2-e75bc30ebcd5 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:30.515451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 168/322] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:23:30.521440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077d805-ee4f-4688-9e17-75f86db3216d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:30.521726 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077d805-ee4f-4688-9e17-75f86db3216d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:30.522144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077d805-ee4f-4688-9e17-75f86db3216d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:30.538952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d077d805-ee4f-4688-9e17-75f86db3216d None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:30.540290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:30.540507 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d077d805-ee4f-4688-9e17-75f86db3216d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:30.582423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1396b-b711-470a-8f26-7b24d9afa769 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:30.612541 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 169/323] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:30.626089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386e12f-4f68-44eb-9dd1-5eeb045fdf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:30.626843 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e12f-4f68-44eb-9dd1-5eeb045fdf58 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:30.627198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e12f-4f68-44eb-9dd1-5eeb045fdf58 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:30.627567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e12f-4f68-44eb-9dd1-5eeb045fdf58 None admin] PATH_INFO: `/v3/groups` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:30.628336 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386e12f-4f68-44eb-9dd1-5eeb045fdf58 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:30.629894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386e12f-4f68-44eb-9dd1-5eeb045fdf58 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:30.633160 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077d805-ee4f-4688-9e17-75f86db3216d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:30.648262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 155/324] 10.222.0.66 () {60 vars in 1134 bytes} [Fri Jul 15 20:23:30 2022] POST /identity/v3/groups => generated 226 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:23:30.758379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077d805-ee4f-4688-9e17-75f86db3216d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:30.785621 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:30.798680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2b063-65d1-4502-abf7-ec5123a89290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:30.799483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b063-65d1-4502-abf7-ec5123a89290 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:30.799769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b063-65d1-4502-abf7-ec5123a89290 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:30.800044 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b063-65d1-4502-abf7-ec5123a89290 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:30.812995 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2b063-65d1-4502-abf7-ec5123a89290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-0eb2b063-65d1-4502-abf7-ec5123a89290 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:30.821405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:30.822277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:30.823053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:30.823053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:30.823053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:30.823053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:30.823053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:30.823053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:30.823053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:30.823053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:30.823053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:30.823053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:30.823053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:30.823053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:30.823053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 170/325] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:23:30.828567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386e12f-4f68-44eb-9dd1-5eeb045fdf58 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:30.941436 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386e12f-4f68-44eb-9dd1-5eeb045fdf58 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:30.967657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:30.980640 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86ea1f-55b3-411d-b13f-5dfe2b24329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:30.981541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ea1f-55b3-411d-b13f-5dfe2b24329b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:30.981826 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ea1f-55b3-411d-b13f-5dfe2b24329b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:30.982103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ea1f-55b3-411d-b13f-5dfe2b24329b None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:30.982850 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86ea1f-55b3-411d-b13f-5dfe2b24329b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:30.983157 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86ea1f-55b3-411d-b13f-5dfe2b24329b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:30.985820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86ea1f-55b3-411d-b13f-5dfe2b24329b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:30.994428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 156/326] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:31.000503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2b063-65d1-4502-abf7-ec5123a89290 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:31.111350 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2b063-65d1-4502-abf7-ec5123a89290 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:31.130432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56c7b2-012c-46f1-a9aa-291fa23dcd9b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:31.130741 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56c7b2-012c-46f1-a9aa-291fa23dcd9b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:31.130993 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56c7b2-012c-46f1-a9aa-291fa23dcd9b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:31.133378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 157/327] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:31.138200 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739578d-2522-4d66-bae2-d303f17afde0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:31.138487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739578d-2522-4d66-bae2-d303f17afde0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:31.138767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739578d-2522-4d66-bae2-d303f17afde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:31.153542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e10b4c-4b0a-4985-b9b8-658b993d1fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:31.154429 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e10b4c-4b0a-4985-b9b8-658b993d1fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:31.154714 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e10b4c-4b0a-4985-b9b8-658b993d1fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:31.154987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e10b4c-4b0a-4985-b9b8-658b993d1fc0 None admin] PATH_INFO: `/v3/users/e4675b5b49ea40a1a5f6cfee27f663ca` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:31.156216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e10b4c-4b0a-4985-b9b8-658b993d1fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=e4675b5b49ea40a1a5f6cfee27f663ca)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:31.157828 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e10b4c-4b0a-4985-b9b8-658b993d1fc0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:31.159948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 171/328] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:30 2022] GET /identity/v3/users/e4675b5b49ea40a1a5f6cfee27f663ca => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:31.160486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5739578d-2522-4d66-bae2-d303f17afde0 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:31.161948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5739578d-2522-4d66-bae2-d303f17afde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:31.166949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e10b4c-4b0a-4985-b9b8-658b993d1fc0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:31.243275 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:31.254033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 158/329] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:31.277616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739578d-2522-4d66-bae2-d303f17afde0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:31.304280 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e10b4c-4b0a-4985-b9b8-658b993d1fc0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:31.340630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb340ff8-4518-4714-bd44-713f3ea3a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:31.341499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb340ff8-4518-4714-bd44-713f3ea3a626 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:31.341786 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb340ff8-4518-4714-bd44-713f3ea3a626 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:31.342063 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb340ff8-4518-4714-bd44-713f3ea3a626 None admin] PATH_INFO: `/v3/system/users/e4675b5b49ea40a1a5f6cfee27f663ca/roles/26266094acc24302b4e409ca0f585710` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:31.343684 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb340ff8-4518-4714-bd44-713f3ea3a626 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e4675b5b49ea40a1a5f6cfee27f663ca, role_id=26266094acc24302b4e409ca0f585710)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:31.345146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb340ff8-4518-4714-bd44-713f3ea3a626 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:31.354281 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 172/330] 10.222.0.66 () {58 vars in 1334 bytes} [Fri Jul 15 20:23:31 2022] PUT /identity/v3/system/users/e4675b5b49ea40a1a5f6cfee27f663ca/roles/26266094acc24302b4e409ca0f585710 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:23:31.393162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739578d-2522-4d66-bae2-d303f17afde0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:31.411701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:31.433765 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8484321-ca2a-434f-a296-822104810284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:31.434630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8484321-ca2a-434f-a296-822104810284 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:31.434921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8484321-ca2a-434f-a296-822104810284 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:31.435199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8484321-ca2a-434f-a296-822104810284 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:31.447898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8484321-ca2a-434f-a296-822104810284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c8484321-ca2a-434f-a296-822104810284 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:31.456082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:31.457033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:31.457802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:31.457802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:31.457802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:31.457802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:31.457802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:31.457802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:31.457802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:31.457802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:31.457802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:31.457802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:31.457802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:31.457802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:31.457802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 159/331] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:23:31.465586 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb340ff8-4518-4714-bd44-713f3ea3a626 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:31.590961 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb340ff8-4518-4714-bd44-713f3ea3a626 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:31.614949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:31.637538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ccd8e-cf08-46dc-aeb8-137d4b228f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:31.638214 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ccd8e-cf08-46dc-aeb8-137d4b228f5e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:31.638491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ccd8e-cf08-46dc-aeb8-137d4b228f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:31.638762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ccd8e-cf08-46dc-aeb8-137d4b228f5e None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:31.639510 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ccd8e-cf08-46dc-aeb8-137d4b228f5e None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:31.639812 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ccd8e-cf08-46dc-aeb8-137d4b228f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:31.641223 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ccd8e-cf08-46dc-aeb8-137d4b228f5e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:31.650246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 173/332] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:31.656014 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8484321-ca2a-434f-a296-822104810284 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:31.783477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8484321-ca2a-434f-a296-822104810284 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:31.818638 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774d07c-556c-4e98-b3be-f4b05440fe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:31.819593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774d07c-556c-4e98-b3be-f4b05440fe78 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:31.819874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774d07c-556c-4e98-b3be-f4b05440fe78 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:31.820166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774d07c-556c-4e98-b3be-f4b05440fe78 None admin] PATH_INFO: `/v3/users/886e72951a1f467a8c054b4c2843d953` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:31.821396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774d07c-556c-4e98-b3be-f4b05440fe78 None admin] RBAC: Authorizing `identity:get_user(user_id=886e72951a1f467a8c054b4c2843d953)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:31.822848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774d07c-556c-4e98-b3be-f4b05440fe78 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:31.824804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 160/333] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:31 2022] GET /identity/v3/users/886e72951a1f467a8c054b4c2843d953 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:31.830615 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ccd8e-cf08-46dc-aeb8-137d4b228f5e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:31.954965 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ccd8e-cf08-46dc-aeb8-137d4b228f5e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:31.995179 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b15e5-3103-4d58-ba6b-cdb7951ac88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:31.995850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b15e5-3103-4d58-ba6b-cdb7951ac88a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:31.996130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b15e5-3103-4d58-ba6b-cdb7951ac88a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:31.996423 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b15e5-3103-4d58-ba6b-cdb7951ac88a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:31.997359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b15e5-3103-4d58-ba6b-cdb7951ac88a None admin] RBAC: Adding query filter params (role.id=83a7ac2bd20743b78fe0f4689037d83b, user.id=886e72951a1f467a8c054b4c2843d953, scope.system=all) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:31.997676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b15e5-3103-4d58-ba6b-cdb7951ac88a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:31.999113 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b15e5-3103-4d58-ba6b-cdb7951ac88a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:32.013811 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 174/334] 10.222.0.66 () {56 vars in 1308 bytes} [Fri Jul 15 20:23:31 2022] GET /identity/v3/role_assignments?user.id=886e72951a1f467a8c054b4c2843d953&scope.system=all&role.id=83a7ac2bd20743b78fe0f4689037d83b => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:33.330528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065103f1-0a54-46c6-8243-fc19c92f07ae None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:33.331035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065103f1-0a54-46c6-8243-fc19c92f07ae None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:33.331116 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065103f1-0a54-46c6-8243-fc19c92f07ae None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:33.332696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 161/335] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:33.339037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86efc7-7376-4683-b659-56a512bc025d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:33.339465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86efc7-7376-4683-b659-56a512bc025d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:33.339661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86efc7-7376-4683-b659-56a512bc025d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:33.381467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5a86efc7-7376-4683-b659-56a512bc025d None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:33.382678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5a86efc7-7376-4683-b659-56a512bc025d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:33.432781 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:33.494784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 175/336] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:33.525177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065103f1-0a54-46c6-8243-fc19c92f07ae None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:33.587511 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:33.654057 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065103f1-0a54-46c6-8243-fc19c92f07ae None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:33.699945 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfe801-2956-4ded-bdb6-abdabb30c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:33.700793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe801-2956-4ded-bdb6-abdabb30c62c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:33.701079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe801-2956-4ded-bdb6-abdabb30c62c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:33.701354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe801-2956-4ded-bdb6-abdabb30c62c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:33.712300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfe801-2956-4ded-bdb6-abdabb30c62c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-dbdfe801-2956-4ded-bdb6-abdabb30c62c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:33.721804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:33.722689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:33.723462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:33.723462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:33.723462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:33.723462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:33.723462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:33.723462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:33.723462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:33.723462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:33.723462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:33.723462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:33.723462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:33.723462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:33.723462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 162/337] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:33.731389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86efc7-7376-4683-b659-56a512bc025d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:33.861628 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86efc7-7376-4683-b659-56a512bc025d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:33.906436 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0c5d9-394b-4180-a78c-aa00fe96575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:33.907124 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c5d9-394b-4180-a78c-aa00fe96575f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:33.907413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c5d9-394b-4180-a78c-aa00fe96575f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:33.907695 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c5d9-394b-4180-a78c-aa00fe96575f None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:33.908477 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0c5d9-394b-4180-a78c-aa00fe96575f None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:33.908791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0c5d9-394b-4180-a78c-aa00fe96575f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:33.910175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0c5d9-394b-4180-a78c-aa00fe96575f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:33.924378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 176/338] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:33.930200 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfe801-2956-4ded-bdb6-abdabb30c62c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:34.069372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfe801-2956-4ded-bdb6-abdabb30c62c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:34.071772 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:34.110088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c493f4-63c3-4796-a36d-9c4471777e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:34.110759 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c493f4-63c3-4796-a36d-9c4471777e5a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:34.111047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c493f4-63c3-4796-a36d-9c4471777e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:34.111324 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c493f4-63c3-4796-a36d-9c4471777e5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:34.189680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c493f4-63c3-4796-a36d-9c4471777e5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:34.191166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c493f4-63c3-4796-a36d-9c4471777e5a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:34.233923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bda4f-038a-4bbb-9e72-323db32926fd None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:34.234225 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bda4f-038a-4bbb-9e72-323db32926fd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:34.234500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bda4f-038a-4bbb-9e72-323db32926fd None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:34.236013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 177/339] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:34.242077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea1fd5-896a-4543-9584-bd976301a0ed None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:34.242782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea1fd5-896a-4543-9584-bd976301a0ed None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:34.243256 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea1fd5-896a-4543-9584-bd976301a0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:34.271585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5eea1fd5-896a-4543-9584-bd976301a0ed None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:34.273926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5eea1fd5-896a-4543-9584-bd976301a0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:34.302377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:34.313804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 163/340] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:34.315150 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9ddab-0ddc-4a53-a2b2-f50e6affd286 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:34.315444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9ddab-0ddc-4a53-a2b2-f50e6affd286 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:34.315720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9ddab-0ddc-4a53-a2b2-f50e6affd286 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:34.321787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 164/341] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:34.323354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9ddab-0ddc-4a53-a2b2-f50e6affd286 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:34.331201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:34.405962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 178/342] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:34.407898 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c634a5-4fbe-4a55-a6f6-0ddec47ed3ee None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:34.411408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c634a5-4fbe-4a55-a6f6-0ddec47ed3ee None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:34.411871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c634a5-4fbe-4a55-a6f6-0ddec47ed3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:34.454284 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f9c634a5-4fbe-4a55-a6f6-0ddec47ed3ee None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:34.456930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f9c634a5-4fbe-4a55-a6f6-0ddec47ed3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:34.501358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9ddab-0ddc-4a53-a2b2-f50e6affd286 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:34.547582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5e770-05ac-4e71-9255-2050a2ac0b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:34.548801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e770-05ac-4e71-9255-2050a2ac0b0c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:34.549259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e770-05ac-4e71-9255-2050a2ac0b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:34.549798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e770-05ac-4e71-9255-2050a2ac0b0c None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:34.552102 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5e770-05ac-4e71-9255-2050a2ac0b0c None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:34.554851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5e770-05ac-4e71-9255-2050a2ac0b0c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:34.558026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 165/343] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:34 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:34.561417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5e770-05ac-4e71-9255-2050a2ac0b0c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:34.599048 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 179/344] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:34.601789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c634a5-4fbe-4a55-a6f6-0ddec47ed3ee None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:34.698394 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:34.717199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:34.734589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c634a5-4fbe-4a55-a6f6-0ddec47ed3ee None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:34.743274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5e770-05ac-4e71-9255-2050a2ac0b0c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:34.782376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926b8d8-f7bc-41ff-89b7-fb80dd4516e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:34.783509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926b8d8-f7bc-41ff-89b7-fb80dd4516e2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:34.784026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926b8d8-f7bc-41ff-89b7-fb80dd4516e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:34.784494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926b8d8-f7bc-41ff-89b7-fb80dd4516e2 None admin] PATH_INFO: `/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:34.792049 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926b8d8-f7bc-41ff-89b7-fb80dd4516e2 None admin] RBAC: Authorizing `identity:get_group(group_id=d896c4db720e42d7b94bb4c1b6a189b9)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:34.793584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926b8d8-f7bc-41ff-89b7-fb80dd4516e2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:34.794500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a6c0a-a650-438f-a40c-1f6e84feddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:34.795291 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 180/345] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:34 2022] GET /identity/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:34.795633 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6c0a-a650-438f-a40c-1f6e84feddb1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:34.796070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6c0a-a650-438f-a40c-1f6e84feddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:34.796520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6c0a-a650-438f-a40c-1f6e84feddb1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:34.796642 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdea6dd-7b6f-4056-83ff-2fce38725d39 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:34.796834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdea6dd-7b6f-4056-83ff-2fce38725d39 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:34.797252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdea6dd-7b6f-4056-83ff-2fce38725d39 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:34.798756 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 181/346] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:34.799472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdea6dd-7b6f-4056-83ff-2fce38725d39 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:34.809873 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a6c0a-a650-438f-a40c-1f6e84feddb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1f0a6c0a-a650-438f-a40c-1f6e84feddb1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:34.817852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:34.819482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:34.820529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:34.820529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:34.820529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:34.820529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:34.820529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:34.820529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:34.820529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:34.820529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:34.820529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:34.820529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:34.820529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 20:23:34.820529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:34.820529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 166/347] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:34.821592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711022a9-94c7-4320-8f19-b3f50797e2c5 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:34.821933 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711022a9-94c7-4320-8f19-b3f50797e2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:34.822221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711022a9-94c7-4320-8f19-b3f50797e2c5 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:34.823500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 167/348] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:34.824192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711022a9-94c7-4320-8f19-b3f50797e2c5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:34.929643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdea6dd-7b6f-4056-83ff-2fce38725d39 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:34.971466 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711022a9-94c7-4320-8f19-b3f50797e2c5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:34.976790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc579f-1de8-45ae-b962-a6857e0d391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:34.977012 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc579f-1de8-45ae-b962-a6857e0d391e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:34.977290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc579f-1de8-45ae-b962-a6857e0d391e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:34.977569 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc579f-1de8-45ae-b962-a6857e0d391e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:34.995100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc579f-1de8-45ae-b962-a6857e0d391e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-18dc579f-1de8-45ae-b962-a6857e0d391e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:35.005752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:35.006984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:35.007783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:35.007783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:35.007783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:35.007783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:35.007783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:35.007783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:35.007783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:35.007783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:35.007783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:35.007783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:35.007783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:35.007783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:35.009160 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 182/349] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:23:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:35.010716 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76548a3f-ea03-4c53-ace3-ee8a2c95d9ef None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:35.014010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76548a3f-ea03-4c53-ace3-ee8a2c95d9ef None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:35.014010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76548a3f-ea03-4c53-ace3-ee8a2c95d9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:35.016262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:35.024502 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b2c0f-272b-43d9-a0df-6ca3c357a9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:35.025140 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b2c0f-272b-43d9-a0df-6ca3c357a9af None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:35.025429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b2c0f-272b-43d9-a0df-6ca3c357a9af None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:35.025713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b2c0f-272b-43d9-a0df-6ca3c357a9af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:35.026564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b2c0f-272b-43d9-a0df-6ca3c357a9af None admin] RBAC: Adding query filter params (group.id=d896c4db720e42d7b94bb4c1b6a189b9, role.id=83a7ac2bd20743b78fe0f4689037d83b, scope.project.id=1658f1fcd1984324979b5dde1834d62e) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:35.026881 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b2c0f-272b-43d9-a0df-6ca3c357a9af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:35.028353 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b2c0f-272b-43d9-a0df-6ca3c357a9af None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:35.036045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 168/350] 10.222.0.66 () {56 vars in 1376 bytes} [Fri Jul 15 20:23:34 2022] GET /identity/v3/role_assignments?group.id=d896c4db720e42d7b94bb4c1b6a189b9&scope.project.id=1658f1fcd1984324979b5dde1834d62e&role.id=83a7ac2bd20743b78fe0f4689037d83b => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:35.036534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-76548a3f-ea03-4c53-ace3-ee8a2c95d9ef None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:35.036918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b2c0f-272b-43d9-a0df-6ca3c357a9af None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:35.040130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-76548a3f-ea03-4c53-ace3-ee8a2c95d9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:35.055228 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:35.150413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 183/351] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:35.152264 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75e784-92e7-4499-af99-9596007a5e54 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:35.152788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75e784-92e7-4499-af99-9596007a5e54 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:35.153335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75e784-92e7-4499-af99-9596007a5e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:35.176205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3a75e784-92e7-4499-af99-9596007a5e54 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:35.178203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3a75e784-92e7-4499-af99-9596007a5e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:35.191888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b2c0f-272b-43d9-a0df-6ca3c357a9af None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:35.245099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025ba38-4c0d-464c-aa15-059c112ebae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:35.245099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025ba38-4c0d-464c-aa15-059c112ebae0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:35.245099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025ba38-4c0d-464c-aa15-059c112ebae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:35.245099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025ba38-4c0d-464c-aa15-059c112ebae0 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:35.245469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025ba38-4c0d-464c-aa15-059c112ebae0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:35.245469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025ba38-4c0d-464c-aa15-059c112ebae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:35.246471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025ba38-4c0d-464c-aa15-059c112ebae0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:35.258935 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 184/352] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:35.259808 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75e784-92e7-4499-af99-9596007a5e54 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:35.260029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 169/353] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:35.261101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025ba38-4c0d-464c-aa15-059c112ebae0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:35.347624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:35.372959 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:35.401736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025ba38-4c0d-464c-aa15-059c112ebae0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:35.417293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75e784-92e7-4499-af99-9596007a5e54 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:35.438538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e5b37-c4e7-4c6d-a299-b51770ca72c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:35.440255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e5b37-c4e7-4c6d-a299-b51770ca72c3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:35.440666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e5b37-c4e7-4c6d-a299-b51770ca72c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:35.440951 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e5b37-c4e7-4c6d-a299-b51770ca72c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:35.455169 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e5b37-c4e7-4c6d-a299-b51770ca72c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a23e5b37-c4e7-4c6d-a299-b51770ca72c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:35.464571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:35.465449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:35.466238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:35.466238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:35.466238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:35.466238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:35.466238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:35.466238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:35.466238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:35.466238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:35.466238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:35.466238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:35.466238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:35.466238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:35.467421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d33bcb-9442-47c0-9e68-eb228e76e100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:35.467421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d33bcb-9442-47c0-9e68-eb228e76e100 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:35.467421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d33bcb-9442-47c0-9e68-eb228e76e100 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:35.467970 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 170/354] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:23:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:35.467970 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e5b37-c4e7-4c6d-a299-b51770ca72c3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:35.471076 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d33bcb-9442-47c0-9e68-eb228e76e100 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:35.471897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d33bcb-9442-47c0-9e68-eb228e76e100 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:35.472322 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d33bcb-9442-47c0-9e68-eb228e76e100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:35.473774 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d33bcb-9442-47c0-9e68-eb228e76e100 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:35.483889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 185/355] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:35.484607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d33bcb-9442-47c0-9e68-eb228e76e100 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:35.594841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e5b37-c4e7-4c6d-a299-b51770ca72c3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:35.604078 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d33bcb-9442-47c0-9e68-eb228e76e100 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:35.612929 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:35.632892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225ee10-8811-4fac-a3fd-2af0650de923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:35.633875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225ee10-8811-4fac-a3fd-2af0650de923 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:35.634162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225ee10-8811-4fac-a3fd-2af0650de923 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:35.634441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225ee10-8811-4fac-a3fd-2af0650de923 None admin] PATH_INFO: `/v3/users/e4675b5b49ea40a1a5f6cfee27f663ca` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:35.635765 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225ee10-8811-4fac-a3fd-2af0650de923 None admin] RBAC: Authorizing `identity:get_user(user_id=e4675b5b49ea40a1a5f6cfee27f663ca)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:35.637275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225ee10-8811-4fac-a3fd-2af0650de923 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:35.638911 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 171/356] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:23:35 2022] GET /identity/v3/users/e4675b5b49ea40a1a5f6cfee27f663ca => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:35.639497 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4c787-81c3-4f19-b830-0803d2052cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:35.639706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225ee10-8811-4fac-a3fd-2af0650de923 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:35.640290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c787-81c3-4f19-b830-0803d2052cac None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:35.640589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c787-81c3-4f19-b830-0803d2052cac None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:35.640870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c787-81c3-4f19-b830-0803d2052cac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:35.646001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:35.654548 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4c787-81c3-4f19-b830-0803d2052cac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-0db4c787-81c3-4f19-b830-0803d2052cac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:35.663416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:35.667016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:35.669091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:35.669091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:35.669091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:35.669091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:35.669091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:35.669091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:35.669091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:35.669091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:35.669091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:35.669091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:35.669091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:35.669091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:35.669091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 186/357] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:35.669091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4c787-81c3-4f19-b830-0803d2052cac None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:35.760622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225ee10-8811-4fac-a3fd-2af0650de923 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:35.773826 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4c787-81c3-4f19-b830-0803d2052cac None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:35.810251 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb906a-2b76-4a69-96c8-5c7f048c59a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:35.810910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb906a-2b76-4a69-96c8-5c7f048c59a8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:35.811376 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb906a-2b76-4a69-96c8-5c7f048c59a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:35.812895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb906a-2b76-4a69-96c8-5c7f048c59a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:35.812895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb906a-2b76-4a69-96c8-5c7f048c59a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:35.813201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb906a-2b76-4a69-96c8-5c7f048c59a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:35.814602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb906a-2b76-4a69-96c8-5c7f048c59a8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:35.821357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289c8f0-98d2-4d7b-9094-80625302ea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:35.822299 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289c8f0-98d2-4d7b-9094-80625302ea11 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:35.822641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289c8f0-98d2-4d7b-9094-80625302ea11 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:35.822920 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289c8f0-98d2-4d7b-9094-80625302ea11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:35.824734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 172/358] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:35.825258 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb906a-2b76-4a69-96c8-5c7f048c59a8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:35.884109 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:35.917821 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:35.929082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289c8f0-98d2-4d7b-9094-80625302ea11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:35.930579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289c8f0-98d2-4d7b-9094-80625302ea11 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:35.950968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb906a-2b76-4a69-96c8-5c7f048c59a8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:35.992575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203efb5-9397-4ed8-9a4c-e1747114067c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:35.993590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203efb5-9397-4ed8-9a4c-e1747114067c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:35.994085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203efb5-9397-4ed8-9a4c-e1747114067c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:35.994361 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203efb5-9397-4ed8-9a4c-e1747114067c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:35.995210 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203efb5-9397-4ed8-9a4c-e1747114067c None admin] RBAC: Adding query filter params (role.id=26266094acc24302b4e409ca0f585710, user.id=e4675b5b49ea40a1a5f6cfee27f663ca, scope.system=all) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:35.995528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203efb5-9397-4ed8-9a4c-e1747114067c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:35.997006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203efb5-9397-4ed8-9a4c-e1747114067c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:36.011105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 173/359] 10.222.0.66 () {56 vars in 1308 bytes} [Fri Jul 15 20:23:35 2022] GET /identity/v3/role_assignments?user.id=e4675b5b49ea40a1a5f6cfee27f663ca&scope.system=all&role.id=26266094acc24302b4e409ca0f585710 => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:36.011898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203efb5-9397-4ed8-9a4c-e1747114067c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:36.060229 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 187/360] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:36.061625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9742f-a7eb-4e64-95f7-a8d66db5696a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:36.061914 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9742f-a7eb-4e64-95f7-a8d66db5696a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:36.062189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9742f-a7eb-4e64-95f7-a8d66db5696a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:36.065030 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 188/361] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:36.065521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9742f-a7eb-4e64-95f7-a8d66db5696a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:36.160123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203efb5-9397-4ed8-9a4c-e1747114067c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:36.169687 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:36.201670 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c5d16-5108-47fc-a0e0-96b33b8d0230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:36.202725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c5d16-5108-47fc-a0e0-96b33b8d0230 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:36.203384 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:36.203753 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c5d16-5108-47fc-a0e0-96b33b8d0230 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:36.204948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c5d16-5108-47fc-a0e0-96b33b8d0230 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:36.206047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c5d16-5108-47fc-a0e0-96b33b8d0230 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:36.206567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c5d16-5108-47fc-a0e0-96b33b8d0230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:36.208991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c5d16-5108-47fc-a0e0-96b33b8d0230 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:36.212834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9742f-a7eb-4e64-95f7-a8d66db5696a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:36.220115 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 174/362] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:36.225769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c5d16-5108-47fc-a0e0-96b33b8d0230 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:36.255836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542d269-2635-4159-8066-e7ce3a9868d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:36.257173 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d269-2635-4159-8066-e7ce3a9868d5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:36.257466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d269-2635-4159-8066-e7ce3a9868d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:36.257742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d269-2635-4159-8066-e7ce3a9868d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:36.348872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542d269-2635-4159-8066-e7ce3a9868d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:36.350373 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542d269-2635-4159-8066-e7ce3a9868d5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:36.361202 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c5d16-5108-47fc-a0e0-96b33b8d0230 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:36.406935 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7e664-3e5e-4091-a41b-1e08d6744fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:36.408322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7e664-3e5e-4091-a41b-1e08d6744fdc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:36.408668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7e664-3e5e-4091-a41b-1e08d6744fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:36.409131 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7e664-3e5e-4091-a41b-1e08d6744fdc None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:36.410461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7e664-3e5e-4091-a41b-1e08d6744fdc None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:36.411848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7e664-3e5e-4091-a41b-1e08d6744fdc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:36.414333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 175/363] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:36 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:36.415583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cf669-1561-407b-aff2-e1e88a5a5276 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:36.415865 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cf669-1561-407b-aff2-e1e88a5a5276 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:36.416135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cf669-1561-407b-aff2-e1e88a5a5276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:36.434558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c14cf669-1561-407b-aff2-e1e88a5a5276 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:36.435736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c14cf669-1561-407b-aff2-e1e88a5a5276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:36.477631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:36.483344 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:36.493641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 189/364] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:36.496461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542d269-2635-4159-8066-e7ce3a9868d5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:36.543870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 176/365] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:36.544823 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cf669-1561-407b-aff2-e1e88a5a5276 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:36.638333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542d269-2635-4159-8066-e7ce3a9868d5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:36.662086 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cf669-1561-407b-aff2-e1e88a5a5276 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:36.688479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab12b68-779c-4809-9eda-264c6cf85443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:36.689147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab12b68-779c-4809-9eda-264c6cf85443 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:36.689435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab12b68-779c-4809-9eda-264c6cf85443 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:36.689719 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab12b68-779c-4809-9eda-264c6cf85443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:36.715348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15fcf1-6df8-43e3-b21f-f58e5b76e1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:36.715348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15fcf1-6df8-43e3-b21f-f58e5b76e1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:36.715348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15fcf1-6df8-43e3-b21f-f58e5b76e1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:36.715348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15fcf1-6df8-43e3-b21f-f58e5b76e1e6 None admin] PATH_INFO: `/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:36.716892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15fcf1-6df8-43e3-b21f-f58e5b76e1e6 None admin] RBAC: Authorizing `identity:get_group(group_id=d896c4db720e42d7b94bb4c1b6a189b9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:36.718010 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15fcf1-6df8-43e3-b21f-f58e5b76e1e6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:36.719892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 177/366] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:36 2022] GET /identity/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:36.722224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15fcf1-6df8-43e3-b21f-f58e5b76e1e6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:36.767100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:36.778194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:36.789885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab12b68-779c-4809-9eda-264c6cf85443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:36.793438 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab12b68-779c-4809-9eda-264c6cf85443 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:36.867979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15fcf1-6df8-43e3-b21f-f58e5b76e1e6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:36.910747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498afccc-9f9d-4a81-af5f-09295c1bc59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:36.911877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498afccc-9f9d-4a81-af5f-09295c1bc59f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:36.912217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498afccc-9f9d-4a81-af5f-09295c1bc59f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:36.913729 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498afccc-9f9d-4a81-af5f-09295c1bc59f None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:36.915404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498afccc-9f9d-4a81-af5f-09295c1bc59f None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:36.917799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498afccc-9f9d-4a81-af5f-09295c1bc59f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:36.919258 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 178/367] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:36 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:36.921289 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498afccc-9f9d-4a81-af5f-09295c1bc59f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:36.941102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 190/368] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:36.942425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab12b68-779c-4809-9eda-264c6cf85443 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:37.058343 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498afccc-9f9d-4a81-af5f-09295c1bc59f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:37.059953 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:37.077707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:37.089405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab12b68-779c-4809-9eda-264c6cf85443 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:37.106870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197969a-81cb-4a4d-a962-5ce0f29ea934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:37.107687 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197969a-81cb-4a4d-a962-5ce0f29ea934 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:37.107965 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197969a-81cb-4a4d-a962-5ce0f29ea934 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:37.108274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197969a-81cb-4a4d-a962-5ce0f29ea934 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:37.120841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197969a-81cb-4a4d-a962-5ce0f29ea934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c197969a-81cb-4a4d-a962-5ce0f29ea934 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:37.129033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:37.130134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:37.130903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:37.130903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:37.130903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:37.130903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:37.130903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:37.130903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:37.130903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:37.130903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:37.130903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:37.130903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:37.130903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:37.130903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:37.130903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 179/369] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:23:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:37.131621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197969a-81cb-4a4d-a962-5ce0f29ea934 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:37.142854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24d238-99ca-444e-a295-bffcd24114b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:37.143754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d238-99ca-444e-a295-bffcd24114b7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:37.144659 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d238-99ca-444e-a295-bffcd24114b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:37.145096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d238-99ca-444e-a295-bffcd24114b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:37.146413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24d238-99ca-444e-a295-bffcd24114b7 None admin] RBAC: Adding query filter params (group.id=d896c4db720e42d7b94bb4c1b6a189b9, role.id=e97c8dedb3a147c6ab5d98229f5a000c, scope.project.id=1658f1fcd1984324979b5dde1834d62e) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:37.147930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24d238-99ca-444e-a295-bffcd24114b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:37.149771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24d238-99ca-444e-a295-bffcd24114b7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:37.159944 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 191/370] 10.222.0.66 () {56 vars in 1376 bytes} [Fri Jul 15 20:23:36 2022] GET /identity/v3/role_assignments?group.id=d896c4db720e42d7b94bb4c1b6a189b9&scope.project.id=1658f1fcd1984324979b5dde1834d62e&role.id=e97c8dedb3a147c6ab5d98229f5a000c => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:37.161050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24d238-99ca-444e-a295-bffcd24114b7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:37.297221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197969a-81cb-4a4d-a962-5ce0f29ea934 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:37.306132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24d238-99ca-444e-a295-bffcd24114b7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:37.343613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433e348-1540-4c32-8bd8-c552e34c2764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:37.344538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433e348-1540-4c32-8bd8-c552e34c2764 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:37.344826 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433e348-1540-4c32-8bd8-c552e34c2764 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:37.345106 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433e348-1540-4c32-8bd8-c552e34c2764 None admin] PATH_INFO: `/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:37.346327 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433e348-1540-4c32-8bd8-c552e34c2764 None admin] RBAC: Authorizing `identity:get_group(group_id=d896c4db720e42d7b94bb4c1b6a189b9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:37.347802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433e348-1540-4c32-8bd8-c552e34c2764 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:37.355350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 180/371] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:37 2022] GET /identity/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:37.356201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69003afc-3236-4f0b-aee8-2be984657a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:37.356325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433e348-1540-4c32-8bd8-c552e34c2764 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:37.357472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69003afc-3236-4f0b-aee8-2be984657a4f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:37.357926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69003afc-3236-4f0b-aee8-2be984657a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:37.358343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69003afc-3236-4f0b-aee8-2be984657a4f None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:37.360711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69003afc-3236-4f0b-aee8-2be984657a4f None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:37.362185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69003afc-3236-4f0b-aee8-2be984657a4f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:37.367791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 192/372] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:37 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:37.367791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef3846-75c8-4019-8748-d90e36724cf8 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:37.367791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef3846-75c8-4019-8748-d90e36724cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:37.367791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef3846-75c8-4019-8748-d90e36724cf8 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:37.367791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 193/373] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:37.368269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef3846-75c8-4019-8748-d90e36724cf8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:37.395356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:37.402310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:37.493729 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433e348-1540-4c32-8bd8-c552e34c2764 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:37.501982 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef3846-75c8-4019-8748-d90e36724cf8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:37.537676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57ab81-a6b8-4415-946d-67f83ae34e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:37.538138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57ab81-a6b8-4415-946d-67f83ae34e1d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:37.538424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57ab81-a6b8-4415-946d-67f83ae34e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:37.538706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57ab81-a6b8-4415-946d-67f83ae34e1d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:37.539718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57ab81-a6b8-4415-946d-67f83ae34e1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:37.540087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57ab81-a6b8-4415-946d-67f83ae34e1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:37.541505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57ab81-a6b8-4415-946d-67f83ae34e1d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:37.551386 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 181/374] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:37.551803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9cb7b-ba52-468c-98d0-5b486dd62d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:37.552721 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c783e-b940-46c8-97c6-422f738e1b46 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:37.552982 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9cb7b-ba52-468c-98d0-5b486dd62d6a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:37.553080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c783e-b940-46c8-97c6-422f738e1b46 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:37.553353 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c783e-b940-46c8-97c6-422f738e1b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:37.553730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9cb7b-ba52-468c-98d0-5b486dd62d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:37.554171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9cb7b-ba52-468c-98d0-5b486dd62d6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:37.555281 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9cb7b-ba52-468c-98d0-5b486dd62d6a None admin] RBAC: Adding query filter params (group.id=d896c4db720e42d7b94bb4c1b6a189b9, role.id=e97c8dedb3a147c6ab5d98229f5a000c, scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:37.555970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9cb7b-ba52-468c-98d0-5b486dd62d6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:37.557826 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9cb7b-ba52-468c-98d0-5b486dd62d6a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:37.565416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 194/375] 10.222.0.66 () {56 vars in 1376 bytes} [Fri Jul 15 20:23:37 2022] GET /identity/v3/role_assignments?group.id=d896c4db720e42d7b94bb4c1b6a189b9&scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6&role.id=e97c8dedb3a147c6ab5d98229f5a000c => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:37.566646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9cb7b-ba52-468c-98d0-5b486dd62d6a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:37.575626 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d31c783e-b940-46c8-97c6-422f738e1b46 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:37.576913 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d31c783e-b940-46c8-97c6-422f738e1b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:37.660407 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 182/376] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:37.661494 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c783e-b940-46c8-97c6-422f738e1b46 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:37.707166 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:37.708785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:37.725660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9cb7b-ba52-468c-98d0-5b486dd62d6a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:37.771234 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08ef53-76f4-456d-bb03-18eeb16fa3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:37.772439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08ef53-76f4-456d-bb03-18eeb16fa3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:37.772866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08ef53-76f4-456d-bb03-18eeb16fa3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:37.773279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08ef53-76f4-456d-bb03-18eeb16fa3c0 None admin] PATH_INFO: `/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:37.775165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08ef53-76f4-456d-bb03-18eeb16fa3c0 None admin] RBAC: Authorizing `identity:get_group(group_id=d896c4db720e42d7b94bb4c1b6a189b9)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:37.776848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08ef53-76f4-456d-bb03-18eeb16fa3c0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:37.784259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 195/377] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:37 2022] GET /identity/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:37.784259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08ef53-76f4-456d-bb03-18eeb16fa3c0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:37.812933 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c783e-b940-46c8-97c6-422f738e1b46 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:37.853089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a915533-5531-4419-a6cd-e026adae032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:37.854224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a915533-5531-4419-a6cd-e026adae032c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:37.854701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a915533-5531-4419-a6cd-e026adae032c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:37.855281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a915533-5531-4419-a6cd-e026adae032c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:37.924695 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08ef53-76f4-456d-bb03-18eeb16fa3c0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:37.948637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a915533-5531-4419-a6cd-e026adae032c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:37.950119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a915533-5531-4419-a6cd-e026adae032c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:37.973796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae198f8d-8ac1-49e0-901a-a970cbf3eebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:37.974593 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae198f8d-8ac1-49e0-901a-a970cbf3eebf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:37.974942 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae198f8d-8ac1-49e0-901a-a970cbf3eebf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:37.975742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae198f8d-8ac1-49e0-901a-a970cbf3eebf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:37.978377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:37.993144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae198f8d-8ac1-49e0-901a-a970cbf3eebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ae198f8d-8ac1-49e0-901a-a970cbf3eebf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:38.002399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:38.003320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:38.004118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:38.004118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:38.004118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:38.004118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:38.004118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:38.004118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:38.004118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:38.004118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:38.004118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:38.004118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:38.004118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:38.004118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:38.004758 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 196/378] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:38.005316 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae198f8d-8ac1-49e0-901a-a970cbf3eebf None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:38.029274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:38.081180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 183/379] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:38.082035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a915533-5531-4419-a6cd-e026adae032c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:38.120751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae198f8d-8ac1-49e0-901a-a970cbf3eebf None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:38.166099 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e10d2-5a7e-42bb-be23-f8913a75cfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:38.166768 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e10d2-5a7e-42bb-be23-f8913a75cfb8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:38.167055 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e10d2-5a7e-42bb-be23-f8913a75cfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:38.167334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e10d2-5a7e-42bb-be23-f8913a75cfb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:38.168183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e10d2-5a7e-42bb-be23-f8913a75cfb8 None admin] RBAC: Adding query filter params (group.id=d896c4db720e42d7b94bb4c1b6a189b9, role.id=83a7ac2bd20743b78fe0f4689037d83b, scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:38.168599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e10d2-5a7e-42bb-be23-f8913a75cfb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:38.170108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e10d2-5a7e-42bb-be23-f8913a75cfb8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:38.182184 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 197/380] 10.222.0.66 () {56 vars in 1376 bytes} [Fri Jul 15 20:23:38 2022] GET /identity/v3/role_assignments?group.id=d896c4db720e42d7b94bb4c1b6a189b9&scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6&role.id=83a7ac2bd20743b78fe0f4689037d83b => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:38.182868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e10d2-5a7e-42bb-be23-f8913a75cfb8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:38.204733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a915533-5531-4419-a6cd-e026adae032c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:38.236642 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:38.289811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e19bf-f29e-4cbb-9685-a3dddbc150a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:38.290555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e19bf-f29e-4cbb-9685-a3dddbc150a4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:38.290848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e19bf-f29e-4cbb-9685-a3dddbc150a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:38.291132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e19bf-f29e-4cbb-9685-a3dddbc150a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:38.291904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e19bf-f29e-4cbb-9685-a3dddbc150a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:38.292216 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e19bf-f29e-4cbb-9685-a3dddbc150a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:38.293669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e19bf-f29e-4cbb-9685-a3dddbc150a4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:38.318800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 184/381] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:38.324770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e19bf-f29e-4cbb-9685-a3dddbc150a4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:38.324924 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:38.332184 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e10d2-5a7e-42bb-be23-f8913a75cfb8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:38.377712 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1e007-7f63-481f-a935-745d605ed044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:38.378686 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1e007-7f63-481f-a935-745d605ed044 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:38.379047 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1e007-7f63-481f-a935-745d605ed044 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:38.379421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1e007-7f63-481f-a935-745d605ed044 None admin] PATH_INFO: `/v3/projects/090394e10e7f467d9c567173bebe0143` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:38.380743 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1e007-7f63-481f-a935-745d605ed044 None admin] RBAC: Authorizing `identity:get_project(project_id=090394e10e7f467d9c567173bebe0143)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:38.383031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1e007-7f63-481f-a935-745d605ed044 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:38.385194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 198/382] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:38 2022] GET /identity/v3/projects/090394e10e7f467d9c567173bebe0143 => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:38.390330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1e007-7f63-481f-a935-745d605ed044 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:38.467907 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e19bf-f29e-4cbb-9685-a3dddbc150a4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:38.516429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7c6c7-1c8c-48b4-9ecf-c4eb6cf36a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:38.518231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7c6c7-1c8c-48b4-9ecf-c4eb6cf36a87 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:38.518998 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7c6c7-1c8c-48b4-9ecf-c4eb6cf36a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:38.519561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7c6c7-1c8c-48b4-9ecf-c4eb6cf36a87 None admin] PATH_INFO: `/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:38.521032 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7c6c7-1c8c-48b4-9ecf-c4eb6cf36a87 None admin] RBAC: Authorizing `identity:get_group(group_id=d896c4db720e42d7b94bb4c1b6a189b9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:38.523882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7c6c7-1c8c-48b4-9ecf-c4eb6cf36a87 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:38.526348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 185/383] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:38 2022] GET /identity/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:38.532517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7c6c7-1c8c-48b4-9ecf-c4eb6cf36a87 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:38.549100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1e007-7f63-481f-a935-745d605ed044 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:38.620235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8ce9f-ec9b-487c-87fb-6bb0e364ac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:38.620944 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8ce9f-ec9b-487c-87fb-6bb0e364ac49 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:38.621227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8ce9f-ec9b-487c-87fb-6bb0e364ac49 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:38.621506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8ce9f-ec9b-487c-87fb-6bb0e364ac49 None admin] PATH_INFO: `/v3/groups/001a6e1ac0524ebd99d0ee2b28151eb3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:38.626608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8ce9f-ec9b-487c-87fb-6bb0e364ac49 None admin] RBAC: Authorizing `identity:get_group(group_id=001a6e1ac0524ebd99d0ee2b28151eb3)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:38.628057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8ce9f-ec9b-487c-87fb-6bb0e364ac49 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:38.630071 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 199/384] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:38 2022] GET /identity/v3/groups/001a6e1ac0524ebd99d0ee2b28151eb3 => generated 229 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:38.635857 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:38.636427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8ce9f-ec9b-487c-87fb-6bb0e364ac49 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:38.653434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:38.701380 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7c6c7-1c8c-48b4-9ecf-c4eb6cf36a87 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:38.744648 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdc0fe-de82-4cf4-b45d-4b7791ee56b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:38.745988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdc0fe-de82-4cf4-b45d-4b7791ee56b0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:38.746506 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdc0fe-de82-4cf4-b45d-4b7791ee56b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:38.746988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdc0fe-de82-4cf4-b45d-4b7791ee56b0 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:38.748470 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdc0fe-de82-4cf4-b45d-4b7791ee56b0 None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:38.750151 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdc0fe-de82-4cf4-b45d-4b7791ee56b0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:38.752451 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 186/385] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:38 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:38.761965 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdc0fe-de82-4cf4-b45d-4b7791ee56b0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:38.765810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8ce9f-ec9b-487c-87fb-6bb0e364ac49 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:38.870814 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdc0fe-de82-4cf4-b45d-4b7791ee56b0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:38.905301 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fa4cb-8d64-4af0-a831-15274dd717a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:38.905987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:38.906092 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fa4cb-8d64-4af0-a831-15274dd717a2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:38.906273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fa4cb-8d64-4af0-a831-15274dd717a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:38.906552 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fa4cb-8d64-4af0-a831-15274dd717a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:38.907400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fa4cb-8d64-4af0-a831-15274dd717a2 None admin] RBAC: Adding query filter params (group.id=001a6e1ac0524ebd99d0ee2b28151eb3, role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=090394e10e7f467d9c567173bebe0143) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:38.907731 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fa4cb-8d64-4af0-a831-15274dd717a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:38.909269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fa4cb-8d64-4af0-a831-15274dd717a2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:38.917265 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82c760-6d5b-4a4f-9b43-0500bc2dcdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:38.918397 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82c760-6d5b-4a4f-9b43-0500bc2dcdaa None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:38.918878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82c760-6d5b-4a4f-9b43-0500bc2dcdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:38.919337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82c760-6d5b-4a4f-9b43-0500bc2dcdaa None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e/groups/d896c4db720e42d7b94bb4c1b6a189b9/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:38.922230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82c760-6d5b-4a4f-9b43-0500bc2dcdaa None admin] RBAC: Authorizing `identity:create_grant(project_id=1658f1fcd1984324979b5dde1834d62e, group_id=d896c4db720e42d7b94bb4c1b6a189b9, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:38.922688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 200/386] 10.222.0.66 () {56 vars in 1376 bytes} [Fri Jul 15 20:23:38 2022] GET /identity/v3/role_assignments?group.id=001a6e1ac0524ebd99d0ee2b28151eb3&scope.project.id=090394e10e7f467d9c567173bebe0143&role.id=43e0afe364894278be44a97662ca6f8e => generated 260 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:38.924367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82c760-6d5b-4a4f-9b43-0500bc2dcdaa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:38.941152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 187/387] 10.222.0.66 () {58 vars in 1442 bytes} [Fri Jul 15 20:23:38 2022] PUT /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e/groups/d896c4db720e42d7b94bb4c1b6a189b9/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:23:39.692474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159ffc2-44ae-4901-bb41-24d247eb06bd None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:39.694012 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159ffc2-44ae-4901-bb41-24d247eb06bd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:39.694748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159ffc2-44ae-4901-bb41-24d247eb06bd None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:39.696808 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 201/388] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:39.701897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a393ef-c221-466b-837d-bca869299e6e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:39.702726 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a393ef-c221-466b-837d-bca869299e6e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:39.703223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a393ef-c221-466b-837d-bca869299e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:39.726229 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-64a393ef-c221-466b-837d-bca869299e6e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:39.727710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-64a393ef-c221-466b-837d-bca869299e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:39.832177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 188/389] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:39.863641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159ffc2-44ae-4901-bb41-24d247eb06bd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:39.959346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:39.962849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678fc82-c75f-417e-a41e-93424ff7d405 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:39.963137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678fc82-c75f-417e-a41e-93424ff7d405 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:39.963456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678fc82-c75f-417e-a41e-93424ff7d405 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:39.965068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 189/390] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:23:39.970567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1d77c-1c19-4b2e-ba43-6f899f445f2e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:39.971129 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1d77c-1c19-4b2e-ba43-6f899f445f2e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:39.971647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1d77c-1c19-4b2e-ba43-6f899f445f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:39.989294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159ffc2-44ae-4901-bb41-24d247eb06bd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:39.989915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b6e1d77c-1c19-4b2e-ba43-6f899f445f2e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:39.991928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b6e1d77c-1c19-4b2e-ba43-6f899f445f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:40.034678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a882308-baee-45a7-9856-bdca9883091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:40.035499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a882308-baee-45a7-9856-bdca9883091d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:40.035784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a882308-baee-45a7-9856-bdca9883091d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:40.036059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a882308-baee-45a7-9856-bdca9883091d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:40.050748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a882308-baee-45a7-9856-bdca9883091d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-5a882308-baee-45a7-9856-bdca9883091d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:40.064689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:40.065737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:40.071625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:40.071625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:40.071625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:40.071625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:40.071625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:40.071625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:40.071625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:40.071625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:40.071625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:40.071625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:40.071625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:40.071625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:40.071625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 202/391] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:23:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:40.077325 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a882308-baee-45a7-9856-bdca9883091d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:40.080204 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 190/392] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:40.102683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1d77c-1c19-4b2e-ba43-6f899f445f2e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:40.194468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:40.223806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a882308-baee-45a7-9856-bdca9883091d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:40.281331 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22d222-ed56-4bb2-a95b-8b9dfc453444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:40.282012 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22d222-ed56-4bb2-a95b-8b9dfc453444 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:40.282306 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22d222-ed56-4bb2-a95b-8b9dfc453444 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:40.282588 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22d222-ed56-4bb2-a95b-8b9dfc453444 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:40.283410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22d222-ed56-4bb2-a95b-8b9dfc453444 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:40.283725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22d222-ed56-4bb2-a95b-8b9dfc453444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:40.285146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22d222-ed56-4bb2-a95b-8b9dfc453444 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:40.292085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:40.296183 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1d77c-1c19-4b2e-ba43-6f899f445f2e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:40.304415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 203/393] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:40.321413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22d222-ed56-4bb2-a95b-8b9dfc453444 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:40.337181 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fd5f7-39f8-4ae0-a096-9527f91d2fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:40.338295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd5f7-39f8-4ae0-a096-9527f91d2fbb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:40.338757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd5f7-39f8-4ae0-a096-9527f91d2fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:40.339199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd5f7-39f8-4ae0-a096-9527f91d2fbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:40.350472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fd5f7-39f8-4ae0-a096-9527f91d2fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ac5fd5f7-39f8-4ae0-a096-9527f91d2fbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:40.359373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:40.360224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:40.361045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:40.361045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:40.361045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:40.361045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:40.361045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:40.361045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:40.361045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:40.361045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:40.361045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:40.361045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:40.361045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:40.361045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:40.368120 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 191/394] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:23:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:40.369455 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fd5f7-39f8-4ae0-a096-9527f91d2fbb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:40.492902 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fd5f7-39f8-4ae0-a096-9527f91d2fbb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:40.495056 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:40.533277 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3011a-37cd-4b81-9703-156c8f6ee27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:40.533873 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3011a-37cd-4b81-9703-156c8f6ee27b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:40.534169 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3011a-37cd-4b81-9703-156c8f6ee27b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:40.534450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3011a-37cd-4b81-9703-156c8f6ee27b None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:40.535315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3011a-37cd-4b81-9703-156c8f6ee27b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:40.535631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3011a-37cd-4b81-9703-156c8f6ee27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:40.537069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3011a-37cd-4b81-9703-156c8f6ee27b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:40.546958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 192/395] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:40.557399 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3011a-37cd-4b81-9703-156c8f6ee27b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:40.581710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22d222-ed56-4bb2-a95b-8b9dfc453444 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:40.619130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fd326-5b34-4025-9d54-fff2d6facc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:40.620001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fd326-5b34-4025-9d54-fff2d6facc63 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:40.620288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fd326-5b34-4025-9d54-fff2d6facc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:40.620614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fd326-5b34-4025-9d54-fff2d6facc63 None admin] PATH_INFO: `/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:40.621817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fd326-5b34-4025-9d54-fff2d6facc63 None admin] RBAC: Authorizing `identity:get_group(group_id=d896c4db720e42d7b94bb4c1b6a189b9)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:40.623703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fd326-5b34-4025-9d54-fff2d6facc63 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:40.626329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 204/396] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:40 2022] GET /identity/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9 => generated 226 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:40.627851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac7cd8-a97e-4fe6-a0ce-0ce2f4108791 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:40.628141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac7cd8-a97e-4fe6-a0ce-0ce2f4108791 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:40.628469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac7cd8-a97e-4fe6-a0ce-0ce2f4108791 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:40.630619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 205/397] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:40.633039 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac7cd8-a97e-4fe6-a0ce-0ce2f4108791 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:40.708868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3011a-37cd-4b81-9703-156c8f6ee27b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:40.724730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:40.751463 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f777a3-2516-4d15-b04d-ad3fc566e9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:40.752362 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f777a3-2516-4d15-b04d-ad3fc566e9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:40.752830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f777a3-2516-4d15-b04d-ad3fc566e9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:40.753252 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f777a3-2516-4d15-b04d-ad3fc566e9a7 None admin] PATH_INFO: `/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:40.754604 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f777a3-2516-4d15-b04d-ad3fc566e9a7 None admin] RBAC: Authorizing `identity:get_group(group_id=d896c4db720e42d7b94bb4c1b6a189b9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:40.756474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f777a3-2516-4d15-b04d-ad3fc566e9a7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:40.758284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 193/398] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:40 2022] GET /identity/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:40.759599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34631-402a-42e0-b25d-635b8f1e5470 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:40.760101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34631-402a-42e0-b25d-635b8f1e5470 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:40.760610 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34631-402a-42e0-b25d-635b8f1e5470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:40.765606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac7cd8-a97e-4fe6-a0ce-0ce2f4108791 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:40.778170 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-81e34631-402a-42e0-b25d-635b8f1e5470 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:40.779631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-81e34631-402a-42e0-b25d-635b8f1e5470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:40.803969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f4a01-af56-41e5-a019-d88e01d13fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:40.804992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f4a01-af56-41e5-a019-d88e01d13fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:40.805495 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:40.806585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f4a01-af56-41e5-a019-d88e01d13fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:40.807020 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f4a01-af56-41e5-a019-d88e01d13fe4 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:40.808594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f4a01-af56-41e5-a019-d88e01d13fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:40.810251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f4a01-af56-41e5-a019-d88e01d13fe4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:40.813859 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 206/399] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:40 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:40.814831 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f4a01-af56-41e5-a019-d88e01d13fe4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:40.853388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 194/400] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:40.854563 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e34631-402a-42e0-b25d-635b8f1e5470 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:40.948119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f4a01-af56-41e5-a019-d88e01d13fe4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:40.962220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e34631-402a-42e0-b25d-635b8f1e5470 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:40.987437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4e2da-6e9d-49fe-af36-045d6af17a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:40.988377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4e2da-6e9d-49fe-af36-045d6af17a01 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:40.988614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4e2da-6e9d-49fe-af36-045d6af17a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:40.988892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4e2da-6e9d-49fe-af36-045d6af17a01 None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:40.990198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4e2da-6e9d-49fe-af36-045d6af17a01 None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:40.992164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4e2da-6e9d-49fe-af36-045d6af17a01 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:40.994250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 207/401] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:40 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:40.995189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4e2da-6e9d-49fe-af36-045d6af17a01 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:40.999018 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:41.001234 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e9b41-5a83-4f60-9c8c-6ad2bb4e24b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:41.002496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e9b41-5a83-4f60-9c8c-6ad2bb4e24b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:41.003015 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e9b41-5a83-4f60-9c8c-6ad2bb4e24b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:41.003704 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e9b41-5a83-4f60-9c8c-6ad2bb4e24b2 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e/groups/d896c4db720e42d7b94bb4c1b6a189b9/roles/e97c8dedb3a147c6ab5d98229f5a000c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:41.007000 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e9b41-5a83-4f60-9c8c-6ad2bb4e24b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1658f1fcd1984324979b5dde1834d62e, group_id=d896c4db720e42d7b94bb4c1b6a189b9, role_id=e97c8dedb3a147c6ab5d98229f5a000c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:41.009265 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e9b41-5a83-4f60-9c8c-6ad2bb4e24b2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:41.026461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 195/402] 10.222.0.66 () {58 vars in 1442 bytes} [Fri Jul 15 20:23:40 2022] PUT /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e/groups/d896c4db720e42d7b94bb4c1b6a189b9/roles/e97c8dedb3a147c6ab5d98229f5a000c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:23:41.028338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e9b41-5a83-4f60-9c8c-6ad2bb4e24b2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:41.060959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:41.135114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4e2da-6e9d-49fe-af36-045d6af17a01 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:41.161849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e9b41-5a83-4f60-9c8c-6ad2bb4e24b2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:41.222251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4186b-a7b7-42b1-ae81-f9f19d423c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:41.223203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4186b-a7b7-42b1-ae81-f9f19d423c10 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:41.223500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4186b-a7b7-42b1-ae81-f9f19d423c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:41.223783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4186b-a7b7-42b1-ae81-f9f19d423c10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:41.233937 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9d2d8-f39c-4d96-9a79-0aa0fdd099b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:41.234984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9d2d8-f39c-4d96-9a79-0aa0fdd099b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:41.235271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9d2d8-f39c-4d96-9a79-0aa0fdd099b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:41.235550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9d2d8-f39c-4d96-9a79-0aa0fdd099b7 None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6/groups/d896c4db720e42d7b94bb4c1b6a189b9/roles/e97c8dedb3a147c6ab5d98229f5a000c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:41.241553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9d2d8-f39c-4d96-9a79-0aa0fdd099b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6062fb0a5e0f441192aaef82d7fd14e6, group_id=d896c4db720e42d7b94bb4c1b6a189b9, role_id=e97c8dedb3a147c6ab5d98229f5a000c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:41.245837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9d2d8-f39c-4d96-9a79-0aa0fdd099b7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:41.254792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4186b-a7b7-42b1-ae81-f9f19d423c10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-77f4186b-a7b7-42b1-ae81-f9f19d423c10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:41.264338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:41.266648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:41.271371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:41.271371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:41.271371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:41.271371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:41.271371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:41.271371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:41.271371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:41.271371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:41.271371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:41.271371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:41.271371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:41.271371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:41.271371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 208/403] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:41.274664 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4186b-a7b7-42b1-ae81-f9f19d423c10 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:41.279500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 196/404] 10.222.0.66 () {58 vars in 1442 bytes} [Fri Jul 15 20:23:41 2022] PUT /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6/groups/d896c4db720e42d7b94bb4c1b6a189b9/roles/e97c8dedb3a147c6ab5d98229f5a000c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:23:41.370195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:41.422993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4186b-a7b7-42b1-ae81-f9f19d423c10 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:41.440152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f3c7-c92d-4760-985b-6bb84ae16e75 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:41.440505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f3c7-c92d-4760-985b-6bb84ae16e75 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:41.444421 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f3c7-c92d-4760-985b-6bb84ae16e75 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:41.444421 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 197/405] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:23:41.461732 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f10927-1b67-4962-b05b-72265c5d53bf None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:41.461732 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f10927-1b67-4962-b05b-72265c5d53bf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:41.462068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f10927-1b67-4962-b05b-72265c5d53bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:41.494777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c0f10927-1b67-4962-b05b-72265c5d53bf None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:41.496048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c0f10927-1b67-4962-b05b-72265c5d53bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:41.520919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afea78f-4e96-4925-9ea1-cdc4084fd973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:41.521789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afea78f-4e96-4925-9ea1-cdc4084fd973 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:41.522919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afea78f-4e96-4925-9ea1-cdc4084fd973 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:41.523215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afea78f-4e96-4925-9ea1-cdc4084fd973 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:41.524011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afea78f-4e96-4925-9ea1-cdc4084fd973 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:41.524011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afea78f-4e96-4925-9ea1-cdc4084fd973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:41.525802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afea78f-4e96-4925-9ea1-cdc4084fd973 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:41.540970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 209/406] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:41.547126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afea78f-4e96-4925-9ea1-cdc4084fd973 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:41.628416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 198/407] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:41.660543 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f10927-1b67-4962-b05b-72265c5d53bf None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:41.675923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:41.723259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afea78f-4e96-4925-9ea1-cdc4084fd973 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:41.752770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:41.772494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172acc8-e05e-4aee-8953-d55064d48860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:41.773579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172acc8-e05e-4aee-8953-d55064d48860 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:41.773866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172acc8-e05e-4aee-8953-d55064d48860 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:41.774144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172acc8-e05e-4aee-8953-d55064d48860 None admin] PATH_INFO: `/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:41.777313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172acc8-e05e-4aee-8953-d55064d48860 None admin] RBAC: Authorizing `identity:get_group(group_id=d896c4db720e42d7b94bb4c1b6a189b9)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:41.778777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172acc8-e05e-4aee-8953-d55064d48860 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:41.781793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 210/408] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:41 2022] GET /identity/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:41.789730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172acc8-e05e-4aee-8953-d55064d48860 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:41.901172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f10927-1b67-4962-b05b-72265c5d53bf None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:41.976617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172acc8-e05e-4aee-8953-d55064d48860 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:41.977213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cae92-bdd1-45d3-868c-86a24e38ef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:41.978273 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cae92-bdd1-45d3-868c-86a24e38ef4b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:41.979128 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cae92-bdd1-45d3-868c-86a24e38ef4b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:41.979924 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cae92-bdd1-45d3-868c-86a24e38ef4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:41.993930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cae92-bdd1-45d3-868c-86a24e38ef4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-971cae92-bdd1-45d3-868c-86a24e38ef4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:42.006868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:42.007828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:42.009135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:42.009135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:42.009135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:42.009135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:42.009135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:42.009135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:42.009135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:42.009135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:42.009135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:42.009135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:42.009135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:42.009135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:42.012237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 199/409] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:23:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:23:42.015050 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f435f-47da-4362-aa7d-f42a3b0cf7e3 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:42.015859 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f435f-47da-4362-aa7d-f42a3b0cf7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:42.016372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f435f-47da-4362-aa7d-f42a3b0cf7e3 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:42.018012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 200/410] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:42.023070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f435f-47da-4362-aa7d-f42a3b0cf7e3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:42.029416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce75c5f-6ff3-477f-bf50-d6e51a81d8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:42.030896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75c5f-6ff3-477f-bf50-d6e51a81d8cf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:42.031346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75c5f-6ff3-477f-bf50-d6e51a81d8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:42.031626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75c5f-6ff3-477f-bf50-d6e51a81d8cf None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:42.033877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce75c5f-6ff3-477f-bf50-d6e51a81d8cf None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:42.041960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce75c5f-6ff3-477f-bf50-d6e51a81d8cf None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:42.048447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 211/411] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:41 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:42.049773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3587-bae3-4229-9c22-4dab647b59d3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:42.050109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3587-bae3-4229-9c22-4dab647b59d3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:42.050391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3587-bae3-4229-9c22-4dab647b59d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:42.098598 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e1ef3587-bae3-4229-9c22-4dab647b59d3 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:42.100911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e1ef3587-bae3-4229-9c22-4dab647b59d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:42.146184 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:42.180487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:42.202765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 212/412] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:42.203999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef3587-bae3-4229-9c22-4dab647b59d3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:42.205892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f435f-47da-4362-aa7d-f42a3b0cf7e3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:42.283824 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7749db-d00c-4cfa-8b49-6eff6f88b043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:42.284529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7749db-d00c-4cfa-8b49-6eff6f88b043 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:42.284820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7749db-d00c-4cfa-8b49-6eff6f88b043 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:42.285104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7749db-d00c-4cfa-8b49-6eff6f88b043 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:42.285864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7749db-d00c-4cfa-8b49-6eff6f88b043 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:42.286182 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7749db-d00c-4cfa-8b49-6eff6f88b043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:42.288098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7749db-d00c-4cfa-8b49-6eff6f88b043 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:42.315677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 201/413] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:42.315677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7749db-d00c-4cfa-8b49-6eff6f88b043 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:42.321535 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef3587-bae3-4229-9c22-4dab647b59d3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:42.371279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6e7ea-979d-46bb-b856-bae3aba879f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:42.373482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e7ea-979d-46bb-b856-bae3aba879f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:42.373780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e7ea-979d-46bb-b856-bae3aba879f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:42.374062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e7ea-979d-46bb-b856-bae3aba879f7 None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6/groups/d896c4db720e42d7b94bb4c1b6a189b9/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:42.378987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6e7ea-979d-46bb-b856-bae3aba879f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6062fb0a5e0f441192aaef82d7fd14e6, group_id=d896c4db720e42d7b94bb4c1b6a189b9, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:42.380464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6e7ea-979d-46bb-b856-bae3aba879f7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:42.408761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 213/414] 10.222.0.66 () {58 vars in 1442 bytes} [Fri Jul 15 20:23:42 2022] PUT /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6/groups/d896c4db720e42d7b94bb4c1b6a189b9/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:23:42.417067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6e7ea-979d-46bb-b856-bae3aba879f7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:42.580519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:42.581964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7749db-d00c-4cfa-8b49-6eff6f88b043 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:42.636765 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:42.641661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e78877-637b-4f89-82c8-2ea7f9cf9a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:42.642845 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e78877-637b-4f89-82c8-2ea7f9cf9a60 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:42.642956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e78877-637b-4f89-82c8-2ea7f9cf9a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:42.643227 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e78877-637b-4f89-82c8-2ea7f9cf9a60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:42.657956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e78877-637b-4f89-82c8-2ea7f9cf9a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-11e78877-637b-4f89-82c8-2ea7f9cf9a60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:42.667340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:42.668298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:42.669191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:42.669191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:42.669191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:42.669191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:42.669191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:42.669191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:42.669191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:42.669191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:42.669191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:42.669191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:42.669191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:42.669191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:42.669191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 202/415] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:42.671941 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6e7ea-979d-46bb-b856-bae3aba879f7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:42.674686 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e78877-637b-4f89-82c8-2ea7f9cf9a60 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:42.710585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b86c0-fee5-429b-929e-fac3ba94020f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:42.711801 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b86c0-fee5-429b-929e-fac3ba94020f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:42.712305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b86c0-fee5-429b-929e-fac3ba94020f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:42.712816 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b86c0-fee5-429b-929e-fac3ba94020f None admin] PATH_INFO: `/v3/groups/001a6e1ac0524ebd99d0ee2b28151eb3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:42.714205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b86c0-fee5-429b-929e-fac3ba94020f None admin] RBAC: Authorizing `identity:get_group(group_id=001a6e1ac0524ebd99d0ee2b28151eb3)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:42.715973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b86c0-fee5-429b-929e-fac3ba94020f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:42.720009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 214/416] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:42 2022] GET /identity/v3/groups/001a6e1ac0524ebd99d0ee2b28151eb3 => generated 229 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:42.726647 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b86c0-fee5-429b-929e-fac3ba94020f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:42.791061 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e78877-637b-4f89-82c8-2ea7f9cf9a60 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:42.830074 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a770ff-debf-460d-9749-11295848bd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:42.830570 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a770ff-debf-460d-9749-11295848bd02 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:42.830777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a770ff-debf-460d-9749-11295848bd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:42.831059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a770ff-debf-460d-9749-11295848bd02 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:42.831694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a770ff-debf-460d-9749-11295848bd02 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:42.832005 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a770ff-debf-460d-9749-11295848bd02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:42.833437 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a770ff-debf-460d-9749-11295848bd02 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:42.843098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 203/417] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:42.850661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a770ff-debf-460d-9749-11295848bd02 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:42.857622 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b86c0-fee5-429b-929e-fac3ba94020f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:42.883452 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:42.908046 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d5c85-b718-4e06-8da1-0f2b4f7d1e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:42.909332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5c85-b718-4e06-8da1-0f2b4f7d1e23 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:42.909856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5c85-b718-4e06-8da1-0f2b4f7d1e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:42.910332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5c85-b718-4e06-8da1-0f2b4f7d1e23 None admin] PATH_INFO: `/v3/projects/090394e10e7f467d9c567173bebe0143` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:42.911833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d5c85-b718-4e06-8da1-0f2b4f7d1e23 None admin] RBAC: Authorizing `identity:get_project(project_id=090394e10e7f467d9c567173bebe0143)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:42.914243 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d5c85-b718-4e06-8da1-0f2b4f7d1e23 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:42.921270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 215/418] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:42 2022] GET /identity/v3/projects/090394e10e7f467d9c567173bebe0143 => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:42.922494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d5c85-b718-4e06-8da1-0f2b4f7d1e23 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:42.929026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:43.002007 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a770ff-debf-460d-9749-11295848bd02 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:43.084972 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d5c85-b718-4e06-8da1-0f2b4f7d1e23 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:43.091904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e173a-c212-4933-a6f4-cb80a1a3dc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:43.092654 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e173a-c212-4933-a6f4-cb80a1a3dc52 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:43.092940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e173a-c212-4933-a6f4-cb80a1a3dc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:43.093219 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e173a-c212-4933-a6f4-cb80a1a3dc52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:43.136505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bf6c3-7e31-4be8-a747-024b71e9a526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:43.137973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bf6c3-7e31-4be8-a747-024b71e9a526 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:43.138487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bf6c3-7e31-4be8-a747-024b71e9a526 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:43.138967 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bf6c3-7e31-4be8-a747-024b71e9a526 None admin] PATH_INFO: `/v3/projects/090394e10e7f467d9c567173bebe0143/groups/001a6e1ac0524ebd99d0ee2b28151eb3/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:43.141381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bf6c3-7e31-4be8-a747-024b71e9a526 None admin] RBAC: Authorizing `identity:create_grant(project_id=090394e10e7f467d9c567173bebe0143, group_id=001a6e1ac0524ebd99d0ee2b28151eb3, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:43.143127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bf6c3-7e31-4be8-a747-024b71e9a526 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:43.175962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 216/419] 10.222.0.66 () {58 vars in 1442 bytes} [Fri Jul 15 20:23:42 2022] PUT /identity/v3/projects/090394e10e7f467d9c567173bebe0143/groups/001a6e1ac0524ebd99d0ee2b28151eb3/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:23:43.188622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e173a-c212-4933-a6f4-cb80a1a3dc52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:43.190139 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e173a-c212-4933-a6f4-cb80a1a3dc52 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:43.252785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:43.309919 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 204/420] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:43.315224 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bf6c3-7e31-4be8-a747-024b71e9a526 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:43.403620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:43.482540 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bf6c3-7e31-4be8-a747-024b71e9a526 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:43.525559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a476b5-e7da-43a1-ab25-4eeb3c97a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:43.526784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a476b5-e7da-43a1-ab25-4eeb3c97a292 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:43.527283 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a476b5-e7da-43a1-ab25-4eeb3c97a292 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:43.527758 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a476b5-e7da-43a1-ab25-4eeb3c97a292 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:43.529206 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a476b5-e7da-43a1-ab25-4eeb3c97a292 None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:43.530873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a476b5-e7da-43a1-ab25-4eeb3c97a292 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:43.532833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 217/421] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:43 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:43.539208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e173a-c212-4933-a6f4-cb80a1a3dc52 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:43.575815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa55331-3ac3-4601-8ea5-35a3c19f1ed0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:43.576458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa55331-3ac3-4601-8ea5-35a3c19f1ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:43.576975 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa55331-3ac3-4601-8ea5-35a3c19f1ed0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:43.578534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 218/422] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:43.585616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57b599-83cc-423c-99d3-e53e660099f7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:43.586165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57b599-83cc-423c-99d3-e53e660099f7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:43.586646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57b599-83cc-423c-99d3-e53e660099f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:43.603697 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9a57b599-83cc-423c-99d3-e53e660099f7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:43.605267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9a57b599-83cc-423c-99d3-e53e660099f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:43.704792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 219/423] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:43.721975 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e173a-c212-4933-a6f4-cb80a1a3dc52 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:43.738633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57b599-83cc-423c-99d3-e53e660099f7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:43.780257 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39016e0-16d5-4cd7-a46f-73c10cfe1d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:43.781069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39016e0-16d5-4cd7-a46f-73c10cfe1d64 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:43.781358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39016e0-16d5-4cd7-a46f-73c10cfe1d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:43.781631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39016e0-16d5-4cd7-a46f-73c10cfe1d64 None admin] PATH_INFO: `/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:43.782905 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39016e0-16d5-4cd7-a46f-73c10cfe1d64 None admin] RBAC: Authorizing `identity:get_group(group_id=d896c4db720e42d7b94bb4c1b6a189b9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:43.784482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39016e0-16d5-4cd7-a46f-73c10cfe1d64 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:43.786401 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 205/424] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:43 2022] GET /identity/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:43.788474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f25965-c3f3-4eae-913e-da00e4b7edc7 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:43.788875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f25965-c3f3-4eae-913e-da00e4b7edc7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:43.789284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f25965-c3f3-4eae-913e-da00e4b7edc7 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:43.794812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 206/425] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:43.795610 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f25965-c3f3-4eae-913e-da00e4b7edc7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:43.803761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:43.822609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:43.880653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57b599-83cc-423c-99d3-e53e660099f7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:43.913247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f25965-c3f3-4eae-913e-da00e4b7edc7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:43.918804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac8e08-4931-44d0-8c6f-ccbaa606d7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:43.919628 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac8e08-4931-44d0-8c6f-ccbaa606d7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:43.919912 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac8e08-4931-44d0-8c6f-ccbaa606d7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:43.920190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac8e08-4931-44d0-8c6f-ccbaa606d7a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:43.931479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac8e08-4931-44d0-8c6f-ccbaa606d7a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-8dac8e08-4931-44d0-8c6f-ccbaa606d7a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:43.939672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:43.940594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:43.941381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:43.941381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:43.941381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:43.941381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:43.941381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:43.941381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:43.941381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:43.941381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:43.941381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:43.941381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:43.941381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:43.941381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:43.945940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 220/426] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:23:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:23:43.947391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fc323-a3cc-4fcb-a323-c837484dd979 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:43.947600 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fc323-a3cc-4fcb-a323-c837484dd979 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:43.947871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fc323-a3cc-4fcb-a323-c837484dd979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:43.956874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d3ebc-b62c-4737-ae4d-77d22720ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:43.958218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3ebc-b62c-4737-ae4d-77d22720ac21 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:43.958717 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3ebc-b62c-4737-ae4d-77d22720ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:43.959868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3ebc-b62c-4737-ae4d-77d22720ac21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:43.961409 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d3ebc-b62c-4737-ae4d-77d22720ac21 None admin] RBAC: Adding query filter params (group.id=d896c4db720e42d7b94bb4c1b6a189b9, role.id=83a7ac2bd20743b78fe0f4689037d83b, scope.project.id=1658f1fcd1984324979b5dde1834d62e) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:43.961987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d3ebc-b62c-4737-ae4d-77d22720ac21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:43.963711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d3ebc-b62c-4737-ae4d-77d22720ac21 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:43.965638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b07fc323-a3cc-4fcb-a323-c837484dd979 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:43.966873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b07fc323-a3cc-4fcb-a323-c837484dd979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:43.971931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 207/427] 10.222.0.66 () {56 vars in 1376 bytes} [Fri Jul 15 20:23:43 2022] GET /identity/v3/role_assignments?group.id=d896c4db720e42d7b94bb4c1b6a189b9&scope.project.id=1658f1fcd1984324979b5dde1834d62e&role.id=83a7ac2bd20743b78fe0f4689037d83b => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:43.973156 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d3ebc-b62c-4737-ae4d-77d22720ac21 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:44.079153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 221/428] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:44.111369 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:44.121581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fc323-a3cc-4fcb-a323-c837484dd979 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:44.129855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d3ebc-b62c-4737-ae4d-77d22720ac21 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:44.174187 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad5066-2be4-4e41-96f2-5b0f88b4b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:44.175264 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad5066-2be4-4e41-96f2-5b0f88b4b641 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:44.175731 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad5066-2be4-4e41-96f2-5b0f88b4b641 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:44.176180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad5066-2be4-4e41-96f2-5b0f88b4b641 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:44.177137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad5066-2be4-4e41-96f2-5b0f88b4b641 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:44.177625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad5066-2be4-4e41-96f2-5b0f88b4b641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:44.179910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad5066-2be4-4e41-96f2-5b0f88b4b641 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:44.188419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:44.199584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 208/429] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:44.205747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad5066-2be4-4e41-96f2-5b0f88b4b641 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:44.270053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fc323-a3cc-4fcb-a323-c837484dd979 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:44.327387 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f61594-44dd-4fcc-a468-4ba4cb9c247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:44.328617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f61594-44dd-4fcc-a468-4ba4cb9c247b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:44.329103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f61594-44dd-4fcc-a468-4ba4cb9c247b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:44.329640 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f61594-44dd-4fcc-a468-4ba4cb9c247b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:44.344702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f61594-44dd-4fcc-a468-4ba4cb9c247b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:44.346349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad5066-2be4-4e41-96f2-5b0f88b4b641 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-22f61594-44dd-4fcc-a468-4ba4cb9c247b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:44.355305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:44.356191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:44.357467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:44.357467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:44.357467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:44.357467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:44.357467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:44.357467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:44.357467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:44.357467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:44.357467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:44.357467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:44.357467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:44.357467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:44.359723 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 222/430] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:23:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:44.367253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f61594-44dd-4fcc-a468-4ba4cb9c247b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:44.393753 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f55fc-d6a0-4e91-ad1e-9b2c89d3e03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:44.394418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f55fc-d6a0-4e91-ad1e-9b2c89d3e03d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:44.395113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f55fc-d6a0-4e91-ad1e-9b2c89d3e03d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:44.395398 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f55fc-d6a0-4e91-ad1e-9b2c89d3e03d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:44.423894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:44.498138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f55fc-d6a0-4e91-ad1e-9b2c89d3e03d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:44.499619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f55fc-d6a0-4e91-ad1e-9b2c89d3e03d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:44.512869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:44.524333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f61594-44dd-4fcc-a468-4ba4cb9c247b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:44.561722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914a10f-8a2c-46ce-afd0-47d3ad3220c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:44.562790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914a10f-8a2c-46ce-afd0-47d3ad3220c6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:44.563307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914a10f-8a2c-46ce-afd0-47d3ad3220c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:44.563787 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914a10f-8a2c-46ce-afd0-47d3ad3220c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:44.564995 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914a10f-8a2c-46ce-afd0-47d3ad3220c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:44.565512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914a10f-8a2c-46ce-afd0-47d3ad3220c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:44.567106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914a10f-8a2c-46ce-afd0-47d3ad3220c6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:44.577144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 223/431] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:44.585568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914a10f-8a2c-46ce-afd0-47d3ad3220c6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:44.619038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 209/432] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:23:44.625317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f55fc-d6a0-4e91-ad1e-9b2c89d3e03d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:44.681780 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:44.700454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914a10f-8a2c-46ce-afd0-47d3ad3220c6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:44.737305 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f55fc-d6a0-4e91-ad1e-9b2c89d3e03d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:44.739568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e762381-8af2-4b8b-b784-3dc823f44303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:44.740830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e762381-8af2-4b8b-b784-3dc823f44303 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:44.741491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e762381-8af2-4b8b-b784-3dc823f44303 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:44.741491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e762381-8af2-4b8b-b784-3dc823f44303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:44.771842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:44.776251 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9116aa-b7cf-4362-937c-a8256c126f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:44.777166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9116aa-b7cf-4362-937c-a8256c126f64 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:44.777447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9116aa-b7cf-4362-937c-a8256c126f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:44.777723 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9116aa-b7cf-4362-937c-a8256c126f64 None admin] PATH_INFO: `/v3/projects/1658f1fcd1984324979b5dde1834d62e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:44.778930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9116aa-b7cf-4362-937c-a8256c126f64 None admin] RBAC: Authorizing `identity:get_project(project_id=1658f1fcd1984324979b5dde1834d62e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:44.780376 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9116aa-b7cf-4362-937c-a8256c126f64 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:44.782382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 210/433] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:44 2022] GET /identity/v3/projects/1658f1fcd1984324979b5dde1834d62e => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:44.787737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9116aa-b7cf-4362-937c-a8256c126f64 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:44.817785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e762381-8af2-4b8b-b784-3dc823f44303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:44.819893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e762381-8af2-4b8b-b784-3dc823f44303 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:44.897814 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9116aa-b7cf-4362-937c-a8256c126f64 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:44.915786 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:44.934835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8adda-3131-48f9-8fe1-c5dcbec07c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:44.935704 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8adda-3131-48f9-8fe1-c5dcbec07c8e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:44.935996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8adda-3131-48f9-8fe1-c5dcbec07c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:44.936281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8adda-3131-48f9-8fe1-c5dcbec07c8e None admin] PATH_INFO: `/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:44.937508 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8adda-3131-48f9-8fe1-c5dcbec07c8e None admin] RBAC: Authorizing `identity:get_group(group_id=d896c4db720e42d7b94bb4c1b6a189b9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:44.937783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 224/434] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:44.939628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8adda-3131-48f9-8fe1-c5dcbec07c8e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:44.941798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 211/435] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:44 2022] GET /identity/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:44.947996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8adda-3131-48f9-8fe1-c5dcbec07c8e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:44.948142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e762381-8af2-4b8b-b784-3dc823f44303 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:45.033481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:45.072714 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8adda-3131-48f9-8fe1-c5dcbec07c8e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:45.079298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e762381-8af2-4b8b-b784-3dc823f44303 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:45.109699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b823148-9211-4a0e-858a-3d60089a34b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:45.110456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b823148-9211-4a0e-858a-3d60089a34b7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:45.110857 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b823148-9211-4a0e-858a-3d60089a34b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:45.111166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b823148-9211-4a0e-858a-3d60089a34b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:45.111995 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b823148-9211-4a0e-858a-3d60089a34b7 None admin] RBAC: Adding query filter params (group.id=d896c4db720e42d7b94bb4c1b6a189b9, role.id=e97c8dedb3a147c6ab5d98229f5a000c, scope.project.id=1658f1fcd1984324979b5dde1834d62e) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:45.112333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b823148-9211-4a0e-858a-3d60089a34b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:45.113805 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b823148-9211-4a0e-858a-3d60089a34b7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:45.116159 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203e5c4-3c39-4030-86d6-38f01fb48abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:45.117247 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203e5c4-3c39-4030-86d6-38f01fb48abf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:45.117729 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203e5c4-3c39-4030-86d6-38f01fb48abf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:45.118178 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203e5c4-3c39-4030-86d6-38f01fb48abf None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:45.119524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203e5c4-3c39-4030-86d6-38f01fb48abf None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:45.119714 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 212/436] 10.222.0.66 () {56 vars in 1376 bytes} [Fri Jul 15 20:23:44 2022] GET /identity/v3/role_assignments?group.id=d896c4db720e42d7b94bb4c1b6a189b9&scope.project.id=1658f1fcd1984324979b5dde1834d62e&role.id=e97c8dedb3a147c6ab5d98229f5a000c => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:45.121033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e0969-b628-4475-989d-cd04ff2393e8 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:45.121321 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e0969-b628-4475-989d-cd04ff2393e8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:45.121598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e0969-b628-4475-989d-cd04ff2393e8 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:45.121846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203e5c4-3c39-4030-86d6-38f01fb48abf None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:45.124010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 225/437] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:44 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:45.128560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 213/438] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:45.129746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22288429-7c7f-42f7-9d9c-30215fcc8fbe None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:45.129855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e0969-b628-4475-989d-cd04ff2393e8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:45.130336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22288429-7c7f-42f7-9d9c-30215fcc8fbe None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:45.131505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22288429-7c7f-42f7-9d9c-30215fcc8fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:45.149646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-22288429-7c7f-42f7-9d9c-30215fcc8fbe None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:45.151147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-22288429-7c7f-42f7-9d9c-30215fcc8fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:45.199662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:45.236427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 226/439] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:45.259109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22288429-7c7f-42f7-9d9c-30215fcc8fbe None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:45.275378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e0969-b628-4475-989d-cd04ff2393e8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:45.314141 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2e428-f437-4421-b288-636bdc8e2dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:45.315408 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2e428-f437-4421-b288-636bdc8e2dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:45.315702 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2e428-f437-4421-b288-636bdc8e2dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:45.315984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2e428-f437-4421-b288-636bdc8e2dd9 None admin] PATH_INFO: `/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:45.317425 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2e428-f437-4421-b288-636bdc8e2dd9 None admin] RBAC: Authorizing `identity:get_group(group_id=d896c4db720e42d7b94bb4c1b6a189b9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:45.319137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2e428-f437-4421-b288-636bdc8e2dd9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:45.321461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 214/440] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:45 2022] GET /identity/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:45.327713 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:45.330193 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2e428-f437-4421-b288-636bdc8e2dd9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:45.387239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22288429-7c7f-42f7-9d9c-30215fcc8fbe None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:45.429187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6e61f-a312-459a-bdfb-0ad9d2e99ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:45.430386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e61f-a312-459a-bdfb-0ad9d2e99ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:45.430868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e61f-a312-459a-bdfb-0ad9d2e99ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:45.431154 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e61f-a312-459a-bdfb-0ad9d2e99ff6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:45.447279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6e61f-a312-459a-bdfb-0ad9d2e99ff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-24b6e61f-a312-459a-bdfb-0ad9d2e99ff6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:45.455673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:45.456616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:45.457394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:45.457394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:45.457394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:45.457394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:45.457394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:45.457394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:45.457394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:45.457394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:45.457394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:45.457394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:45.457394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 20:23:45.457394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:45.459289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 227/441] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:45.466835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6e61f-a312-459a-bdfb-0ad9d2e99ff6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:45.484313 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2e428-f437-4421-b288-636bdc8e2dd9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:45.509346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:45.531102 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b773537-9792-42ef-bdb5-3dffa0087ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:45.532148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b773537-9792-42ef-bdb5-3dffa0087ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:45.532743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b773537-9792-42ef-bdb5-3dffa0087ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:45.533027 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b773537-9792-42ef-bdb5-3dffa0087ea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:45.534013 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b773537-9792-42ef-bdb5-3dffa0087ea4 None admin] RBAC: Adding query filter params (group.id=d896c4db720e42d7b94bb4c1b6a189b9, role.id=e97c8dedb3a147c6ab5d98229f5a000c, scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:45.534339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b773537-9792-42ef-bdb5-3dffa0087ea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:45.536828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b773537-9792-42ef-bdb5-3dffa0087ea4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:45.544773 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 215/442] 10.222.0.66 () {56 vars in 1376 bytes} [Fri Jul 15 20:23:45 2022] GET /identity/v3/role_assignments?group.id=d896c4db720e42d7b94bb4c1b6a189b9&scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6&role.id=e97c8dedb3a147c6ab5d98229f5a000c => generated 611 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:45.609472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6e61f-a312-459a-bdfb-0ad9d2e99ff6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:45.629926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:45.653089 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d492a-6d6a-4274-9e52-0ee9b8ade784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:45.654149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d492a-6d6a-4274-9e52-0ee9b8ade784 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:45.654575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d492a-6d6a-4274-9e52-0ee9b8ade784 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:45.655008 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d492a-6d6a-4274-9e52-0ee9b8ade784 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:45.655914 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d492a-6d6a-4274-9e52-0ee9b8ade784 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:45.656384 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d492a-6d6a-4274-9e52-0ee9b8ade784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:45.657974 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d492a-6d6a-4274-9e52-0ee9b8ade784 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:45.669545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 228/443] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:23:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:45.675247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b773537-9792-42ef-bdb5-3dffa0087ea4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:45.691032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00701a1d-c593-4ad5-a903-a10c8ef5216e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:45.691229 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00701a1d-c593-4ad5-a903-a10c8ef5216e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:45.691515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00701a1d-c593-4ad5-a903-a10c8ef5216e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:45.693785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 229/444] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:23:45.698857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360493b-c533-4ea4-a319-3c6ab49dd3b5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:45.699132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360493b-c533-4ea4-a319-3c6ab49dd3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:45.699412 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360493b-c533-4ea4-a319-3c6ab49dd3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:45.716520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c360493b-c533-4ea4-a319-3c6ab49dd3b5 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:45.717727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c360493b-c533-4ea4-a319-3c6ab49dd3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:45.791864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 230/445] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:45.801996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b773537-9792-42ef-bdb5-3dffa0087ea4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:45.814940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360493b-c533-4ea4-a319-3c6ab49dd3b5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:45.836494 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd972-56f6-4ebf-8106-d6ac056e9e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:45.837240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd972-56f6-4ebf-8106-d6ac056e9e1d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:45.837587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd972-56f6-4ebf-8106-d6ac056e9e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:45.837920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd972-56f6-4ebf-8106-d6ac056e9e1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:45.885967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:45.905276 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cd972-56f6-4ebf-8106-d6ac056e9e1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:45.906733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cd972-56f6-4ebf-8106-d6ac056e9e1d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:45.912841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360493b-c533-4ea4-a319-3c6ab49dd3b5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:45.923061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:45.948065 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268d202-2223-4695-97ba-cf90f26520f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:45.948809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268d202-2223-4695-97ba-cf90f26520f9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:45.949096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268d202-2223-4695-97ba-cf90f26520f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:45.949374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268d202-2223-4695-97ba-cf90f26520f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:45.960349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268d202-2223-4695-97ba-cf90f26520f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-4268d202-2223-4695-97ba-cf90f26520f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:45.967837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:45.968846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:45.969815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:45.969815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:45.969815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:45.969815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:45.969815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:45.969815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:45.969815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:45.969815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:45.969815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:45.969815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:45.969815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:23:45.969815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:45.969815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 231/446] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:23:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:23:45.975248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268d202-2223-4695-97ba-cf90f26520f9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:46.009318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 216/447] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:46.015070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd972-56f6-4ebf-8106-d6ac056e9e1d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:46.073618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268d202-2223-4695-97ba-cf90f26520f9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:46.093871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:46.107230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f6a3f-ae8c-40ce-ae6d-9ad27e6ff7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:46.107891 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f6a3f-ae8c-40ce-ae6d-9ad27e6ff7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:46.108173 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f6a3f-ae8c-40ce-ae6d-9ad27e6ff7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:46.108478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f6a3f-ae8c-40ce-ae6d-9ad27e6ff7e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:46.109227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f6a3f-ae8c-40ce-ae6d-9ad27e6ff7e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:46.109531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f6a3f-ae8c-40ce-ae6d-9ad27e6ff7e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:46.110898 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f6a3f-ae8c-40ce-ae6d-9ad27e6ff7e3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:46.113362 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd972-56f6-4ebf-8106-d6ac056e9e1d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:46.118889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 232/448] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:46.124691 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f6a3f-ae8c-40ce-ae6d-9ad27e6ff7e3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:46.148085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031acef6-aa30-4259-b320-5653d717200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:46.148980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031acef6-aa30-4259-b320-5653d717200e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:46.149263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031acef6-aa30-4259-b320-5653d717200e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:46.149540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031acef6-aa30-4259-b320-5653d717200e None admin] PATH_INFO: `/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:46.150709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031acef6-aa30-4259-b320-5653d717200e None admin] RBAC: Authorizing `identity:get_project(project_id=6062fb0a5e0f441192aaef82d7fd14e6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:46.152134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031acef6-aa30-4259-b320-5653d717200e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:46.153840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 217/449] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:46 2022] GET /identity/v3/projects/6062fb0a5e0f441192aaef82d7fd14e6 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:46.154580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:46.159123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031acef6-aa30-4259-b320-5653d717200e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:46.223774 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f6a3f-ae8c-40ce-ae6d-9ad27e6ff7e3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:46.257064 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031acef6-aa30-4259-b320-5653d717200e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:46.257479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352da955-5a6d-422f-b8dc-83f9b3bb7797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:46.258125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352da955-5a6d-422f-b8dc-83f9b3bb7797 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:46.258413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352da955-5a6d-422f-b8dc-83f9b3bb7797 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:46.258687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352da955-5a6d-422f-b8dc-83f9b3bb7797 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:46.291285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7788c-161f-49cf-8573-7141fa54b546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:46.292130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7788c-161f-49cf-8573-7141fa54b546 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:46.292435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7788c-161f-49cf-8573-7141fa54b546 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:46.292718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7788c-161f-49cf-8573-7141fa54b546 None admin] PATH_INFO: `/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:46.293893 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7788c-161f-49cf-8573-7141fa54b546 None admin] RBAC: Authorizing `identity:get_group(group_id=d896c4db720e42d7b94bb4c1b6a189b9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:46.295323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7788c-161f-49cf-8573-7141fa54b546 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:46.296961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 218/450] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:46 2022] GET /identity/v3/groups/d896c4db720e42d7b94bb4c1b6a189b9 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:46.302655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7788c-161f-49cf-8573-7141fa54b546 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:46.320851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:46.328824 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352da955-5a6d-422f-b8dc-83f9b3bb7797 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:46.330301 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352da955-5a6d-422f-b8dc-83f9b3bb7797 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:46.359089 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:46.404022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7788c-161f-49cf-8573-7141fa54b546 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:46.427635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 233/451] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:23:46.433237 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352da955-5a6d-422f-b8dc-83f9b3bb7797 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:46.437664 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d9e1f-776f-416b-bb10-9e29aeb6fbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:46.438320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d9e1f-776f-416b-bb10-9e29aeb6fbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:46.438612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d9e1f-776f-416b-bb10-9e29aeb6fbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:46.438891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d9e1f-776f-416b-bb10-9e29aeb6fbc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:46.439720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d9e1f-776f-416b-bb10-9e29aeb6fbc0 None admin] RBAC: Adding query filter params (group.id=d896c4db720e42d7b94bb4c1b6a189b9, role.id=83a7ac2bd20743b78fe0f4689037d83b, scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:46.440034 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d9e1f-776f-416b-bb10-9e29aeb6fbc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:46.441517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d9e1f-776f-416b-bb10-9e29aeb6fbc0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:46.448481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 219/452] 10.222.0.66 () {56 vars in 1376 bytes} [Fri Jul 15 20:23:46 2022] GET /identity/v3/role_assignments?group.id=d896c4db720e42d7b94bb4c1b6a189b9&scope.project.id=6062fb0a5e0f441192aaef82d7fd14e6&role.id=83a7ac2bd20743b78fe0f4689037d83b => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:46.544775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352da955-5a6d-422f-b8dc-83f9b3bb7797 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:46.575263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:46.581429 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785569f5-d38b-469f-8251-9d3535e38a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:46.582310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785569f5-d38b-469f-8251-9d3535e38a57 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:46.582599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785569f5-d38b-469f-8251-9d3535e38a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:46.582882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785569f5-d38b-469f-8251-9d3535e38a57 None admin] PATH_INFO: `/v3/projects/090394e10e7f467d9c567173bebe0143` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:46.584245 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785569f5-d38b-469f-8251-9d3535e38a57 None admin] RBAC: Authorizing `identity:get_project(project_id=090394e10e7f467d9c567173bebe0143)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:46.585653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785569f5-d38b-469f-8251-9d3535e38a57 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:46.587374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 234/453] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:23:46 2022] GET /identity/v3/projects/090394e10e7f467d9c567173bebe0143 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:46.593079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d9e1f-776f-416b-bb10-9e29aeb6fbc0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:46.680139 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:46.700315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d9e1f-776f-416b-bb10-9e29aeb6fbc0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:46.735332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d17544-9206-4871-ae03-d1401f80465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:46.736186 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d17544-9206-4871-ae03-d1401f80465a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:46.736499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d17544-9206-4871-ae03-d1401f80465a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:46.736784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d17544-9206-4871-ae03-d1401f80465a None admin] PATH_INFO: `/v3/groups/001a6e1ac0524ebd99d0ee2b28151eb3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:46.737954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d17544-9206-4871-ae03-d1401f80465a None admin] RBAC: Authorizing `identity:get_group(group_id=001a6e1ac0524ebd99d0ee2b28151eb3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:46.739395 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d17544-9206-4871-ae03-d1401f80465a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:46.741077 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 220/454] 10.222.0.66 () {56 vars in 1180 bytes} [Fri Jul 15 20:23:46 2022] GET /identity/v3/groups/001a6e1ac0524ebd99d0ee2b28151eb3 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:46.746966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785569f5-d38b-469f-8251-9d3535e38a57 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:46.855105 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785569f5-d38b-469f-8251-9d3535e38a57 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:46.889230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ec8df-7abe-49c5-923b-f03a752ce277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:46.889889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ec8df-7abe-49c5-923b-f03a752ce277 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:46.890183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ec8df-7abe-49c5-923b-f03a752ce277 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:46.890460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ec8df-7abe-49c5-923b-f03a752ce277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:46.891296 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ec8df-7abe-49c5-923b-f03a752ce277 None admin] RBAC: Adding query filter params (group.id=001a6e1ac0524ebd99d0ee2b28151eb3, role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=090394e10e7f467d9c567173bebe0143) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:46.891611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ec8df-7abe-49c5-923b-f03a752ce277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:46.893082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ec8df-7abe-49c5-923b-f03a752ce277 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:46.899688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 235/455] 10.222.0.66 () {56 vars in 1376 bytes} [Fri Jul 15 20:23:46 2022] GET /identity/v3/role_assignments?group.id=001a6e1ac0524ebd99d0ee2b28151eb3&scope.project.id=090394e10e7f467d9c567173bebe0143&role.id=43e0afe364894278be44a97662ca6f8e => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:49.420626 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1ac4e-fe5a-452f-a936-0ca602eb1401 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:49.421137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1ac4e-fe5a-452f-a936-0ca602eb1401 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:49.421210 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1ac4e-fe5a-452f-a936-0ca602eb1401 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:49.422850 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 221/456] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:49.428533 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4041dc2-31a0-4367-be47-10db02e2805e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:49.429011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4041dc2-31a0-4367-be47-10db02e2805e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:49.429266 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4041dc2-31a0-4367-be47-10db02e2805e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:49.449276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c4041dc2-31a0-4367-be47-10db02e2805e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:49.450504 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c4041dc2-31a0-4367-be47-10db02e2805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:49.534945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:49.549072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 236/457] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:49.598138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1ac4e-fe5a-452f-a936-0ca602eb1401 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:49.701851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f019f5-ac67-435b-b715-e95d0107e442 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:49.702056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f019f5-ac67-435b-b715-e95d0107e442 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:49.702508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f019f5-ac67-435b-b715-e95d0107e442 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:49.705374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 237/458] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:49.710095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37091902-e96c-4e8b-bbec-c78bec495279 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:49.710546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37091902-e96c-4e8b-bbec-c78bec495279 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:49.710967 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37091902-e96c-4e8b-bbec-c78bec495279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:49.721728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1ac4e-fe5a-452f-a936-0ca602eb1401 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:49.743589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-37091902-e96c-4e8b-bbec-c78bec495279 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:49.745089 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-37091902-e96c-4e8b-bbec-c78bec495279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:49.770551 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faeeb35-950e-46dd-9737-6607af94f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:49.772146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeeb35-950e-46dd-9737-6607af94f2bc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:49.772453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeeb35-950e-46dd-9737-6607af94f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:49.772743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeeb35-950e-46dd-9737-6607af94f2bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:49.786135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faeeb35-950e-46dd-9737-6607af94f2bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:49.788213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faeeb35-950e-46dd-9737-6607af94f2bc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:49.810532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3faeeb35-950e-46dd-9737-6607af94f2bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:49.815164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:49.816379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:49.817471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:49.817471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:49.817471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:49.817471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:49.819646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 222/459] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:49.821092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bfc51-57f8-41f8-889e-8fbd44f1f526 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:49.821539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bfc51-57f8-41f8-889e-8fbd44f1f526 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:49.821960 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bfc51-57f8-41f8-889e-8fbd44f1f526 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:49.823616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 223/460] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:49.827522 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 238/461] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:49.829729 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0343-9734-437c-bc0b-66d0c838bc94 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:49.830172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0343-9734-437c-bc0b-66d0c838bc94 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:49.830599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0343-9734-437c-bc0b-66d0c838bc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:49.833633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37091902-e96c-4e8b-bbec-c78bec495279 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:49.850717 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c36b0343-9734-437c-bc0b-66d0c838bc94 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:49.852136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c36b0343-9734-437c-bc0b-66d0c838bc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:49.940601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 224/462] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:49.940601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0343-9734-437c-bc0b-66d0c838bc94 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:49.966991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37091902-e96c-4e8b-bbec-c78bec495279 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:49.991107 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:50.004827 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f8bf7-4a30-4694-b7eb-8b4b3d120ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:50.005626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f8bf7-4a30-4694-b7eb-8b4b3d120ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:50.006477 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f8bf7-4a30-4694-b7eb-8b4b3d120ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:50.006828 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f8bf7-4a30-4694-b7eb-8b4b3d120ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:50.007618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f8bf7-4a30-4694-b7eb-8b4b3d120ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:50.007989 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f8bf7-4a30-4694-b7eb-8b4b3d120ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:50.009725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f8bf7-4a30-4694-b7eb-8b4b3d120ee3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:50.023988 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 239/463] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:50.029798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c91f-11c7-40db-b121-8f5a75b9a835 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:50.030092 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c91f-11c7-40db-b121-8f5a75b9a835 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:50.030374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c91f-11c7-40db-b121-8f5a75b9a835 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:50.032432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 240/464] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:50.032432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3c91f-11c7-40db-b121-8f5a75b9a835 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:50.048442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0343-9734-437c-bc0b-66d0c838bc94 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:50.080048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:50.087318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408e22b-5509-43f2-aa3b-43c7e0a1656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:50.088119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408e22b-5509-43f2-aa3b-43c7e0a1656f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:50.088420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408e22b-5509-43f2-aa3b-43c7e0a1656f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:50.088727 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408e22b-5509-43f2-aa3b-43c7e0a1656f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:50.099889 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408e22b-5509-43f2-aa3b-43c7e0a1656f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:50.101419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408e22b-5509-43f2-aa3b-43c7e0a1656f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-2408e22b-5509-43f2-aa3b-43c7e0a1656f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:50.119452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:50.120433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:50.121269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:50.121269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:50.121269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:50.121269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:50.124648 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 225/465] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:50.125523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408e22b-5509-43f2-aa3b-43c7e0a1656f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:50.150337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3c91f-11c7-40db-b121-8f5a75b9a835 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:50.185729 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18066a-aa03-4e0f-9c1c-3a9ec8c6fe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:50.186521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18066a-aa03-4e0f-9c1c-3a9ec8c6fe16 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:50.186817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18066a-aa03-4e0f-9c1c-3a9ec8c6fe16 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:50.187137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18066a-aa03-4e0f-9c1c-3a9ec8c6fe16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:50.198192 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18066a-aa03-4e0f-9c1c-3a9ec8c6fe16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:50.199641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18066a-aa03-4e0f-9c1c-3a9ec8c6fe16 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-bd18066a-aa03-4e0f-9c1c-3a9ec8c6fe16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:50.217239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:50.218251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:50.219114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:50.219114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:50.219114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:50.219114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:50.219114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 241/466] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:50.219593 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4f584-4b93-45c4-ba40-5366dfd37150 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:50.220031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4f584-4b93-45c4-ba40-5366dfd37150 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:50.220313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4f584-4b93-45c4-ba40-5366dfd37150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:50.238444 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b2e4f584-4b93-45c4-ba40-5366dfd37150 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:50.239632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b2e4f584-4b93-45c4-ba40-5366dfd37150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:50.243601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408e22b-5509-43f2-aa3b-43c7e0a1656f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:50.268806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:50.284385 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d516f8-68d8-48b8-9991-2ae495eee701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:50.285435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d516f8-68d8-48b8-9991-2ae495eee701 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:50.285729 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d516f8-68d8-48b8-9991-2ae495eee701 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:50.286004 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d516f8-68d8-48b8-9991-2ae495eee701 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:50.287601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d516f8-68d8-48b8-9991-2ae495eee701 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:50.289239 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d516f8-68d8-48b8-9991-2ae495eee701 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:50.311567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 226/467] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:23:50 2022] POST /identity/v3/users => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:23:50.316616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 242/468] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:50.316616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4f584-4b93-45c4-ba40-5366dfd37150 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:50.325491 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d516f8-68d8-48b8-9991-2ae495eee701 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:50.401457 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:50.446293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4f584-4b93-45c4-ba40-5366dfd37150 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:50.486505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d516f8-68d8-48b8-9991-2ae495eee701 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:50.491888 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e502d-09e4-42ee-b50e-d6aaeab839d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:50.492669 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e502d-09e4-42ee-b50e-d6aaeab839d1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:50.493187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e502d-09e4-42ee-b50e-d6aaeab839d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:50.493655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e502d-09e4-42ee-b50e-d6aaeab839d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:50.495472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e502d-09e4-42ee-b50e-d6aaeab839d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:50.496018 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e502d-09e4-42ee-b50e-d6aaeab839d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:50.497793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e502d-09e4-42ee-b50e-d6aaeab839d1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:50.514049 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 243/469] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:50.515350 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e502d-09e4-42ee-b50e-d6aaeab839d1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:50.531844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35b238-d4ee-46a7-8c2a-a8f30779cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:50.532661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35b238-d4ee-46a7-8c2a-a8f30779cc07 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:50.532948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35b238-d4ee-46a7-8c2a-a8f30779cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:50.533348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35b238-d4ee-46a7-8c2a-a8f30779cc07 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:50.534092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35b238-d4ee-46a7-8c2a-a8f30779cc07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:50.534403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35b238-d4ee-46a7-8c2a-a8f30779cc07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:50.536583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35b238-d4ee-46a7-8c2a-a8f30779cc07 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:50.550749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:50.552324 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 227/470] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:50.554047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35b238-d4ee-46a7-8c2a-a8f30779cc07 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:50.659852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e502d-09e4-42ee-b50e-d6aaeab839d1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:50.684715 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:50.692075 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35b238-d4ee-46a7-8c2a-a8f30779cc07 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:50.698048 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a77bf-fcb5-4931-984e-d2d98c57e4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:50.699056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a77bf-fcb5-4931-984e-d2d98c57e4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:50.699407 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a77bf-fcb5-4931-984e-d2d98c57e4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:50.699793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a77bf-fcb5-4931-984e-d2d98c57e4b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:50.712159 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a77bf-fcb5-4931-984e-d2d98c57e4b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:50.713884 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a77bf-fcb5-4931-984e-d2d98c57e4b3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2e5a77bf-fcb5-4931-984e-d2d98c57e4b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:50.732841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:50.733727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:50.734872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:50.734872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:50.734872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:50.734872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:50.734872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 244/471] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:50.735667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a77bf-fcb5-4931-984e-d2d98c57e4b3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:50.736329 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430018d-2f7a-4139-b1f1-6b9cdd0cb3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:50.737297 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430018d-2f7a-4139-b1f1-6b9cdd0cb3c1 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:50.737771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430018d-2f7a-4139-b1f1-6b9cdd0cb3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:50.738216 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430018d-2f7a-4139-b1f1-6b9cdd0cb3c1 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:50.739698 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430018d-2f7a-4139-b1f1-6b9cdd0cb3c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:50.741996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430018d-2f7a-4139-b1f1-6b9cdd0cb3c1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:50.776630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 228/472] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:23:50 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:23:50.776630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430018d-2f7a-4139-b1f1-6b9cdd0cb3c1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:50.874188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:50.906418 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a77bf-fcb5-4931-984e-d2d98c57e4b3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:50.946586 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4a086-e31e-48d1-8062-7080fd761ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:50.947268 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a086-e31e-48d1-8062-7080fd761ec4 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:50.947555 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a086-e31e-48d1-8062-7080fd761ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:50.947833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a086-e31e-48d1-8062-7080fd761ec4 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:50.949579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4a086-e31e-48d1-8062-7080fd761ec4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:50.950027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4a086-e31e-48d1-8062-7080fd761ec4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:50.950669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430018d-2f7a-4139-b1f1-6b9cdd0cb3c1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:50.972975 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 245/473] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:23:50 2022] POST /identity/v3/users => generated 248 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:23:50.980491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fc740-8a68-42a2-bc75-fb6cee2ef217 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:50.980491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fc740-8a68-42a2-bc75-fb6cee2ef217 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:50.980491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fc740-8a68-42a2-bc75-fb6cee2ef217 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:50.980491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 246/474] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:50.985074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f61d-6966-4990-ac18-b668cea5655f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:50.985477 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f61d-6966-4990-ac18-b668cea5655f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:50.985765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f61d-6966-4990-ac18-b668cea5655f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:50.999676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e364f-8142-4c8f-aff4-bb7e6b93b596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:51.001207 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e364f-8142-4c8f-aff4-bb7e6b93b596 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:51.002665 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e364f-8142-4c8f-aff4-bb7e6b93b596 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:51.002958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e364f-8142-4c8f-aff4-bb7e6b93b596 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:51.003727 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e364f-8142-4c8f-aff4-bb7e6b93b596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:51.004273 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e364f-8142-4c8f-aff4-bb7e6b93b596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:51.005793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e364f-8142-4c8f-aff4-bb7e6b93b596 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:51.011530 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ae56f61d-6966-4990-ac18-b668cea5655f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:51.012929 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ae56f61d-6966-4990-ac18-b668cea5655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:51.028666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 229/475] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:51.038033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e364f-8142-4c8f-aff4-bb7e6b93b596 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:51.066971 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:51.120144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 247/476] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:51.143710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56f61d-6966-4990-ac18-b668cea5655f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:51.180934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e364f-8142-4c8f-aff4-bb7e6b93b596 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:51.214366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:51.221294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaf264-e1b0-4ee4-9ab2-9d84eb881aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:51.222166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf264-e1b0-4ee4-9ab2-9d84eb881aa4 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:51.222681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf264-e1b0-4ee4-9ab2-9d84eb881aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:51.223112 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf264-e1b0-4ee4-9ab2-9d84eb881aa4 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:51.223965 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaf264-e1b0-4ee4-9ab2-9d84eb881aa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:51.225997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaf264-e1b0-4ee4-9ab2-9d84eb881aa4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:51.251078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 230/477] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:23:51 2022] POST /identity/v3/users => generated 249 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:23:51.264560 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56f61d-6966-4990-ac18-b668cea5655f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:51.307348 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f851c-183c-4eb6-be6e-05f5c7081c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:51.308329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f851c-183c-4eb6-be6e-05f5c7081c20 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:51.308780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f851c-183c-4eb6-be6e-05f5c7081c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:51.309247 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f851c-183c-4eb6-be6e-05f5c7081c20 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:51.310154 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f851c-183c-4eb6-be6e-05f5c7081c20 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:51.311852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f851c-183c-4eb6-be6e-05f5c7081c20 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:51.320017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.sql.core [None req-768f851c-183c-4eb6-be6e-05f5c7081c20 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 20:23:51.320017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 15 20:23:51.320017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [parameters: {'id': 'c486f8a3c61641378b24eeb405536761', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 15 20:23:51.320017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80252) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-768f851c-183c-4eb6-be6e-05f5c7081c20 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application conn.query(q) Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application result.read() Jul 15 20:23:51.339613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return ref.to_dict() Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 20:23:51.340775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application next(self.gen) Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application yield resource Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application next(self.gen) Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise self.value Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application session.commit() Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 20:23:51.341796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.session.flush() Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application compat.raise_( Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 20:23:51.342738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 20:23:51.343765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application conn.query(q) Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application result.read() Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 20:23:51.344591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [parameters: {'id': 'c486f8a3c61641378b24eeb405536761', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:51.345391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 15 20:23:51.346171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:51.349043 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 248/478] 10.222.0.66 () {60 vars in 1131 bytes} [Fri Jul 15 20:23:51 2022] POST /identity/v3/roles => generated 144 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:23:51.357603 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaf264-e1b0-4ee4-9ab2-9d84eb881aa4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:51.447776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:51.487655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaf264-e1b0-4ee4-9ab2-9d84eb881aa4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:51.526178 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06579724-c34d-45ab-a393-7928c64be0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:51.526929 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06579724-c34d-45ab-a393-7928c64be0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:51.527217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06579724-c34d-45ab-a393-7928c64be0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:51.527496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06579724-c34d-45ab-a393-7928c64be0f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:51.539676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06579724-c34d-45ab-a393-7928c64be0f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-06579724-c34d-45ab-a393-7928c64be0f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:51.547981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:51.548875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:51.549659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:51.549659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:51.549659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:51.549659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:51.549659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:51.549659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:51.549659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:51.549659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:51.549659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:51.549659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:51.549659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 20:23:51.549659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:51.549659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 231/479] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:23:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:51.555608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f851c-183c-4eb6-be6e-05f5c7081c20 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:51.674906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f851c-183c-4eb6-be6e-05f5c7081c20 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:51.715849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:51.726874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef312e9-570d-4ec7-9d6e-98619acd8ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:51.728168 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef312e9-570d-4ec7-9d6e-98619acd8ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:51.728736 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef312e9-570d-4ec7-9d6e-98619acd8ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:51.729387 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef312e9-570d-4ec7-9d6e-98619acd8ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:51.730398 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef312e9-570d-4ec7-9d6e-98619acd8ac6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:51.731114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef312e9-570d-4ec7-9d6e-98619acd8ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:51.732549 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef312e9-570d-4ec7-9d6e-98619acd8ac6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:51.743778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 249/480] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:52.573821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e5b9b-74d7-484e-9242-da22e3767428 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:52.574348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e5b9b-74d7-484e-9242-da22e3767428 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:52.574348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e5b9b-74d7-484e-9242-da22e3767428 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:52.575964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 232/481] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:52.581278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63604692-633a-45d4-b51a-ea2a7a085bca None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:52.581678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63604692-633a-45d4-b51a-ea2a7a085bca None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:52.581843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63604692-633a-45d4-b51a-ea2a7a085bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:52.609428 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-63604692-633a-45d4-b51a-ea2a7a085bca None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:52.610636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-63604692-633a-45d4-b51a-ea2a7a085bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:52.699631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 250/482] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:52.734585 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e5b9b-74d7-484e-9242-da22e3767428 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:52.870053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e5b9b-74d7-484e-9242-da22e3767428 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:52.908822 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:52.914885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c035f15-5054-41fb-a4a0-a0c932e18156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:52.916129 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c035f15-5054-41fb-a4a0-a0c932e18156 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:52.916709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c035f15-5054-41fb-a4a0-a0c932e18156 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:52.917345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c035f15-5054-41fb-a4a0-a0c932e18156 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:52.933357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c035f15-5054-41fb-a4a0-a0c932e18156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7c035f15-5054-41fb-a4a0-a0c932e18156 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:52.941143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:52.942085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:52.942882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:52.942882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:52.942882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:52.942882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:52.942882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:52.942882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:52.942882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:52.942882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:52.942882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:52.942882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:52.942882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:23:52.942882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:52.946892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 233/483] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:23:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:52.948149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63604692-633a-45d4-b51a-ea2a7a085bca None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:53.183202 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63604692-633a-45d4-b51a-ea2a7a085bca None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:53.215413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:53.232289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f83e7e-02d7-40a7-a644-f13b759e9080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:53.232993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f83e7e-02d7-40a7-a644-f13b759e9080 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:53.233275 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f83e7e-02d7-40a7-a644-f13b759e9080 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:53.233554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f83e7e-02d7-40a7-a644-f13b759e9080 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:53.234304 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f83e7e-02d7-40a7-a644-f13b759e9080 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:53.234610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f83e7e-02d7-40a7-a644-f13b759e9080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:53.235975 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f83e7e-02d7-40a7-a644-f13b759e9080 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:53.244681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 251/484] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:23:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:53.253456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c035f15-5054-41fb-a4a0-a0c932e18156 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:53.375601 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca843-2ccf-4c18-ba09-4dbbf8f65475 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:53.375926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca843-2ccf-4c18-ba09-4dbbf8f65475 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:53.376168 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca843-2ccf-4c18-ba09-4dbbf8f65475 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:53.383679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 252/485] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:53.385058 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4257d2-b9c2-4699-a2ae-d86f27523ea8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:53.385712 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4257d2-b9c2-4699-a2ae-d86f27523ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:53.385994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4257d2-b9c2-4699-a2ae-d86f27523ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:53.395923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c035f15-5054-41fb-a4a0-a0c932e18156 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:53.417695 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cf4257d2-b9c2-4699-a2ae-d86f27523ea8 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:53.420748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cf4257d2-b9c2-4699-a2ae-d86f27523ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:53.473298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb2df0-1176-4a37-922a-fd4116794d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:53.474102 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb2df0-1176-4a37-922a-fd4116794d08 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:53.474560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb2df0-1176-4a37-922a-fd4116794d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:53.474933 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb2df0-1176-4a37-922a-fd4116794d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:53.499243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb2df0-1176-4a37-922a-fd4116794d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:53.500754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb2df0-1176-4a37-922a-fd4116794d08 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-79cb2df0-1176-4a37-922a-fd4116794d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:53.522243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:53.523143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:53.523967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:53.523967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:53.523967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:53.523967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:53.523967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 234/486] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:53.529487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb2df0-1176-4a37-922a-fd4116794d08 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:53.581701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:53.598131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 253/487] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:53.624905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4257d2-b9c2-4699-a2ae-d86f27523ea8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:53.673262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb2df0-1176-4a37-922a-fd4116794d08 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:53.714218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0312c-615c-4f9e-92f5-07ad5d28f959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:53.714824 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0312c-615c-4f9e-92f5-07ad5d28f959 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:53.715110 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0312c-615c-4f9e-92f5-07ad5d28f959 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:53.715391 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0312c-615c-4f9e-92f5-07ad5d28f959 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:53.716123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0312c-615c-4f9e-92f5-07ad5d28f959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:53.716469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0312c-615c-4f9e-92f5-07ad5d28f959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:53.718001 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0312c-615c-4f9e-92f5-07ad5d28f959 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:53.731943 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 235/488] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:53.737364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0312c-615c-4f9e-92f5-07ad5d28f959 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:53.796860 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4257d2-b9c2-4699-a2ae-d86f27523ea8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:53.808631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:53.838624 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d8028-d580-4a35-83cf-6b9141b0f5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:53.839795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d8028-d580-4a35-83cf-6b9141b0f5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:53.840085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d8028-d580-4a35-83cf-6b9141b0f5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:53.840363 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d8028-d580-4a35-83cf-6b9141b0f5c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:53.855061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d8028-d580-4a35-83cf-6b9141b0f5c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-1c9d8028-d580-4a35-83cf-6b9141b0f5c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:53.865850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:53.866737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:53.867523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:53.867523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:53.867523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:53.867523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:53.867523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:53.867523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:53.867523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:53.867523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:53.867523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:53.867523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:53.867523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:23:53.867523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:53.872781 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 254/489] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:23:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:23:53.874115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a9e0c-45a0-442d-9479-a7bb7081be0c None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:53.874401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a9e0c-45a0-442d-9479-a7bb7081be0c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:53.874681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a9e0c-45a0-442d-9479-a7bb7081be0c None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:53.875983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 255/490] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:53.876926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a9e0c-45a0-442d-9479-a7bb7081be0c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:53.915892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0312c-615c-4f9e-92f5-07ad5d28f959 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:53.917591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:53.954791 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338e37c-e08e-46fb-b2f3-5988a11f5f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:53.955581 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338e37c-e08e-46fb-b2f3-5988a11f5f2b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:53.955863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338e37c-e08e-46fb-b2f3-5988a11f5f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:53.956136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338e37c-e08e-46fb-b2f3-5988a11f5f2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:53.964910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338e37c-e08e-46fb-b2f3-5988a11f5f2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:53.966431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338e37c-e08e-46fb-b2f3-5988a11f5f2b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c338e37c-e08e-46fb-b2f3-5988a11f5f2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:23:53.988261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:53.989377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:53.995517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:53.995517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:53.995517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:23:53.995517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:23:53.995517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:23:53.995517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:23:53.995517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:23:53.995517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:23:53.995517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:23:53.995517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:53.995517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 236/491] 10.222.0.66 () {56 vars in 1093 bytes} [Fri Jul 15 20:23:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:53.995517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0f7f-7ba3-4eab-b5ff-18a0999986d0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:53.995517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0f7f-7ba3-4eab-b5ff-18a0999986d0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:53.996368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0f7f-7ba3-4eab-b5ff-18a0999986d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:53.996472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a9e0c-45a0-442d-9479-a7bb7081be0c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:54.016795 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-eaff0f7f-7ba3-4eab-b5ff-18a0999986d0 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:54.018407 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eaff0f7f-7ba3-4eab-b5ff-18a0999986d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:54.032581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1d6fe-355f-48cd-aa95-d39e761ce965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:54.033250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1d6fe-355f-48cd-aa95-d39e761ce965 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:54.033534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1d6fe-355f-48cd-aa95-d39e761ce965 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:54.033810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1d6fe-355f-48cd-aa95-d39e761ce965 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:54.034550 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1d6fe-355f-48cd-aa95-d39e761ce965 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:54.034855 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1d6fe-355f-48cd-aa95-d39e761ce965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:54.036212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1d6fe-355f-48cd-aa95-d39e761ce965 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:54.045727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 256/492] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:23:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:54.046180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0ea7f-3a9c-494f-a095-e091af609e59 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:54.046180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0ea7f-3a9c-494f-a095-e091af609e59 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:54.046519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0ea7f-3a9c-494f-a095-e091af609e59 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:54.047819 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 257/493] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:54.049701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0ea7f-3a9c-494f-a095-e091af609e59 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:54.085726 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:54.100463 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 237/494] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:54.105860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff0f7f-7ba3-4eab-b5ff-18a0999986d0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:54.162317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0ea7f-3a9c-494f-a095-e091af609e59 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:54.196822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66df476-c514-448d-9bfe-f4d110681f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:54.197505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66df476-c514-448d-9bfe-f4d110681f8f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:54.197784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66df476-c514-448d-9bfe-f4d110681f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:54.198069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66df476-c514-448d-9bfe-f4d110681f8f None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:54.198911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66df476-c514-448d-9bfe-f4d110681f8f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:54.199218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66df476-c514-448d-9bfe-f4d110681f8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:54.200685 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66df476-c514-448d-9bfe-f4d110681f8f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:54.214028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:54.223976 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff0f7f-7ba3-4eab-b5ff-18a0999986d0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:54.245183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 258/495] 10.222.0.66 () {56 vars in 1133 bytes} [Fri Jul 15 20:23:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:54.245183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008130f3-7cea-4292-9ead-57b7a1361aed None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:54.245183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008130f3-7cea-4292-9ead-57b7a1361aed None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:54.245183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008130f3-7cea-4292-9ead-57b7a1361aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:54.258389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-008130f3-7cea-4292-9ead-57b7a1361aed None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:54.259576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-008130f3-7cea-4292-9ead-57b7a1361aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:54.265328 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff004865-05fb-4435-a71b-947268aa01d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:54.266120 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff004865-05fb-4435-a71b-947268aa01d1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:54.266406 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff004865-05fb-4435-a71b-947268aa01d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:54.266683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff004865-05fb-4435-a71b-947268aa01d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:54.277598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff004865-05fb-4435-a71b-947268aa01d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:54.279067 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff004865-05fb-4435-a71b-947268aa01d1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ff004865-05fb-4435-a71b-947268aa01d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:54.299137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:54.300028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:54.306465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:54.306465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:54.306465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:54.306465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:54.306465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 238/496] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:54.306465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff004865-05fb-4435-a71b-947268aa01d1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:54.337291 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 259/497] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:54.345355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008130f3-7cea-4292-9ead-57b7a1361aed None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:54.372287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:54.414896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff004865-05fb-4435-a71b-947268aa01d1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:54.453972 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e9da1-4730-415d-8338-387b06dd5c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:54.454778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e9da1-4730-415d-8338-387b06dd5c4d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:54.455063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e9da1-4730-415d-8338-387b06dd5c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:54.455341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e9da1-4730-415d-8338-387b06dd5c4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:54.456695 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008130f3-7cea-4292-9ead-57b7a1361aed None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:54.472050 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e9da1-4730-415d-8338-387b06dd5c4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b02e9da1-4730-415d-8338-387b06dd5c4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:54.482490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:54.483555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:54.484559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:54.484559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:54.484559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:54.484559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:54.484559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:54.484559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:54.484559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:54.484559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:54.484559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:54.484559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:54.484559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:23:54.484559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:54.486020 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 239/498] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:23:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:54.487123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e9da1-4730-415d-8338-387b06dd5c4d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:54.493047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:54.499335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393115ca-bdfa-4895-b6d4-969f4a6214dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:54.500058 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393115ca-bdfa-4895-b6d4-969f4a6214dc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:54.500427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393115ca-bdfa-4895-b6d4-969f4a6214dc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:54.500796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393115ca-bdfa-4895-b6d4-969f4a6214dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:54.569806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393115ca-bdfa-4895-b6d4-969f4a6214dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:54.571264 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393115ca-bdfa-4895-b6d4-969f4a6214dc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:54.590499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e9da1-4730-415d-8338-387b06dd5c4d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:54.591411 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:54.624884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ada745-5526-4fca-8011-747e2d9576f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:54.625544 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ada745-5526-4fca-8011-747e2d9576f9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:54.625825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ada745-5526-4fca-8011-747e2d9576f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:54.626121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ada745-5526-4fca-8011-747e2d9576f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:54.626822 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ada745-5526-4fca-8011-747e2d9576f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:54.627129 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ada745-5526-4fca-8011-747e2d9576f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:54.628530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ada745-5526-4fca-8011-747e2d9576f9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:54.644832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 240/499] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:54.644832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ada745-5526-4fca-8011-747e2d9576f9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:54.670407 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 260/500] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:54.671327 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393115ca-bdfa-4895-b6d4-969f4a6214dc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:54.705299 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:54.742602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ada745-5526-4fca-8011-747e2d9576f9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:54.769925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393115ca-bdfa-4895-b6d4-969f4a6214dc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:54.775251 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c085ebf-f514-4a05-a21c-39987a97b429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:54.776041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085ebf-f514-4a05-a21c-39987a97b429 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:54.776326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085ebf-f514-4a05-a21c-39987a97b429 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:54.776635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085ebf-f514-4a05-a21c-39987a97b429 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:54.786467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c085ebf-f514-4a05-a21c-39987a97b429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:54.790526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8c085ebf-f514-4a05-a21c-39987a97b429 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:54.795016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:54.795882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:54.796890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:54.796890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:54.796890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:54.796890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:54.796890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:54.796890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:54.796890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:54.796890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:54.796890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:54.796890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:54.796890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:23:54.796890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:54.796890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 241/501] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:23:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:54.798040 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203f227-baa2-4ad4-82e7-288ab195639a None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:54.798040 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203f227-baa2-4ad4-82e7-288ab195639a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:54.798264 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203f227-baa2-4ad4-82e7-288ab195639a None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:54.799514 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 242/502] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:54.800201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203f227-baa2-4ad4-82e7-288ab195639a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:54.810118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d147bc-3d3f-4f64-800b-cd41e9ecb3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:54.810784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d147bc-3d3f-4f64-800b-cd41e9ecb3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:54.811071 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d147bc-3d3f-4f64-800b-cd41e9ecb3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:54.811349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d147bc-3d3f-4f64-800b-cd41e9ecb3e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:54.812133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d147bc-3d3f-4f64-800b-cd41e9ecb3e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:54.816484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d147bc-3d3f-4f64-800b-cd41e9ecb3e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:54.816484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d147bc-3d3f-4f64-800b-cd41e9ecb3e8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:54.823460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 261/503] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:23:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:54.824253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d147bc-3d3f-4f64-800b-cd41e9ecb3e8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:54.901309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203f227-baa2-4ad4-82e7-288ab195639a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:54.924985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:54.925970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d147bc-3d3f-4f64-800b-cd41e9ecb3e8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:54.936481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f33be5-b589-4766-9ac9-c5627258ec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:54.937266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f33be5-b589-4766-9ac9-c5627258ec4f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:54.937546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f33be5-b589-4766-9ac9-c5627258ec4f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:54.937819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f33be5-b589-4766-9ac9-c5627258ec4f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:54.945414 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f33be5-b589-4766-9ac9-c5627258ec4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:54.946865 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f33be5-b589-4766-9ac9-c5627258ec4f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:54.961124 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fc706-adbf-4690-b8f7-f1615a2e188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-40f33be5-b589-4766-9ac9-c5627258ec4f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:23:54.961311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:54.962345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:54.963218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:54.963218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:54.963218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:23:54.963218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:23:54.963218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:23:54.963218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:23:54.963218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:23:54.963218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:23:54.963218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 20:23:54.963218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:54.963722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fc706-adbf-4690-b8f7-f1615a2e188b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:54.963722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fc706-adbf-4690-b8f7-f1615a2e188b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:54.963837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 243/504] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:54.963899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fc706-adbf-4690-b8f7-f1615a2e188b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:54.963963 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f33be5-b589-4766-9ac9-c5627258ec4f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:54.975776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fc706-adbf-4690-b8f7-f1615a2e188b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:54.977255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fc706-adbf-4690-b8f7-f1615a2e188b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-834fc706-adbf-4690-b8f7-f1615a2e188b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:54.994858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:54.995915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:54.997051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:54.997051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:54.997051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:54.997051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:54.997051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 262/505] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:54.997439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720fb93-1019-43d0-82e0-2010b1511dda None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:54.997724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720fb93-1019-43d0-82e0-2010b1511dda None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:54.997998 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720fb93-1019-43d0-82e0-2010b1511dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:55.014400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5720fb93-1019-43d0-82e0-2010b1511dda None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:55.015589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5720fb93-1019-43d0-82e0-2010b1511dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:55.041545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:55.065349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f33be5-b589-4766-9ac9-c5627258ec4f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:55.080873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 263/506] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:55.081696 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720fb93-1019-43d0-82e0-2010b1511dda None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:55.103497 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c4e13-0830-47c7-b267-546ee1e1ec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:55.104768 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c4e13-0830-47c7-b267-546ee1e1ec51 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:55.104997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c4e13-0830-47c7-b267-546ee1e1ec51 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:55.105269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c4e13-0830-47c7-b267-546ee1e1ec51 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:55.106361 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c4e13-0830-47c7-b267-546ee1e1ec51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:55.106671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c4e13-0830-47c7-b267-546ee1e1ec51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:55.108356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c4e13-0830-47c7-b267-546ee1e1ec51 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:55.116715 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 244/507] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:23:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:55.121350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c4e13-0830-47c7-b267-546ee1e1ec51 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:55.162609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:55.197598 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720fb93-1019-43d0-82e0-2010b1511dda None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:55.215832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c4e13-0830-47c7-b267-546ee1e1ec51 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:55.232282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9b301-4d95-4113-b46e-6375b0f25581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:55.233106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9b301-4d95-4113-b46e-6375b0f25581 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:55.233392 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9b301-4d95-4113-b46e-6375b0f25581 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:55.233668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9b301-4d95-4113-b46e-6375b0f25581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:55.243979 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9b301-4d95-4113-b46e-6375b0f25581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:55.245512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9b301-4d95-4113-b46e-6375b0f25581 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:55.249039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b7684-3efc-4f1e-8e79-8430814862c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:55.249701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b7684-3efc-4f1e-8e79-8430814862c2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:55.249986 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b7684-3efc-4f1e-8e79-8430814862c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:55.250263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b7684-3efc-4f1e-8e79-8430814862c2 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:55.251088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b7684-3efc-4f1e-8e79-8430814862c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:55.251396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b7684-3efc-4f1e-8e79-8430814862c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:55.252839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b7684-3efc-4f1e-8e79-8430814862c2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ddb9b301-4d95-4113-b46e-6375b0f25581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:55.262559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:55.263500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:55.264651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:55.264651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:55.264651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:55.264651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:55.264995 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 264/508] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:55.265688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9b301-4d95-4113-b46e-6375b0f25581 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:55.286634 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:55.290663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 245/509] 10.222.0.66 () {56 vars in 1137 bytes} [Fri Jul 15 20:23:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:55.291942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b7684-3efc-4f1e-8e79-8430814862c2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:55.369881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9b301-4d95-4113-b46e-6375b0f25581 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:55.399784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b7684-3efc-4f1e-8e79-8430814862c2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:55.402644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:55.402925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c374fe-8562-4016-b2de-b35eb9a20c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:55.403698 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c374fe-8562-4016-b2de-b35eb9a20c43 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:55.403879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c374fe-8562-4016-b2de-b35eb9a20c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:55.404180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c374fe-8562-4016-b2de-b35eb9a20c43 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:55.404903 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c374fe-8562-4016-b2de-b35eb9a20c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:55.405207 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c374fe-8562-4016-b2de-b35eb9a20c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:55.406596 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c374fe-8562-4016-b2de-b35eb9a20c43 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:55.419818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 265/510] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:55.420658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c374fe-8562-4016-b2de-b35eb9a20c43 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:55.438121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee52d2-8524-44f2-a592-f6c9fec97708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:55.438941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee52d2-8524-44f2-a592-f6c9fec97708 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:55.439228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee52d2-8524-44f2-a592-f6c9fec97708 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:55.439512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee52d2-8524-44f2-a592-f6c9fec97708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:55.450826 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee52d2-8524-44f2-a592-f6c9fec97708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:55.452290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee52d2-8524-44f2-a592-f6c9fec97708 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-52ee52d2-8524-44f2-a592-f6c9fec97708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:55.469751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:55.470752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:55.471787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:55.471787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:55.471787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:55.471787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:55.471787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 246/511] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:55.471787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee52d2-8524-44f2-a592-f6c9fec97708 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:55.501114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:55.523971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c374fe-8562-4016-b2de-b35eb9a20c43 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:55.557982 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe4274-d453-4093-ba54-1007732c072f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:55.558772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe4274-d453-4093-ba54-1007732c072f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:55.559057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe4274-d453-4093-ba54-1007732c072f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:55.559340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe4274-d453-4093-ba54-1007732c072f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:55.570630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe4274-d453-4093-ba54-1007732c072f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:55.571147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee52d2-8524-44f2-a592-f6c9fec97708 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:55.572089 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe4274-d453-4093-ba54-1007732c072f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-3cfe4274-d453-4093-ba54-1007732c072f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:55.589464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:55.590506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:55.591563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:55.591563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:55.591563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:55.591563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:55.591563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 266/512] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:55.591563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe4274-d453-4093-ba54-1007732c072f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:55.606149 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14652f-bb62-4894-bed6-180972ba4751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:55.606804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14652f-bb62-4894-bed6-180972ba4751 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:55.607082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14652f-bb62-4894-bed6-180972ba4751 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:55.607357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14652f-bb62-4894-bed6-180972ba4751 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:55.608074 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14652f-bb62-4894-bed6-180972ba4751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:55.608379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14652f-bb62-4894-bed6-180972ba4751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:55.609761 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14652f-bb62-4894-bed6-180972ba4751 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:55.621915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 247/513] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:55.622686 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14652f-bb62-4894-bed6-180972ba4751 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:55.641625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:55.699573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe4274-d453-4093-ba54-1007732c072f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:55.726440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:55.727995 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14652f-bb62-4894-bed6-180972ba4751 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:55.733679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1662d-bfff-4747-8a3b-4566dbabff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:55.734322 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1662d-bfff-4747-8a3b-4566dbabff8d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:55.734605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1662d-bfff-4747-8a3b-4566dbabff8d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:55.734886 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1662d-bfff-4747-8a3b-4566dbabff8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:55.761217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409c1db-bcb3-4b1b-a48f-62b409a286fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:55.761933 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c1db-bcb3-4b1b-a48f-62b409a286fb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:55.762218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c1db-bcb3-4b1b-a48f-62b409a286fb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:55.762497 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c1db-bcb3-4b1b-a48f-62b409a286fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:55.769141 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409c1db-bcb3-4b1b-a48f-62b409a286fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:55.770591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409c1db-bcb3-4b1b-a48f-62b409a286fb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a409c1db-bcb3-4b1b-a48f-62b409a286fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:23:55.785678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:55.787269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:55.788433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:23:55.788433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:23:55.788433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:23:55.788433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:23:55.788433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:23:55.788433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:23:55.788433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:23:55.788433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:55.788433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 248/514] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:55.789252 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409c1db-bcb3-4b1b-a48f-62b409a286fb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:55.802937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1662d-bfff-4747-8a3b-4566dbabff8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:55.804418 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1662d-bfff-4747-8a3b-4566dbabff8d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:55.864520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:55.888355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409c1db-bcb3-4b1b-a48f-62b409a286fb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:55.902476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 267/515] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:55.903424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1662d-bfff-4747-8a3b-4566dbabff8d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:55.922207 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aae768-6988-4c60-86c6-db30376b5cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:55.922869 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aae768-6988-4c60-86c6-db30376b5cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:55.923159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aae768-6988-4c60-86c6-db30376b5cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:55.923443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aae768-6988-4c60-86c6-db30376b5cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:55.924164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aae768-6988-4c60-86c6-db30376b5cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:55.924500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aae768-6988-4c60-86c6-db30376b5cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:55.925892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aae768-6988-4c60-86c6-db30376b5cd1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:55.930308 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:55.938121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 249/516] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:55.938917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aae768-6988-4c60-86c6-db30376b5cd1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:56.013660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1662d-bfff-4747-8a3b-4566dbabff8d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:56.038069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aae768-6988-4c60-86c6-db30376b5cd1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:56.047281 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89135146-2e66-4967-8aa4-bcc200a6bd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:56.047946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89135146-2e66-4967-8aa4-bcc200a6bd73 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:56.048235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89135146-2e66-4967-8aa4-bcc200a6bd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:56.048794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89135146-2e66-4967-8aa4-bcc200a6bd73 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:56.049262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89135146-2e66-4967-8aa4-bcc200a6bd73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:56.049647 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89135146-2e66-4967-8aa4-bcc200a6bd73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:56.050977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89135146-2e66-4967-8aa4-bcc200a6bd73 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:56.062893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 268/517] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:56.063684 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89135146-2e66-4967-8aa4-bcc200a6bd73 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:56.076431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd4b0-e771-48a2-bb04-193501d1cef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:56.077222 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd4b0-e771-48a2-bb04-193501d1cef9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:56.077504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd4b0-e771-48a2-bb04-193501d1cef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:56.077780 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd4b0-e771-48a2-bb04-193501d1cef9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:56.080424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:56.087112 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd4b0-e771-48a2-bb04-193501d1cef9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:56.088690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd4b0-e771-48a2-bb04-193501d1cef9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-252bd4b0-e771-48a2-bb04-193501d1cef9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:23:56.103582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:56.104703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:56.105760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:56.105760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:56.105760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:23:56.105760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:23:56.105760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:23:56.105760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:23:56.105760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:23:56.105760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:23:56.105760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:23:56.105760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:56.105760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 250/518] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:23:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:56.105760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd4b0-e771-48a2-bb04-193501d1cef9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:56.154526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:56.167895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89135146-2e66-4967-8aa4-bcc200a6bd73 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:56.202121 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629801f-cd70-4ac8-b2cc-6713cddcfd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:56.202784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629801f-cd70-4ac8-b2cc-6713cddcfd40 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:56.203074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629801f-cd70-4ac8-b2cc-6713cddcfd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:56.203382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629801f-cd70-4ac8-b2cc-6713cddcfd40 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:56.204174 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629801f-cd70-4ac8-b2cc-6713cddcfd40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:56.204520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629801f-cd70-4ac8-b2cc-6713cddcfd40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:56.205956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629801f-cd70-4ac8-b2cc-6713cddcfd40 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:56.207042 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd4b0-e771-48a2-bb04-193501d1cef9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:56.223483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 269/519] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:23:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:56.224821 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629801f-cd70-4ac8-b2cc-6713cddcfd40 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:56.243944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c2478-20de-43d0-9839-aea0c15c4865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:56.244767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c2478-20de-43d0-9839-aea0c15c4865 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:56.245055 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c2478-20de-43d0-9839-aea0c15c4865 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:56.245329 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c2478-20de-43d0-9839-aea0c15c4865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:56.255042 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c2478-20de-43d0-9839-aea0c15c4865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:56.256960 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c2478-20de-43d0-9839-aea0c15c4865 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7d4c2478-20de-43d0-9839-aea0c15c4865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:56.274500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:56.275489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:56.276358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:56.276358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:56.276358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:56.276358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:56.276358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 251/520] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:56.276651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c2478-20de-43d0-9839-aea0c15c4865 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:56.327892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:56.331582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629801f-cd70-4ac8-b2cc-6713cddcfd40 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:56.366208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbeabe-6316-4e60-9498-24ce98f5abef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:56.366884 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbeabe-6316-4e60-9498-24ce98f5abef None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:56.367172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbeabe-6316-4e60-9498-24ce98f5abef None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:56.367451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbeabe-6316-4e60-9498-24ce98f5abef None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:56.368191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbeabe-6316-4e60-9498-24ce98f5abef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:56.369678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbeabe-6316-4e60-9498-24ce98f5abef None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:56.379221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c2478-20de-43d0-9839-aea0c15c4865 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:56.388555 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 270/521] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:23:56 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:23:56.389360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbeabe-6316-4e60-9498-24ce98f5abef None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:56.393701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:56.417455 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bd7b2-ff2f-430b-9dfa-04fa8a3e58ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:56.418271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bd7b2-ff2f-430b-9dfa-04fa8a3e58ec None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:56.418559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bd7b2-ff2f-430b-9dfa-04fa8a3e58ec None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:56.418837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bd7b2-ff2f-430b-9dfa-04fa8a3e58ec None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:56.428319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bd7b2-ff2f-430b-9dfa-04fa8a3e58ec None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:56.430002 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bd7b2-ff2f-430b-9dfa-04fa8a3e58ec None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f73bd7b2-ff2f-430b-9dfa-04fa8a3e58ec None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:23:56.445646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:56.446803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:56.447930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:56.447930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:56.447930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:23:56.447930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:23:56.447930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:23:56.447930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:23:56.447930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:23:56.447930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:23:56.447930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 20:23:56.447930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:56.451621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 252/522] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:23:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:56.452652 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bd7b2-ff2f-430b-9dfa-04fa8a3e58ec None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:56.520791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbeabe-6316-4e60-9498-24ce98f5abef None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:56.561439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719c792-589e-4e8b-9d81-c14ee9f3153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:56.562045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719c792-589e-4e8b-9d81-c14ee9f3153b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:56.562334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719c792-589e-4e8b-9d81-c14ee9f3153b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:56.562612 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719c792-589e-4e8b-9d81-c14ee9f3153b None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:56.563465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719c792-589e-4e8b-9d81-c14ee9f3153b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:56.563778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719c792-589e-4e8b-9d81-c14ee9f3153b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:56.565239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719c792-589e-4e8b-9d81-c14ee9f3153b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:56.567644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bd7b2-ff2f-430b-9dfa-04fa8a3e58ec None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:56.577908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:56.589558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 271/523] 10.222.0.66 () {56 vars in 1137 bytes} [Fri Jul 15 20:23:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:56.590583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719c792-589e-4e8b-9d81-c14ee9f3153b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:56.613698 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca7bab-648c-4264-81b5-32d7d4df061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:56.614471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca7bab-648c-4264-81b5-32d7d4df061b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:56.615333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca7bab-648c-4264-81b5-32d7d4df061b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:56.615607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca7bab-648c-4264-81b5-32d7d4df061b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:56.616754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca7bab-648c-4264-81b5-32d7d4df061b None admin] RBAC: Adding query filter params (role.id=c81d50150272454fa5fe29cf1428c69e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=b042da9298894712a0a29787a343bf85) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:56.617121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca7bab-648c-4264-81b5-32d7d4df061b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:56.618579 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca7bab-648c-4264-81b5-32d7d4df061b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:56.624426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 253/524] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:56 2022] GET /identity/v3/role_assignments?user.id=b042da9298894712a0a29787a343bf85&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=c81d50150272454fa5fe29cf1428c69e => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:56.628521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca7bab-648c-4264-81b5-32d7d4df061b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:56.674255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:56.722494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719c792-589e-4e8b-9d81-c14ee9f3153b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:56.762916 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e0e1d-b483-4eb1-88e9-8c22a6fb4bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:56.763606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e0e1d-b483-4eb1-88e9-8c22a6fb4bdb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:56.763708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca7bab-648c-4264-81b5-32d7d4df061b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:56.763896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e0e1d-b483-4eb1-88e9-8c22a6fb4bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:56.764180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e0e1d-b483-4eb1-88e9-8c22a6fb4bdb None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:56.764971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e0e1d-b483-4eb1-88e9-8c22a6fb4bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:56.765467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e0e1d-b483-4eb1-88e9-8c22a6fb4bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:56.767794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e0e1d-b483-4eb1-88e9-8c22a6fb4bdb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:56.783704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 272/525] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:56.784615 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e0e1d-b483-4eb1-88e9-8c22a6fb4bdb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:56.806564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0d2bb-73cb-416c-8c57-8aa25144e970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:56.807281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0d2bb-73cb-416c-8c57-8aa25144e970 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:56.807565 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0d2bb-73cb-416c-8c57-8aa25144e970 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:56.807843 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0d2bb-73cb-416c-8c57-8aa25144e970 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:56.808784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0d2bb-73cb-416c-8c57-8aa25144e970 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:56.809103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0d2bb-73cb-416c-8c57-8aa25144e970 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:56.810558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0d2bb-73cb-416c-8c57-8aa25144e970 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:56.828875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 254/526] 10.222.0.66 () {56 vars in 1139 bytes} [Fri Jul 15 20:23:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:56.829654 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0d2bb-73cb-416c-8c57-8aa25144e970 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:56.872764 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:56.909645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e0e1d-b483-4eb1-88e9-8c22a6fb4bdb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:56.939880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:56.952297 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0d2bb-73cb-416c-8c57-8aa25144e970 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:56.964417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48569512-926e-4486-a805-2df56bb6a58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:56.965775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48569512-926e-4486-a805-2df56bb6a58b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:56.966763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48569512-926e-4486-a805-2df56bb6a58b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:56.967236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48569512-926e-4486-a805-2df56bb6a58b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:56.992599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f670f-3525-405a-8257-b06170ea9e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:56.993655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f670f-3525-405a-8257-b06170ea9e5c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:56.994057 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f670f-3525-405a-8257-b06170ea9e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:56.994420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f670f-3525-405a-8257-b06170ea9e5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:57.001766 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f670f-3525-405a-8257-b06170ea9e5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:57.003482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f670f-3525-405a-8257-b06170ea9e5c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-341f670f-3525-405a-8257-b06170ea9e5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:23:57.018925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:57.019796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:57.020641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:23:57.020641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:23:57.020641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:23:57.020641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:23:57.020641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:23:57.020641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:23:57.020641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:23:57.020641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:57.020641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 255/527] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:57.022681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f670f-3525-405a-8257-b06170ea9e5c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:57.063246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48569512-926e-4486-a805-2df56bb6a58b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:57.065031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48569512-926e-4486-a805-2df56bb6a58b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:57.122324 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:57.134242 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f670f-3525-405a-8257-b06170ea9e5c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:57.171966 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99ef11-2689-4230-8dec-a0a20d9faa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:57.172660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99ef11-2689-4230-8dec-a0a20d9faa7d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:57.172941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99ef11-2689-4230-8dec-a0a20d9faa7d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:57.173257 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99ef11-2689-4230-8dec-a0a20d9faa7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:57.200194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 273/528] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:57.201516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48569512-926e-4486-a805-2df56bb6a58b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:57.232435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:57.245920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99ef11-2689-4230-8dec-a0a20d9faa7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:57.248246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99ef11-2689-4230-8dec-a0a20d9faa7d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:57.340739 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48569512-926e-4486-a805-2df56bb6a58b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:57.359650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:57.373527 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 256/529] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:23:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:23:57.374643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99ef11-2689-4230-8dec-a0a20d9faa7d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:57.382249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa6991-b2a6-41e5-ae9d-f39d314f0cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:57.383152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa6991-b2a6-41e5-ae9d-f39d314f0cbd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:57.383698 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa6991-b2a6-41e5-ae9d-f39d314f0cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:57.384253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa6991-b2a6-41e5-ae9d-f39d314f0cbd None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:57.385355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa6991-b2a6-41e5-ae9d-f39d314f0cbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:57.385864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa6991-b2a6-41e5-ae9d-f39d314f0cbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:57.387761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa6991-b2a6-41e5-ae9d-f39d314f0cbd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:57.401511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 274/530] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:23:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:57.402730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa6991-b2a6-41e5-ae9d-f39d314f0cbd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:57.498793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:57.501251 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99ef11-2689-4230-8dec-a0a20d9faa7d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:57.520770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa6991-b2a6-41e5-ae9d-f39d314f0cbd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:57.536333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d3456-9b5f-43c5-a20a-a82a890e1602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:57.537987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d3456-9b5f-43c5-a20a-a82a890e1602 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:57.538123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d3456-9b5f-43c5-a20a-a82a890e1602 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:57.538381 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d3456-9b5f-43c5-a20a-a82a890e1602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:57.549158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d3456-9b5f-43c5-a20a-a82a890e1602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:57.550342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d3456-9b5f-43c5-a20a-a82a890e1602 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:57.561318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be8fa2-fab1-48e4-b61b-185effcee952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:57.562533 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be8fa2-fab1-48e4-b61b-185effcee952 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:57.563020 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be8fa2-fab1-48e4-b61b-185effcee952 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:57.563524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be8fa2-fab1-48e4-b61b-185effcee952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3d7d3456-9b5f-43c5-a20a-a82a890e1602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:57.569228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:57.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:57.571019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:57.571019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:57.571019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:57.571019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:57.571019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 257/531] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:57.571737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d3456-9b5f-43c5-a20a-a82a890e1602 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:57.579844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be8fa2-fab1-48e4-b61b-185effcee952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:57.581901 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be8fa2-fab1-48e4-b61b-185effcee952 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-10be8fa2-fab1-48e4-b61b-185effcee952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:57.603447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:57.604357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:57.605232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:57.605232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:57.605232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:57.605232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:57.605910 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 275/532] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:57.606620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be8fa2-fab1-48e4-b61b-185effcee952 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:57.622223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:57.681426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d3456-9b5f-43c5-a20a-a82a890e1602 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:57.716664 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0360f0-a705-4b0a-a081-e7805a5fe7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:57.717318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0360f0-a705-4b0a-a081-e7805a5fe7ad None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:57.717598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0360f0-a705-4b0a-a081-e7805a5fe7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:57.717872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0360f0-a705-4b0a-a081-e7805a5fe7ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:57.718697 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0360f0-a705-4b0a-a081-e7805a5fe7ad None admin] RBAC: Adding query filter params (role.id=c81d50150272454fa5fe29cf1428c69e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=93958c7dad0540b296b316169932d474) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:57.719004 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0360f0-a705-4b0a-a081-e7805a5fe7ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:57.720450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0360f0-a705-4b0a-a081-e7805a5fe7ad None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:57.727478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be8fa2-fab1-48e4-b61b-185effcee952 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:57.732661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 258/533] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:57 2022] GET /identity/v3/role_assignments?user.id=93958c7dad0540b296b316169932d474&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=c81d50150272454fa5fe29cf1428c69e => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:57.733494 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0360f0-a705-4b0a-a081-e7805a5fe7ad None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:57.777169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effa092-8f57-403f-ab4c-f6274de7f09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:57.778346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effa092-8f57-403f-ab4c-f6274de7f09b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:57.778863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effa092-8f57-403f-ab4c-f6274de7f09b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:57.779349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effa092-8f57-403f-ab4c-f6274de7f09b None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:57.780339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effa092-8f57-403f-ab4c-f6274de7f09b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:57.782425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effa092-8f57-403f-ab4c-f6274de7f09b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:57.784205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effa092-8f57-403f-ab4c-f6274de7f09b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:57.790836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:57.813832 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 276/534] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:57.820406 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effa092-8f57-403f-ab4c-f6274de7f09b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:57.966719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0360f0-a705-4b0a-a081-e7805a5fe7ad None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:57.981308 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:57.993142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effa092-8f57-403f-ab4c-f6274de7f09b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:58.047090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f10227-5035-4b08-90e0-c368d6b747af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:58.047766 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f10227-5035-4b08-90e0-c368d6b747af None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:58.048052 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f10227-5035-4b08-90e0-c368d6b747af None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:58.048332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f10227-5035-4b08-90e0-c368d6b747af None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:58.049331 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f10227-5035-4b08-90e0-c368d6b747af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:58.049640 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f10227-5035-4b08-90e0-c368d6b747af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:58.051020 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f10227-5035-4b08-90e0-c368d6b747af None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:58.063720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31448e3c-d44f-4700-bdc8-e8a0f6357e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:58.064553 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31448e3c-d44f-4700-bdc8-e8a0f6357e6c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:58.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31448e3c-d44f-4700-bdc8-e8a0f6357e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:58.065130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31448e3c-d44f-4700-bdc8-e8a0f6357e6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:58.070262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 259/535] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:58.080185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f10227-5035-4b08-90e0-c368d6b747af None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:58.081349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31448e3c-d44f-4700-bdc8-e8a0f6357e6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:58.082822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31448e3c-d44f-4700-bdc8-e8a0f6357e6c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-31448e3c-d44f-4700-bdc8-e8a0f6357e6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:23:58.114636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:58.116109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:58.116980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:23:58.116980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:23:58.116980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:23:58.116980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:23:58.116980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:23:58.116980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:23:58.116980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:23:58.116980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:58.117855 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 277/536] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:58.122556 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31448e3c-d44f-4700-bdc8-e8a0f6357e6c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:58.226691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f10227-5035-4b08-90e0-c368d6b747af None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:58.254930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:58.273359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2dd71-b8f1-4dea-bccf-ba1da8964a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:58.274160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2dd71-b8f1-4dea-bccf-ba1da8964a3f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:58.274437 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2dd71-b8f1-4dea-bccf-ba1da8964a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:58.274706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2dd71-b8f1-4dea-bccf-ba1da8964a3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:58.288956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2dd71-b8f1-4dea-bccf-ba1da8964a3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:58.290686 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2dd71-b8f1-4dea-bccf-ba1da8964a3f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-54d2dd71-b8f1-4dea-bccf-ba1da8964a3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:23:58.312048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:58.313146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:58.314167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:23:58.314167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:23:58.314167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:23:58.314167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:23:58.314167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:23:58.314167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:23:58.314167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:23:58.314167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:58.314167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 260/537] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:23:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:58.325620 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2dd71-b8f1-4dea-bccf-ba1da8964a3f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:58.342351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31448e3c-d44f-4700-bdc8-e8a0f6357e6c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:58.383831 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424d5fc-bd6a-4932-8711-b3a81bb27caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:58.385807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424d5fc-bd6a-4932-8711-b3a81bb27caa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:58.386098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424d5fc-bd6a-4932-8711-b3a81bb27caa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:58.386380 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424d5fc-bd6a-4932-8711-b3a81bb27caa None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:58.387187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424d5fc-bd6a-4932-8711-b3a81bb27caa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:58.387501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424d5fc-bd6a-4932-8711-b3a81bb27caa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:58.388794 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:58.388974 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424d5fc-bd6a-4932-8711-b3a81bb27caa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:58.418170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 278/538] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:23:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:58.423927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424d5fc-bd6a-4932-8711-b3a81bb27caa None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:58.475923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2dd71-b8f1-4dea-bccf-ba1da8964a3f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:58.525855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bebd98-a243-4e92-882c-a3195f6a1d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:58.526453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bebd98-a243-4e92-882c-a3195f6a1d62 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:58.526739 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bebd98-a243-4e92-882c-a3195f6a1d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:58.527020 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bebd98-a243-4e92-882c-a3195f6a1d62 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:58.527909 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bebd98-a243-4e92-882c-a3195f6a1d62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:58.528224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bebd98-a243-4e92-882c-a3195f6a1d62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:58.529700 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bebd98-a243-4e92-882c-a3195f6a1d62 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:58.574759 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 261/539] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:23:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:58.580658 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bebd98-a243-4e92-882c-a3195f6a1d62 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:58.623078 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424d5fc-bd6a-4932-8711-b3a81bb27caa None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:58.639049 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:58.663371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549648c3-977e-43b2-acc9-96b2b72618e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:58.664046 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549648c3-977e-43b2-acc9-96b2b72618e0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:58.664610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549648c3-977e-43b2-acc9-96b2b72618e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:58.664897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549648c3-977e-43b2-acc9-96b2b72618e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:58.665753 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549648c3-977e-43b2-acc9-96b2b72618e0 None admin] RBAC: Adding query filter params (role.id=c81d50150272454fa5fe29cf1428c69e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=1d4739b31f6647d89132f79f3f811d02) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:58.666173 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549648c3-977e-43b2-acc9-96b2b72618e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:58.667735 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549648c3-977e-43b2-acc9-96b2b72618e0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:58.674168 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 279/540] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:58 2022] GET /identity/v3/role_assignments?user.id=1d4739b31f6647d89132f79f3f811d02&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=c81d50150272454fa5fe29cf1428c69e => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:58.675611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b1d91-7472-4e4d-8820-b0897b20bc39 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:58.675915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b1d91-7472-4e4d-8820-b0897b20bc39 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:58.676199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b1d91-7472-4e4d-8820-b0897b20bc39 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:58.682939 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 280/541] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:23:58.684609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4141c0-d287-4e55-88bd-49d547754065 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:58.684905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4141c0-d287-4e55-88bd-49d547754065 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:58.685184 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4141c0-d287-4e55-88bd-49d547754065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:58.706194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:58.720795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ee4141c0-d287-4e55-88bd-49d547754065 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:58.722545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ee4141c0-d287-4e55-88bd-49d547754065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:58.754506 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bebd98-a243-4e92-882c-a3195f6a1d62 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:58.805876 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 281/542] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:23:58.826312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e82c2e-ca17-498d-ba16-943d53bfec92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:58.827307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82c2e-ca17-498d-ba16-943d53bfec92 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:58.827760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82c2e-ca17-498d-ba16-943d53bfec92 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:58.828230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82c2e-ca17-498d-ba16-943d53bfec92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:58.829317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e82c2e-ca17-498d-ba16-943d53bfec92 None admin] RBAC: Adding query filter params (role.id=c81d50150272454fa5fe29cf1428c69e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=633e05f021544b669749f941f40cbf58) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:58.829801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e82c2e-ca17-498d-ba16-943d53bfec92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:58.831482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e82c2e-ca17-498d-ba16-943d53bfec92 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:58.837804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d58f7-183c-4f3b-ab28-5483a658e967 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:58.838344 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d58f7-183c-4f3b-ab28-5483a658e967 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:58.838795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d58f7-183c-4f3b-ab28-5483a658e967 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:58.840617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 282/543] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:23:58.842494 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 262/544] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:23:58 2022] GET /identity/v3/role_assignments?user.id=633e05f021544b669749f941f40cbf58&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=c81d50150272454fa5fe29cf1428c69e => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:58.842609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d58f7-183c-4f3b-ab28-5483a658e967 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:58.848655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0c45f-2c25-4ece-96b4-bcdd0daed416 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:58.848974 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0c45f-2c25-4ece-96b4-bcdd0daed416 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:58.849395 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0c45f-2c25-4ece-96b4-bcdd0daed416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:58.879104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6fb0c45f-2c25-4ece-96b4-bcdd0daed416 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:23:58.880858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6fb0c45f-2c25-4ece-96b4-bcdd0daed416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:23:58.976587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 263/545] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:23:58.993079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0c45f-2c25-4ece-96b4-bcdd0daed416 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:58.994495 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d58f7-183c-4f3b-ab28-5483a658e967 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:59.007600 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:59.041881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26925de6-9141-42c9-a88c-5b807b347adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:59.043531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26925de6-9141-42c9-a88c-5b807b347adb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:59.044016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26925de6-9141-42c9-a88c-5b807b347adb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:59.044516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26925de6-9141-42c9-a88c-5b807b347adb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:59.058492 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26925de6-9141-42c9-a88c-5b807b347adb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-26925de6-9141-42c9-a88c-5b807b347adb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:59.070573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:59.071489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:59.072248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:59.072248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:59.072248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:59.072248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:59.072248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:59.072248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:59.072248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:59.072248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:59.072248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:59.072248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:59.072248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:23:59.072248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:59.073999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 283/546] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:23:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:59.079818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26925de6-9141-42c9-a88c-5b807b347adb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:59.126315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:59.164754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0c45f-2c25-4ece-96b4-bcdd0daed416 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:59.201631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bed80d-c842-4244-a809-a4d930e8509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:59.202429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bed80d-c842-4244-a809-a4d930e8509d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:59.202716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bed80d-c842-4244-a809-a4d930e8509d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:59.202994 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bed80d-c842-4244-a809-a4d930e8509d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:59.225826 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bed80d-c842-4244-a809-a4d930e8509d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-17bed80d-c842-4244-a809-a4d930e8509d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:23:59.233629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:59.234499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:59.235282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:59.235282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:59.235282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:59.235282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:59.235282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:23:59.235282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:23:59.235282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:23:59.235282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:23:59.235282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:23:59.235282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:23:59.235282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:23:59.235282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:59.236490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 264/547] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:23:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:23:59.245380 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bed80d-c842-4244-a809-a4d930e8509d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:59.246636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26925de6-9141-42c9-a88c-5b807b347adb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:59.285737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068542df-396e-44f8-bf7e-0b9b2d053869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:59.287056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068542df-396e-44f8-bf7e-0b9b2d053869 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:59.287352 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068542df-396e-44f8-bf7e-0b9b2d053869 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:59.287632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068542df-396e-44f8-bf7e-0b9b2d053869 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:59.288384 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068542df-396e-44f8-bf7e-0b9b2d053869 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:59.288748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068542df-396e-44f8-bf7e-0b9b2d053869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:59.290594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068542df-396e-44f8-bf7e-0b9b2d053869 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:59.308051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 284/548] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:23:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:59.313363 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068542df-396e-44f8-bf7e-0b9b2d053869 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:59.365804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:59.384803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bed80d-c842-4244-a809-a4d930e8509d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:59.449584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d45696-19f2-4ed8-a6a8-9e3956039b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:59.450246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d45696-19f2-4ed8-a6a8-9e3956039b88 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:59.450523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d45696-19f2-4ed8-a6a8-9e3956039b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:59.450804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d45696-19f2-4ed8-a6a8-9e3956039b88 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:59.451567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d45696-19f2-4ed8-a6a8-9e3956039b88 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:59.451887 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d45696-19f2-4ed8-a6a8-9e3956039b88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:59.453320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d45696-19f2-4ed8-a6a8-9e3956039b88 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:59.463815 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 265/549] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:23:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:23:59.473379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d45696-19f2-4ed8-a6a8-9e3956039b88 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:59.478671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:59.481450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068542df-396e-44f8-bf7e-0b9b2d053869 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:59.529141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393fc96-a31b-4370-a370-e2f7cf4f79e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:59.530212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fc96-a31b-4370-a370-e2f7cf4f79e6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:59.530642 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fc96-a31b-4370-a370-e2f7cf4f79e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:59.531061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fc96-a31b-4370-a370-e2f7cf4f79e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:59.543697 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393fc96-a31b-4370-a370-e2f7cf4f79e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:59.545376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393fc96-a31b-4370-a370-e2f7cf4f79e6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-6393fc96-a31b-4370-a370-e2f7cf4f79e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:59.564053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:59.565646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:59.566874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:59.566874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:59.566874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:59.566874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:23:59.568923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 285/550] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:59.574460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393fc96-a31b-4370-a370-e2f7cf4f79e6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:59.665146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:59.667592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d45696-19f2-4ed8-a6a8-9e3956039b88 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:59.684249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393fc96-a31b-4370-a370-e2f7cf4f79e6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:23:59.724668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c825961-8005-44b8-979c-809a6c266a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:59.725750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c825961-8005-44b8-979c-809a6c266a85 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:59.726663 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c825961-8005-44b8-979c-809a6c266a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:59.728858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c825961-8005-44b8-979c-809a6c266a85 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:59.730080 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c825961-8005-44b8-979c-809a6c266a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:23:59.731354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18684b0e-7fc5-414a-973d-ab649775ffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:23:59.732655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18684b0e-7fc5-414a-973d-ab649775ffd6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:23:59.733093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18684b0e-7fc5-414a-973d-ab649775ffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:23:59.733558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c825961-8005-44b8-979c-809a6c266a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:59.733986 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18684b0e-7fc5-414a-973d-ab649775ffd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:23:59.735531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c825961-8005-44b8-979c-809a6c266a85 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:59.757446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18684b0e-7fc5-414a-973d-ab649775ffd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:23:59.759610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 286/551] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:23:59.761353 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18684b0e-7fc5-414a-973d-ab649775ffd6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:23:59.765223 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c825961-8005-44b8-979c-809a6c266a85 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-18684b0e-7fc5-414a-973d-ab649775ffd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:23:59.791804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:23:59.792908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:23:59.794162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:23:59.794162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:23:59.794162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:23:59.794162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:23:59.796794 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 266/552] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:23:59.808433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18684b0e-7fc5-414a-973d-ab649775ffd6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:23:59.932826 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:23:59.975982 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c825961-8005-44b8-979c-809a6c266a85 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:00.015284 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b97dc6-6ecd-4f2d-9ea1-387e80a5b24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:00.016351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97dc6-6ecd-4f2d-9ea1-387e80a5b24c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:00.016830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97dc6-6ecd-4f2d-9ea1-387e80a5b24c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:00.017262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97dc6-6ecd-4f2d-9ea1-387e80a5b24c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:00.026834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b97dc6-6ecd-4f2d-9ea1-387e80a5b24c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:00.028543 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b97dc6-6ecd-4f2d-9ea1-387e80a5b24c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-62b97dc6-6ecd-4f2d-9ea1-387e80a5b24c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:00.047123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:00.048263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:00.049446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:00.049446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:00.049446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:00.049446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:00.049446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:00.049446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:00.049446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:00.049446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:00.049446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 20:24:00.049446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:00.051842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 287/553] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:23:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:00.055272 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18684b0e-7fc5-414a-973d-ab649775ffd6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:00.061401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b97dc6-6ecd-4f2d-9ea1-387e80a5b24c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:00.070558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:00.096501 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc169ff-4467-4e68-bde5-bb53812e086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:00.097616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc169ff-4467-4e68-bde5-bb53812e086b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:00.099654 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc169ff-4467-4e68-bde5-bb53812e086b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:00.101016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc169ff-4467-4e68-bde5-bb53812e086b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:00.104667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc169ff-4467-4e68-bde5-bb53812e086b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:00.105144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc169ff-4467-4e68-bde5-bb53812e086b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:00.106714 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc169ff-4467-4e68-bde5-bb53812e086b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:00.122711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 267/554] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:00.124044 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f878cf-d122-4fcd-a56d-9c21c822b0ea None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:00.124335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f878cf-d122-4fcd-a56d-9c21c822b0ea None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:00.124648 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f878cf-d122-4fcd-a56d-9c21c822b0ea None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:00.129938 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 268/555] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:00.129938 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f878cf-d122-4fcd-a56d-9c21c822b0ea None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:00.214378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b97dc6-6ecd-4f2d-9ea1-387e80a5b24c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:00.251924 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ca0b7-cb07-48f8-844c-5e0f2ee1d21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:00.252642 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ca0b7-cb07-48f8-844c-5e0f2ee1d21e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:00.252928 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ca0b7-cb07-48f8-844c-5e0f2ee1d21e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:00.253206 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ca0b7-cb07-48f8-844c-5e0f2ee1d21e None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:00.254170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ca0b7-cb07-48f8-844c-5e0f2ee1d21e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:00.254486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ca0b7-cb07-48f8-844c-5e0f2ee1d21e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:00.256804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ca0b7-cb07-48f8-844c-5e0f2ee1d21e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:00.266063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f878cf-d122-4fcd-a56d-9c21c822b0ea None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:00.276662 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 288/556] 10.222.0.66 () {56 vars in 1135 bytes} [Fri Jul 15 20:24:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:00.278094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6eab8-2e6b-469f-8070-a5e6c73f11f2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:00.278395 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6eab8-2e6b-469f-8070-a5e6c73f11f2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:00.278674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6eab8-2e6b-469f-8070-a5e6c73f11f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:00.282541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:00.297387 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9db6eab8-2e6b-469f-8070-a5e6c73f11f2 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:00.298767 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9db6eab8-2e6b-469f-8070-a5e6c73f11f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:00.305929 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335466c0-0511-4b06-be57-a08ca4fdace6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:00.307035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335466c0-0511-4b06-be57-a08ca4fdace6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:00.307211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335466c0-0511-4b06-be57-a08ca4fdace6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:00.307586 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335466c0-0511-4b06-be57-a08ca4fdace6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:00.315077 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335466c0-0511-4b06-be57-a08ca4fdace6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:00.316651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335466c0-0511-4b06-be57-a08ca4fdace6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-335466c0-0511-4b06-be57-a08ca4fdace6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:00.331383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:00.332917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:00.334462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:00.334462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:00.334462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:00.334462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:00.334462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:00.334462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:00.334462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:00.334462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:00.334462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:24:00.334462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:00.338335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 269/557] 10.222.0.66 () {56 vars in 1093 bytes} [Fri Jul 15 20:24:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:00.339862 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335466c0-0511-4b06-be57-a08ca4fdace6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:00.366840 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:00.380020 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 289/558] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:00.381165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6eab8-2e6b-469f-8070-a5e6c73f11f2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:00.483609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6eab8-2e6b-469f-8070-a5e6c73f11f2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:00.484330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335466c0-0511-4b06-be57-a08ca4fdace6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:00.519687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e7967-4d4e-4584-a461-54645252653b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:00.520698 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e7967-4d4e-4584-a461-54645252653b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:00.521798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e7967-4d4e-4584-a461-54645252653b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:00.522324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e7967-4d4e-4584-a461-54645252653b None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:00.522979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95215f5-1fbb-4b59-b783-7d186e8567e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:00.523579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e7967-4d4e-4584-a461-54645252653b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:00.523696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95215f5-1fbb-4b59-b783-7d186e8567e2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:00.524040 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95215f5-1fbb-4b59-b783-7d186e8567e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:00.524355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e7967-4d4e-4584-a461-54645252653b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:00.524493 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95215f5-1fbb-4b59-b783-7d186e8567e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:00.526127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e7967-4d4e-4584-a461-54645252653b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:00.545603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 290/559] 10.222.0.66 () {56 vars in 1133 bytes} [Fri Jul 15 20:24:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:00.546931 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e7967-4d4e-4584-a461-54645252653b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:00.578015 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:00.609585 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95215f5-1fbb-4b59-b783-7d186e8567e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:00.611152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95215f5-1fbb-4b59-b783-7d186e8567e2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:00.620199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:00.688421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e7967-4d4e-4584-a461-54645252653b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:00.724246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 270/560] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:24:00.725389 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95215f5-1fbb-4b59-b783-7d186e8567e2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:00.733514 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdae74-0416-42e7-90fe-d9c204666a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:00.734655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdae74-0416-42e7-90fe-d9c204666a68 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:00.735619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdae74-0416-42e7-90fe-d9c204666a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:00.736076 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdae74-0416-42e7-90fe-d9c204666a68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:00.750074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdae74-0416-42e7-90fe-d9c204666a68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2cbdae74-0416-42e7-90fe-d9c204666a68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:00.761707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:00.762630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:00.763439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:00.763439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:00.763439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:00.763439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:00.763439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:00.763439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:00.763439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:00.763439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:00.763439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:00.763439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:00.763439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:00.763439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:00.766854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 291/561] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:24:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:00.767797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdae74-0416-42e7-90fe-d9c204666a68 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:00.823429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:00.857221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95215f5-1fbb-4b59-b783-7d186e8567e2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:00.879700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdae74-0416-42e7-90fe-d9c204666a68 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:00.890222 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:00.900848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d31d4-89d1-4e12-bab1-e244d1e8282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:00.902009 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d31d4-89d1-4e12-bab1-e244d1e8282f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:00.902726 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d31d4-89d1-4e12-bab1-e244d1e8282f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:00.903248 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d31d4-89d1-4e12-bab1-e244d1e8282f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:00.917473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d31d4-89d1-4e12-bab1-e244d1e8282f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:00.919113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d31d4-89d1-4e12-bab1-e244d1e8282f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:00.920990 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697075ee-4c73-4398-a33e-0700284843b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:00.922026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697075ee-4c73-4398-a33e-0700284843b2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:00.922374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697075ee-4c73-4398-a33e-0700284843b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:00.922750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697075ee-4c73-4398-a33e-0700284843b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:00.938313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697075ee-4c73-4398-a33e-0700284843b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a11d31d4-89d1-4e12-bab1-e244d1e8282f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:00.938634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:00.939566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:00.940475 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:00.940475 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:00.940475 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:00.940475 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:00.942407 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697075ee-4c73-4398-a33e-0700284843b2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:00.945411 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 271/562] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:00.946395 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d31d4-89d1-4e12-bab1-e244d1e8282f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-697075ee-4c73-4398-a33e-0700284843b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:00.966527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:00.967453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:00.968327 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:00.968327 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:00.968327 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:00.968327 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:00.970355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 292/563] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:00.971343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697075ee-4c73-4398-a33e-0700284843b2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:01.063036 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d31d4-89d1-4e12-bab1-e244d1e8282f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:01.091583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:01.095509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697075ee-4c73-4398-a33e-0700284843b2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:01.107538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd196f-7c02-41d5-83fe-04feaa569b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:01.108844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd196f-7c02-41d5-83fe-04feaa569b80 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.109235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd196f-7c02-41d5-83fe-04feaa569b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.109633 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd196f-7c02-41d5-83fe-04feaa569b80 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.110898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd196f-7c02-41d5-83fe-04feaa569b80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:01.111308 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd196f-7c02-41d5-83fe-04feaa569b80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:01.113105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd196f-7c02-41d5-83fe-04feaa569b80 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:01.124613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 272/564] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:24:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:01.125603 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd196f-7c02-41d5-83fe-04feaa569b80 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:01.136638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3abe0-f141-45cb-bb9f-a2f7756a792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:01.137561 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3abe0-f141-45cb-bb9f-a2f7756a792e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.137990 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3abe0-f141-45cb-bb9f-a2f7756a792e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.138409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3abe0-f141-45cb-bb9f-a2f7756a792e None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.139354 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3abe0-f141-45cb-bb9f-a2f7756a792e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:01.139884 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3abe0-f141-45cb-bb9f-a2f7756a792e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:01.141428 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3abe0-f141-45cb-bb9f-a2f7756a792e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:01.153914 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 293/565] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:01.155153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857eb5-74be-4ab5-9e4d-c9074d641605 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.155444 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857eb5-74be-4ab5-9e4d-c9074d641605 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.155721 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857eb5-74be-4ab5-9e4d-c9074d641605 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.157214 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 294/566] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:01.158033 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd857eb5-74be-4ab5-9e4d-c9074d641605 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:01.181355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:01.230968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd196f-7c02-41d5-83fe-04feaa569b80 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:01.261130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd857eb5-74be-4ab5-9e4d-c9074d641605 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:01.264023 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de68d1-22f3-4895-9b66-c37486711a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:01.264714 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de68d1-22f3-4895-9b66-c37486711a56 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.265006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de68d1-22f3-4895-9b66-c37486711a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.265290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de68d1-22f3-4895-9b66-c37486711a56 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.266014 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de68d1-22f3-4895-9b66-c37486711a56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:01.266323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de68d1-22f3-4895-9b66-c37486711a56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:01.267795 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de68d1-22f3-4895-9b66-c37486711a56 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:01.279422 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 273/567] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:01.280670 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5a588-3000-4a88-9059-256d1fdf249a None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.281015 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5a588-3000-4a88-9059-256d1fdf249a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.281301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5a588-3000-4a88-9059-256d1fdf249a None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.284520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 274/568] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:01.285511 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5a588-3000-4a88-9059-256d1fdf249a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:01.297812 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec247d-67fd-40c2-b13b-14ba4acd0b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:01.298615 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec247d-67fd-40c2-b13b-14ba4acd0b05 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.298903 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec247d-67fd-40c2-b13b-14ba4acd0b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.299185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec247d-67fd-40c2-b13b-14ba4acd0b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.309939 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec247d-67fd-40c2-b13b-14ba4acd0b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:01.311408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec247d-67fd-40c2-b13b-14ba4acd0b05 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-4fec247d-67fd-40c2-b13b-14ba4acd0b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:01.330208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:01.331180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:01.332090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:01.332090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:01.332090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:01.332090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:01.332784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 295/569] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:01.334074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95ed1-25eb-4f70-a55f-5a25d1d48120 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.334638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95ed1-25eb-4f70-a55f-5a25d1d48120 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.334927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95ed1-25eb-4f70-a55f-5a25d1d48120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.336027 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:01.352925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-25e95ed1-25eb-4f70-a55f-5a25d1d48120 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:01.354130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-25e95ed1-25eb-4f70-a55f-5a25d1d48120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:01.388571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5a588-3000-4a88-9059-256d1fdf249a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:01.420062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 296/570] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:01.420919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e95ed1-25eb-4f70-a55f-5a25d1d48120 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:01.422190 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705084c-6d44-46be-a3b1-435c29d27ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:01.422976 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705084c-6d44-46be-a3b1-435c29d27ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.423259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705084c-6d44-46be-a3b1-435c29d27ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.423535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705084c-6d44-46be-a3b1-435c29d27ad8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.430074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:01.430433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705084c-6d44-46be-a3b1-435c29d27ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:01.431880 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705084c-6d44-46be-a3b1-435c29d27ad8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1705084c-6d44-46be-a3b1-435c29d27ad8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:01.446513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:01.447590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:01.448548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:01.448548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:01.448548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:01.448548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:01.448548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:01.448548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:01.448548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:01.448548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:01.448548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 275/571] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:01.449381 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62de7-957f-4c0a-b2b4-5e4593cc66e1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.449547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62de7-957f-4c0a-b2b4-5e4593cc66e1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.449830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62de7-957f-4c0a-b2b4-5e4593cc66e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.470606 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-49d62de7-957f-4c0a-b2b4-5e4593cc66e1 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:01.471826 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-49d62de7-957f-4c0a-b2b4-5e4593cc66e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:01.530298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e95ed1-25eb-4f70-a55f-5a25d1d48120 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:01.538861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 276/572] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:01.539953 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d62de7-957f-4c0a-b2b4-5e4593cc66e1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:01.563672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaa43a-6bb6-46a8-86a1-3c597f81abb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:01.564485 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaa43a-6bb6-46a8-86a1-3c597f81abb7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.564769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaa43a-6bb6-46a8-86a1-3c597f81abb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.565045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaa43a-6bb6-46a8-86a1-3c597f81abb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.572553 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaa43a-6bb6-46a8-86a1-3c597f81abb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:01.573979 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaa43a-6bb6-46a8-86a1-3c597f81abb7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:01.584892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-5dbaa43a-6bb6-46a8-86a1-3c597f81abb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:01.588115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:01.589091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:01.589966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:01.589966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:01.589966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:01.589966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:01.589966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:01.589966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:01.589966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:01.589966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:01.589966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 297/573] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:01.590442 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaa43a-6bb6-46a8-86a1-3c597f81abb7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:01.649907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:01.650680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d62de7-957f-4c0a-b2b4-5e4593cc66e1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:01.685259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837307ae-774d-4629-89c4-394ad7c2f70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:01.685918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837307ae-774d-4629-89c4-394ad7c2f70b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.686206 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837307ae-774d-4629-89c4-394ad7c2f70b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.686485 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837307ae-774d-4629-89c4-394ad7c2f70b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.687207 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837307ae-774d-4629-89c4-394ad7c2f70b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:01.687522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837307ae-774d-4629-89c4-394ad7c2f70b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:01.688950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837307ae-774d-4629-89c4-394ad7c2f70b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:01.690063 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaa43a-6bb6-46a8-86a1-3c597f81abb7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:01.700868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 277/574] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:01.701712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837307ae-774d-4629-89c4-394ad7c2f70b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:01.724677 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43932749-4495-4301-94f4-b9acc9b180a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:01.725472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43932749-4495-4301-94f4-b9acc9b180a9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.725761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43932749-4495-4301-94f4-b9acc9b180a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.726043 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43932749-4495-4301-94f4-b9acc9b180a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.735864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43932749-4495-4301-94f4-b9acc9b180a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-43932749-4495-4301-94f4-b9acc9b180a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:01.744372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:01.745313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:01.746142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:01.746142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:01.746142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:01.746142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:01.746142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:01.746142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:01.746142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:01.746142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:01.746142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:01.746142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:01.746142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:01.746142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:01.746142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 298/575] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:24:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:01.746861 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43932749-4495-4301-94f4-b9acc9b180a9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:01.800058 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:01.804290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837307ae-774d-4629-89c4-394ad7c2f70b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:01.837480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c53790-2ec5-4b0e-b659-7f9f55e6133e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:01.838088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c53790-2ec5-4b0e-b659-7f9f55e6133e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.838328 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c53790-2ec5-4b0e-b659-7f9f55e6133e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.838601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c53790-2ec5-4b0e-b659-7f9f55e6133e None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.839376 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c53790-2ec5-4b0e-b659-7f9f55e6133e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:01.839677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c53790-2ec5-4b0e-b659-7f9f55e6133e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:01.841126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c53790-2ec5-4b0e-b659-7f9f55e6133e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:01.845295 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43932749-4495-4301-94f4-b9acc9b180a9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:01.852904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 278/576] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:01.853683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c53790-2ec5-4b0e-b659-7f9f55e6133e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:01.869030 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:01.881050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570a70b-9748-44e9-a55c-7e312dabcd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:01.881853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570a70b-9748-44e9-a55c-7e312dabcd0a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.882142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570a70b-9748-44e9-a55c-7e312dabcd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.882426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570a70b-9748-44e9-a55c-7e312dabcd0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.892556 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570a70b-9748-44e9-a55c-7e312dabcd0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e570a70b-9748-44e9-a55c-7e312dabcd0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:01.901333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:01.902211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:01.903041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:01.903041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:01.903041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:01.903041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:01.903041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:01.903041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:01.903041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:01.903041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:01.903041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:01.903041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:01.903041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:01.903041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:01.903041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 299/577] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:24:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:01.903716 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570a70b-9748-44e9-a55c-7e312dabcd0a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:01.958837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c53790-2ec5-4b0e-b659-7f9f55e6133e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:01.993330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41ffe3-2aca-40e5-abdc-8cc1fbf92478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:01.993990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41ffe3-2aca-40e5-abdc-8cc1fbf92478 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:01.994280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41ffe3-2aca-40e5-abdc-8cc1fbf92478 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:01.994562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41ffe3-2aca-40e5-abdc-8cc1fbf92478 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:01.995348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41ffe3-2aca-40e5-abdc-8cc1fbf92478 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:01.995667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41ffe3-2aca-40e5-abdc-8cc1fbf92478 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:01.997129 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41ffe3-2aca-40e5-abdc-8cc1fbf92478 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:02.001287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570a70b-9748-44e9-a55c-7e312dabcd0a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:02.009365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 279/578] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:02.010063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41ffe3-2aca-40e5-abdc-8cc1fbf92478 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:02.029283 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:02.039794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109db9fd-63ac-4a21-9c59-f322d52f64e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:02.040622 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109db9fd-63ac-4a21-9c59-f322d52f64e5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:02.040906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109db9fd-63ac-4a21-9c59-f322d52f64e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:02.041187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109db9fd-63ac-4a21-9c59-f322d52f64e5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:02.048501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109db9fd-63ac-4a21-9c59-f322d52f64e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:02.049947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109db9fd-63ac-4a21-9c59-f322d52f64e5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-109db9fd-63ac-4a21-9c59-f322d52f64e5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:02.064844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:02.065777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:02.066933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:02.066933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:02.066933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:02.066933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:02.066933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:02.066933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:02.066933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:02.066933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:02.066933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 20:24:02.066933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:02.066933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 300/579] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:24:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:02.066933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109db9fd-63ac-4a21-9c59-f322d52f64e5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:02.110716 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:02.112293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41ffe3-2aca-40e5-abdc-8cc1fbf92478 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:02.146282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62caa1-dfc4-40ce-baba-9176dd158023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:02.146942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62caa1-dfc4-40ce-baba-9176dd158023 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:02.147228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62caa1-dfc4-40ce-baba-9176dd158023 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:02.147506 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62caa1-dfc4-40ce-baba-9176dd158023 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:02.148242 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62caa1-dfc4-40ce-baba-9176dd158023 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:02.148582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62caa1-dfc4-40ce-baba-9176dd158023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:02.149949 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62caa1-dfc4-40ce-baba-9176dd158023 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:02.157698 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 280/580] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:24:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:02.158477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62caa1-dfc4-40ce-baba-9176dd158023 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:02.172278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109db9fd-63ac-4a21-9c59-f322d52f64e5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:02.205334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454d720-19ef-4ad3-9f14-034c1922c5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:02.206210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454d720-19ef-4ad3-9f14-034c1922c5c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:02.206490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454d720-19ef-4ad3-9f14-034c1922c5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:02.206763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454d720-19ef-4ad3-9f14-034c1922c5c3 None admin] PATH_INFO: `/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/b042da9298894712a0a29787a343bf85/roles/c81d50150272454fa5fe29cf1428c69e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:02.220731 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454d720-19ef-4ad3-9f14-034c1922c5c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=52dd45fcba114e3f8ff40d8b954ee5cc, user_id=b042da9298894712a0a29787a343bf85, role_id=c81d50150272454fa5fe29cf1428c69e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:02.222163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454d720-19ef-4ad3-9f14-034c1922c5c3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:02.235006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 301/581] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:24:02 2022] PUT /identity/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/b042da9298894712a0a29787a343bf85/roles/c81d50150272454fa5fe29cf1428c69e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:24:02.235792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454d720-19ef-4ad3-9f14-034c1922c5c3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:02.245034 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:02.267955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62caa1-dfc4-40ce-baba-9176dd158023 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:02.308278 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa7485-ce38-4fc3-a562-aca3023716c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:02.308985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa7485-ce38-4fc3-a562-aca3023716c1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:02.309273 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa7485-ce38-4fc3-a562-aca3023716c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:02.309557 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa7485-ce38-4fc3-a562-aca3023716c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:02.310316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa7485-ce38-4fc3-a562-aca3023716c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:02.310628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa7485-ce38-4fc3-a562-aca3023716c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:02.312047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa7485-ce38-4fc3-a562-aca3023716c1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:02.321878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 281/582] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:24:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:02.322867 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa7485-ce38-4fc3-a562-aca3023716c1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:02.353868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:02.365291 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454d720-19ef-4ad3-9f14-034c1922c5c3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:02.406940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1143177-c443-4332-995f-936ffb0efa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:02.407607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1143177-c443-4332-995f-936ffb0efa30 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:02.407894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1143177-c443-4332-995f-936ffb0efa30 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:02.408224 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1143177-c443-4332-995f-936ffb0efa30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:02.409146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1143177-c443-4332-995f-936ffb0efa30 None admin] RBAC: Adding query filter params (role.id=c81d50150272454fa5fe29cf1428c69e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=4eed1d3c16354c8c9af8c01cb541c11c) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:02.409457 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1143177-c443-4332-995f-936ffb0efa30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:02.410888 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1143177-c443-4332-995f-936ffb0efa30 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:02.417766 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 302/583] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:02 2022] GET /identity/v3/role_assignments?user.id=4eed1d3c16354c8c9af8c01cb541c11c&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=c81d50150272454fa5fe29cf1428c69e => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:02.418814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1143177-c443-4332-995f-936ffb0efa30 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:02.451232 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa7485-ce38-4fc3-a562-aca3023716c1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:02.508345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e0b11-5873-49c6-a6a0-20b3fb62fed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:02.509701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e0b11-5873-49c6-a6a0-20b3fb62fed6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:02.510178 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e0b11-5873-49c6-a6a0-20b3fb62fed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:02.510632 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e0b11-5873-49c6-a6a0-20b3fb62fed6 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:02.511704 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e0b11-5873-49c6-a6a0-20b3fb62fed6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:02.512494 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e0b11-5873-49c6-a6a0-20b3fb62fed6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:02.515244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e0b11-5873-49c6-a6a0-20b3fb62fed6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:02.537047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:02.543688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 282/584] 10.222.0.66 () {56 vars in 1137 bytes} [Fri Jul 15 20:24:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:02.545174 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e0b11-5873-49c6-a6a0-20b3fb62fed6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:02.558503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1143177-c443-4332-995f-936ffb0efa30 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:02.604481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac13f59-9f68-4cd6-9bfe-d9f18e90ac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:02.605293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac13f59-9f68-4cd6-9bfe-d9f18e90ac8f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:02.605585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac13f59-9f68-4cd6-9bfe-d9f18e90ac8f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:02.605861 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac13f59-9f68-4cd6-9bfe-d9f18e90ac8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:02.617830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac13f59-9f68-4cd6-9bfe-d9f18e90ac8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:02.619212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac13f59-9f68-4cd6-9bfe-d9f18e90ac8f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-4ac13f59-9f68-4cd6-9bfe-d9f18e90ac8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:02.636760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:02.637645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:02.638506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:02.638506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:02.638506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:02.638506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:02.638506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 303/585] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:02.639501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac13f59-9f68-4cd6-9bfe-d9f18e90ac8f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:02.651527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:02.683144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e0b11-5873-49c6-a6a0-20b3fb62fed6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:02.736161 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1eb876-3b5e-4c58-9b67-ecf9284f7de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:02.737514 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eb876-3b5e-4c58-9b67-ecf9284f7de7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:02.738225 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eb876-3b5e-4c58-9b67-ecf9284f7de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:02.738652 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eb876-3b5e-4c58-9b67-ecf9284f7de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:02.748462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac13f59-9f68-4cd6-9bfe-d9f18e90ac8f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:02.754444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1eb876-3b5e-4c58-9b67-ecf9284f7de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:02.756781 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1eb876-3b5e-4c58-9b67-ecf9284f7de7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ef1eb876-3b5e-4c58-9b67-ecf9284f7de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:02.780722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:02.781883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:02.782870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:02.782870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:02.782870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:02.782870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:02.786669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 283/586] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:02.787536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1eb876-3b5e-4c58-9b67-ecf9284f7de7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:02.792945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410a0b0-0446-456f-a0c0-863a01ce5515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:02.793978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410a0b0-0446-456f-a0c0-863a01ce5515 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:02.794442 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410a0b0-0446-456f-a0c0-863a01ce5515 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:02.794898 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410a0b0-0446-456f-a0c0-863a01ce5515 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:02.810559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410a0b0-0446-456f-a0c0-863a01ce5515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:02.812921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410a0b0-0446-456f-a0c0-863a01ce5515 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d410a0b0-0446-456f-a0c0-863a01ce5515 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:02.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:02.839309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:02.840204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:02.840204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:02.840204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:02.840204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:02.846723 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 304/587] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:02.846723 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410a0b0-0446-456f-a0c0-863a01ce5515 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:02.853780 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:02.908961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1eb876-3b5e-4c58-9b67-ecf9284f7de7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:02.933649 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:02.947513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d413dc-1995-4f42-8a17-a26384603002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:02.948637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d413dc-1995-4f42-8a17-a26384603002 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:02.949241 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d413dc-1995-4f42-8a17-a26384603002 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:02.949735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d413dc-1995-4f42-8a17-a26384603002 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:02.950656 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d413dc-1995-4f42-8a17-a26384603002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:02.951167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d413dc-1995-4f42-8a17-a26384603002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:02.952788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d413dc-1995-4f42-8a17-a26384603002 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:02.971221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 284/588] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:02.972385 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d413dc-1995-4f42-8a17-a26384603002 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:02.985972 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410a0b0-0446-456f-a0c0-863a01ce5515 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:03.033911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60f0cc-96b5-402f-9062-087218f7e2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:03.034639 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60f0cc-96b5-402f-9062-087218f7e2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:03.034928 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60f0cc-96b5-402f-9062-087218f7e2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:03.035209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60f0cc-96b5-402f-9062-087218f7e2c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:03.036211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60f0cc-96b5-402f-9062-087218f7e2c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:03.036578 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60f0cc-96b5-402f-9062-087218f7e2c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:03.038797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60f0cc-96b5-402f-9062-087218f7e2c0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:03.055911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 305/589] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:03.056839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60f0cc-96b5-402f-9062-087218f7e2c0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:03.082622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d413dc-1995-4f42-8a17-a26384603002 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:03.097839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:03.121467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d8301-b5f3-42fc-ac5e-b5c2fce564b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:03.122563 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d8301-b5f3-42fc-ac5e-b5c2fce564b6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:03.123042 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d8301-b5f3-42fc-ac5e-b5c2fce564b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:03.123513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d8301-b5f3-42fc-ac5e-b5c2fce564b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:03.124460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d8301-b5f3-42fc-ac5e-b5c2fce564b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:03.124962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d8301-b5f3-42fc-ac5e-b5c2fce564b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:03.126599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d8301-b5f3-42fc-ac5e-b5c2fce564b6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:03.144631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 285/590] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:03.145832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d8301-b5f3-42fc-ac5e-b5c2fce564b6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:03.187275 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60f0cc-96b5-402f-9062-087218f7e2c0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:03.213851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:03.236151 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fca344-320b-4b61-bbf8-6f524a7f72a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:03.236982 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca344-320b-4b61-bbf8-6f524a7f72a2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:03.237269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca344-320b-4b61-bbf8-6f524a7f72a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:03.237547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca344-320b-4b61-bbf8-6f524a7f72a2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:03.247817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fca344-320b-4b61-bbf8-6f524a7f72a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:03.249894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fca344-320b-4b61-bbf8-6f524a7f72a2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:03.267722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d8301-b5f3-42fc-ac5e-b5c2fce564b6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-75fca344-320b-4b61-bbf8-6f524a7f72a2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:03.269074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:03.269981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:03.271449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:03.271449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:03.271449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:03.271449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:03.271449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:03.271449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:03.271449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:03.271449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:03.271449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:24:03.271449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:03.271449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 306/591] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:24:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:03.272020 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fca344-320b-4b61-bbf8-6f524a7f72a2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:03.312628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7e86b-3ffa-4509-9c4e-c3b226c3aa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:03.313882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7e86b-3ffa-4509-9c4e-c3b226c3aa55 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:03.314388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7e86b-3ffa-4509-9c4e-c3b226c3aa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:03.314907 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7e86b-3ffa-4509-9c4e-c3b226c3aa55 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:03.323321 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7e86b-3ffa-4509-9c4e-c3b226c3aa55 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:03.325184 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7e86b-3ffa-4509-9c4e-c3b226c3aa55 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6ec7e86b-3ffa-4509-9c4e-c3b226c3aa55 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:03.341126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:03.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:03.342959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:03.342959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:03.342959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:03.342959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:03.342959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:03.342959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:03.342959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:03.342959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:03.342959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 20:24:03.342959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:03.345509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 286/592] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:24:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:03.346539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7e86b-3ffa-4509-9c4e-c3b226c3aa55 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:03.383002 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:03.412270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fca344-320b-4b61-bbf8-6f524a7f72a2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:03.462678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95a9ca-a637-4c59-b97a-fc4c2d4df51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:03.463633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95a9ca-a637-4c59-b97a-fc4c2d4df51c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:03.464098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95a9ca-a637-4c59-b97a-fc4c2d4df51c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:03.464417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95a9ca-a637-4c59-b97a-fc4c2d4df51c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:03.466692 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7e86b-3ffa-4509-9c4e-c3b226c3aa55 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:03.471770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95a9ca-a637-4c59-b97a-fc4c2d4df51c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:03.473401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95a9ca-a637-4c59-b97a-fc4c2d4df51c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ff95a9ca-a637-4c59-b97a-fc4c2d4df51c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:03.488908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:03.490016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:03.491421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:03.491421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:03.491421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:03.491421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:03.491421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:03.491421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:03.491421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:03.491421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:03.497431 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 307/593] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:03.498497 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95a9ca-a637-4c59-b97a-fc4c2d4df51c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:03.513755 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1a410-6511-4047-8a97-71fca97f720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:03.514930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a410-6511-4047-8a97-71fca97f720c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:03.515367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a410-6511-4047-8a97-71fca97f720c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:03.515823 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a410-6511-4047-8a97-71fca97f720c None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:03.517562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1a410-6511-4047-8a97-71fca97f720c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:03.518026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1a410-6511-4047-8a97-71fca97f720c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:03.520130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1a410-6511-4047-8a97-71fca97f720c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:03.545764 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 287/594] 10.222.0.66 () {56 vars in 1137 bytes} [Fri Jul 15 20:24:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:03.550291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1a410-6511-4047-8a97-71fca97f720c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:03.552479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:03.639706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95a9ca-a637-4c59-b97a-fc4c2d4df51c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:03.654099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:03.666354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1a410-6511-4047-8a97-71fca97f720c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:03.686656 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37747bb3-1313-4f34-b234-f249b95e1363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:03.687656 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37747bb3-1313-4f34-b234-f249b95e1363 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:03.688145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37747bb3-1313-4f34-b234-f249b95e1363 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:03.689069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37747bb3-1313-4f34-b234-f249b95e1363 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:03.690402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37747bb3-1313-4f34-b234-f249b95e1363 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:03.690917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37747bb3-1313-4f34-b234-f249b95e1363 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:03.693383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37747bb3-1313-4f34-b234-f249b95e1363 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:03.703507 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191a85d-7351-4935-8b19-fe0aded63e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:03.704267 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191a85d-7351-4935-8b19-fe0aded63e46 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:03.704655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191a85d-7351-4935-8b19-fe0aded63e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:03.705060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191a85d-7351-4935-8b19-fe0aded63e46 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:03.706305 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191a85d-7351-4935-8b19-fe0aded63e46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:03.706305 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191a85d-7351-4935-8b19-fe0aded63e46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:03.707939 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191a85d-7351-4935-8b19-fe0aded63e46 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:03.716242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 308/595] 10.222.0.66 () {56 vars in 1139 bytes} [Fri Jul 15 20:24:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:03.717417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37747bb3-1313-4f34-b234-f249b95e1363 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:03.728744 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 288/596] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:03.729725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191a85d-7351-4935-8b19-fe0aded63e46 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:03.843689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191a85d-7351-4935-8b19-fe0aded63e46 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:03.844038 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:03.851088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37747bb3-1313-4f34-b234-f249b95e1363 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:03.883924 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63335f9-bc1a-431c-a06b-92d334b8429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:03.884860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63335f9-bc1a-431c-a06b-92d334b8429f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:03.885218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63335f9-bc1a-431c-a06b-92d334b8429f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:03.885567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63335f9-bc1a-431c-a06b-92d334b8429f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:03.896578 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038df4a-4b3d-4fd3-95f9-3cf022022f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:03.897857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038df4a-4b3d-4fd3-95f9-3cf022022f37 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:03.898427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038df4a-4b3d-4fd3-95f9-3cf022022f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:03.898884 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038df4a-4b3d-4fd3-95f9-3cf022022f37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:03.898990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63335f9-bc1a-431c-a06b-92d334b8429f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:03.900894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63335f9-bc1a-431c-a06b-92d334b8429f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:03.912579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038df4a-4b3d-4fd3-95f9-3cf022022f37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:03.914697 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038df4a-4b3d-4fd3-95f9-3cf022022f37 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e63335f9-bc1a-431c-a06b-92d334b8429f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:03.921838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:03.922712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:03.923650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:03.923650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:03.923650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:03.923650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:03.923650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 289/597] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:03.924706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63335f9-bc1a-431c-a06b-92d334b8429f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:03.928810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-b038df4a-4b3d-4fd3-95f9-3cf022022f37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:03.941794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:03.943003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:03.944031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:03.944031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:03.944031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:03.944031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:03.945907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 309/598] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:03.950717 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038df4a-4b3d-4fd3-95f9-3cf022022f37 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:04.059402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038df4a-4b3d-4fd3-95f9-3cf022022f37 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:04.074977 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63335f9-bc1a-431c-a06b-92d334b8429f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:04.096225 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f21609-cd12-43bd-8d8e-e70bd883b753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:04.097048 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f21609-cd12-43bd-8d8e-e70bd883b753 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:04.097496 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f21609-cd12-43bd-8d8e-e70bd883b753 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:04.097784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f21609-cd12-43bd-8d8e-e70bd883b753 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:04.098570 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f21609-cd12-43bd-8d8e-e70bd883b753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:04.099444 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f21609-cd12-43bd-8d8e-e70bd883b753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:04.101312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f21609-cd12-43bd-8d8e-e70bd883b753 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:04.113412 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 310/599] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:04.114244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f21609-cd12-43bd-8d8e-e70bd883b753 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:04.122163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f92201-cfec-44c9-8d7c-9647510a2b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:04.123338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f92201-cfec-44c9-8d7c-9647510a2b8a None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:04.123853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f92201-cfec-44c9-8d7c-9647510a2b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:04.124880 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f92201-cfec-44c9-8d7c-9647510a2b8a None admin] PATH_INFO: `/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/93958c7dad0540b296b316169932d474/roles/c81d50150272454fa5fe29cf1428c69e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:04.128637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:04.150069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f92201-cfec-44c9-8d7c-9647510a2b8a None admin] RBAC: Authorizing `identity:create_grant(project_id=52dd45fcba114e3f8ff40d8b954ee5cc, user_id=93958c7dad0540b296b316169932d474, role_id=c81d50150272454fa5fe29cf1428c69e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:04.152884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f92201-cfec-44c9-8d7c-9647510a2b8a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:04.176427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 290/600] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:24:03 2022] PUT /identity/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/93958c7dad0540b296b316169932d474/roles/c81d50150272454fa5fe29cf1428c69e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:24:04.176427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f92201-cfec-44c9-8d7c-9647510a2b8a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:04.282578 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f21609-cd12-43bd-8d8e-e70bd883b753 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:04.288892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:04.334929 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4145a5e-6433-4607-a128-46e52304a1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:04.336662 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4145a5e-6433-4607-a128-46e52304a1fb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:04.337456 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4145a5e-6433-4607-a128-46e52304a1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:04.337940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4145a5e-6433-4607-a128-46e52304a1fb None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:04.339186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4145a5e-6433-4607-a128-46e52304a1fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:04.340186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4145a5e-6433-4607-a128-46e52304a1fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:04.342379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4145a5e-6433-4607-a128-46e52304a1fb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:04.350143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f92201-cfec-44c9-8d7c-9647510a2b8a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:04.361023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 311/601] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:04.367417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7655c-1db0-4cab-b932-e27b8ccd594a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:04.367417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7655c-1db0-4cab-b932-e27b8ccd594a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:04.367417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7655c-1db0-4cab-b932-e27b8ccd594a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:04.367751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 312/602] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:04.371359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7655c-1db0-4cab-b932-e27b8ccd594a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:04.404235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624400ca-e44e-4f2d-ad17-70f5d9a2479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:04.405633 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624400ca-e44e-4f2d-ad17-70f5d9a2479c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:04.405927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624400ca-e44e-4f2d-ad17-70f5d9a2479c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:04.406209 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624400ca-e44e-4f2d-ad17-70f5d9a2479c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:04.414085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624400ca-e44e-4f2d-ad17-70f5d9a2479c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:04.415807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624400ca-e44e-4f2d-ad17-70f5d9a2479c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-624400ca-e44e-4f2d-ad17-70f5d9a2479c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:04.430735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:04.431653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:04.432558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:04.432558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:04.432558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:04.432558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:04.432558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:04.432558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:04.432558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:04.432558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:04.432558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 291/603] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:04.433724 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa44380-5188-4ef5-9047-35ff7a5966e7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:04.433724 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa44380-5188-4ef5-9047-35ff7a5966e7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:04.433724 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa44380-5188-4ef5-9047-35ff7a5966e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:04.451909 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8fa44380-5188-4ef5-9047-35ff7a5966e7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:04.453152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8fa44380-5188-4ef5-9047-35ff7a5966e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:04.467143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:04.509506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7655c-1db0-4cab-b932-e27b8ccd594a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:04.543650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 292/604] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:04.545589 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa44380-5188-4ef5-9047-35ff7a5966e7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:04.549376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af933739-53fe-4930-a42e-f21dc52b8997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:04.550180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af933739-53fe-4930-a42e-f21dc52b8997 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:04.550464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af933739-53fe-4930-a42e-f21dc52b8997 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:04.550742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af933739-53fe-4930-a42e-f21dc52b8997 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:04.558043 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af933739-53fe-4930-a42e-f21dc52b8997 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:04.559494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af933739-53fe-4930-a42e-f21dc52b8997 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-af933739-53fe-4930-a42e-f21dc52b8997 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:04.574674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:04.575755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:04.576751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:04.576751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:04.576751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:04.576751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:04.576751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:04.576751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:04.576751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:04.576751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:04.576751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 313/605] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:04.577541 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d819-b9d9-4344-b2e3-8e6192657991 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:04.577822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d819-b9d9-4344-b2e3-8e6192657991 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:04.578147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d819-b9d9-4344-b2e3-8e6192657991 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:04.579626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 314/606] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:04.580329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1d819-b9d9-4344-b2e3-8e6192657991 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:04.605134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:04.665720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa44380-5188-4ef5-9047-35ff7a5966e7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:04.689033 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1d819-b9d9-4344-b2e3-8e6192657991 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:04.701108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a076c0-0089-4a9a-b9fc-5f728e40ca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:04.701774 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a076c0-0089-4a9a-b9fc-5f728e40ca3d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:04.702058 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a076c0-0089-4a9a-b9fc-5f728e40ca3d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:04.702336 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a076c0-0089-4a9a-b9fc-5f728e40ca3d None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:04.703124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a076c0-0089-4a9a-b9fc-5f728e40ca3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:04.703434 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a076c0-0089-4a9a-b9fc-5f728e40ca3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:04.704897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a076c0-0089-4a9a-b9fc-5f728e40ca3d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:04.720574 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 293/607] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:04.721882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf12bdf-702e-4e9c-a5ce-6d86e6f9e8dc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:04.722172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf12bdf-702e-4e9c-a5ce-6d86e6f9e8dc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:04.723240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf12bdf-702e-4e9c-a5ce-6d86e6f9e8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:04.724997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:04.731955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48808a6a-0c94-4618-9025-5a6863191a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:04.732777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48808a6a-0c94-4618-9025-5a6863191a47 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:04.733061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48808a6a-0c94-4618-9025-5a6863191a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:04.733335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48808a6a-0c94-4618-9025-5a6863191a47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:04.741217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cdf12bdf-702e-4e9c-a5ce-6d86e6f9e8dc None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:04.742393 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cdf12bdf-702e-4e9c-a5ce-6d86e6f9e8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:04.745302 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48808a6a-0c94-4618-9025-5a6863191a47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-48808a6a-0c94-4618-9025-5a6863191a47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:04.753161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:04.754077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:04.754949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:04.754949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:04.754949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:04.754949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:04.754949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:04.754949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:04.754949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:04.754949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:04.754949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:04.754949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:04.754949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:04.754949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:04.754949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 315/608] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:24:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:04.755761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48808a6a-0c94-4618-9025-5a6863191a47 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:04.818147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 294/609] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:04.818877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf12bdf-702e-4e9c-a5ce-6d86e6f9e8dc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:04.861743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:04.872504 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48808a6a-0c94-4618-9025-5a6863191a47 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:04.909856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7b917-9e71-47c8-abd6-d8ec0b83bcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:04.910599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7b917-9e71-47c8-abd6-d8ec0b83bcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:04.910939 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7b917-9e71-47c8-abd6-d8ec0b83bcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:04.911307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7b917-9e71-47c8-abd6-d8ec0b83bcf3 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:04.912674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7b917-9e71-47c8-abd6-d8ec0b83bcf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:04.912987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7b917-9e71-47c8-abd6-d8ec0b83bcf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:04.914936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7b917-9e71-47c8-abd6-d8ec0b83bcf3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:04.927880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 316/610] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:04.932619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7b917-9e71-47c8-abd6-d8ec0b83bcf3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:04.936625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf12bdf-702e-4e9c-a5ce-6d86e6f9e8dc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:04.975154 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87e7e1-02ee-48a5-a98f-0a5a33c7bfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:04.976038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87e7e1-02ee-48a5-a98f-0a5a33c7bfc7 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:04.976322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87e7e1-02ee-48a5-a98f-0a5a33c7bfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:04.976642 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87e7e1-02ee-48a5-a98f-0a5a33c7bfc7 None admin] PATH_INFO: `/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/633e05f021544b669749f941f40cbf58/roles/c81d50150272454fa5fe29cf1428c69e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:04.982781 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:04.991988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87e7e1-02ee-48a5-a98f-0a5a33c7bfc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=52dd45fcba114e3f8ff40d8b954ee5cc, user_id=633e05f021544b669749f941f40cbf58, role_id=c81d50150272454fa5fe29cf1428c69e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:04.993516 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87e7e1-02ee-48a5-a98f-0a5a33c7bfc7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:05.007811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 295/611] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:24:04 2022] PUT /identity/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/633e05f021544b669749f941f40cbf58/roles/c81d50150272454fa5fe29cf1428c69e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:24:05.008667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87e7e1-02ee-48a5-a98f-0a5a33c7bfc7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:05.062983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7b917-9e71-47c8-abd6-d8ec0b83bcf3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:05.116039 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051b83f-f2d2-4ad4-aabd-94216228299a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:05.117866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051b83f-f2d2-4ad4-aabd-94216228299a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:05.118666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051b83f-f2d2-4ad4-aabd-94216228299a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:05.119181 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051b83f-f2d2-4ad4-aabd-94216228299a None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:05.120435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051b83f-f2d2-4ad4-aabd-94216228299a None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:05.121999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051b83f-f2d2-4ad4-aabd-94216228299a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:05.123681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051b83f-f2d2-4ad4-aabd-94216228299a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:05.136236 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:05.138832 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 317/612] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:24:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:05.140082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051b83f-f2d2-4ad4-aabd-94216228299a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:05.169165 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87e7e1-02ee-48a5-a98f-0a5a33c7bfc7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:05.213107 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd5df2-b186-4328-968f-24749fa47ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:05.213914 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd5df2-b186-4328-968f-24749fa47ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:05.214197 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd5df2-b186-4328-968f-24749fa47ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:05.214469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd5df2-b186-4328-968f-24749fa47ae8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:05.226074 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd5df2-b186-4328-968f-24749fa47ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f4cd5df2-b186-4328-968f-24749fa47ae8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:05.233973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:05.234927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:05.235790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:05.235790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:05.235790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:05.235790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:05.235790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:05.235790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:05.235790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:05.235790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:05.235790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:05.235790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:05.235790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:05.235790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:05.236438 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 296/613] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:24:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:05.237564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd5df2-b186-4328-968f-24749fa47ae8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:05.270894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051b83f-f2d2-4ad4-aabd-94216228299a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:05.284666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:05.319907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fba8a4-8f5c-42cd-b09d-00f944056676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:05.320818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fba8a4-8f5c-42cd-b09d-00f944056676 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:05.321099 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fba8a4-8f5c-42cd-b09d-00f944056676 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:05.321371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fba8a4-8f5c-42cd-b09d-00f944056676 None admin] PATH_INFO: `/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/1d4739b31f6647d89132f79f3f811d02/roles/c81d50150272454fa5fe29cf1428c69e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:05.337075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fba8a4-8f5c-42cd-b09d-00f944056676 None admin] RBAC: Authorizing `identity:create_grant(project_id=52dd45fcba114e3f8ff40d8b954ee5cc, user_id=1d4739b31f6647d89132f79f3f811d02, role_id=c81d50150272454fa5fe29cf1428c69e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:05.338537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fba8a4-8f5c-42cd-b09d-00f944056676 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:05.355392 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 318/614] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:24:05 2022] PUT /identity/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/1d4739b31f6647d89132f79f3f811d02/roles/c81d50150272454fa5fe29cf1428c69e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:24:05.356197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fba8a4-8f5c-42cd-b09d-00f944056676 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:05.381170 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd5df2-b186-4328-968f-24749fa47ae8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:05.462501 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bdd46-8f3e-495f-b11a-7407e09929fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:05.463310 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bdd46-8f3e-495f-b11a-7407e09929fe None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:05.463589 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bdd46-8f3e-495f-b11a-7407e09929fe None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:05.463863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bdd46-8f3e-495f-b11a-7407e09929fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:05.485833 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bdd46-8f3e-495f-b11a-7407e09929fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:05.487702 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bdd46-8f3e-495f-b11a-7407e09929fe None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:05.496157 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d80bdd46-8f3e-495f-b11a-7407e09929fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:05.524679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:05.525810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:05.526882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:05.526882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:05.526882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:05.526882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:05.532439 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 297/615] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:05.537888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bdd46-8f3e-495f-b11a-7407e09929fe None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:05.563222 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fba8a4-8f5c-42cd-b09d-00f944056676 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:05.608425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb94c2-fd4f-4c94-ae7a-3392d2ab7360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:05.609341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb94c2-fd4f-4c94-ae7a-3392d2ab7360 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:05.609624 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb94c2-fd4f-4c94-ae7a-3392d2ab7360 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:05.610287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb94c2-fd4f-4c94-ae7a-3392d2ab7360 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:05.611038 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb94c2-fd4f-4c94-ae7a-3392d2ab7360 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:05.611346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb94c2-fd4f-4c94-ae7a-3392d2ab7360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:05.613397 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb94c2-fd4f-4c94-ae7a-3392d2ab7360 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:05.626516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 319/616] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:24:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:05.632079 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb94c2-fd4f-4c94-ae7a-3392d2ab7360 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:05.666012 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:05.668669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bdd46-8f3e-495f-b11a-7407e09929fe None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:05.703216 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd0457-252e-4682-9d95-dfcd41e95d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:05.703973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0457-252e-4682-9d95-dfcd41e95d34 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:05.704323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0457-252e-4682-9d95-dfcd41e95d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:05.704691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0457-252e-4682-9d95-dfcd41e95d34 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:05.705486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd0457-252e-4682-9d95-dfcd41e95d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:05.705852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd0457-252e-4682-9d95-dfcd41e95d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:05.707271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd0457-252e-4682-9d95-dfcd41e95d34 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:05.724068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 298/617] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:05.726027 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd0457-252e-4682-9d95-dfcd41e95d34 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:05.781793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:05.807985 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb94c2-fd4f-4c94-ae7a-3392d2ab7360 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:05.827479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd0457-252e-4682-9d95-dfcd41e95d34 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:05.863620 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde71b6-fa82-44cb-bc85-3ce2f746a62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:05.864653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde71b6-fa82-44cb-bc85-3ce2f746a62e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:05.864937 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde71b6-fa82-44cb-bc85-3ce2f746a62e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:05.865200 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde71b6-fa82-44cb-bc85-3ce2f746a62e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:05.872757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde71b6-fa82-44cb-bc85-3ce2f746a62e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:05.874203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde71b6-fa82-44cb-bc85-3ce2f746a62e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:05.877530 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128993b-0c32-489a-8e80-1fc2428b61b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:05.878384 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128993b-0c32-489a-8e80-1fc2428b61b7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:05.878675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128993b-0c32-489a-8e80-1fc2428b61b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:05.878954 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128993b-0c32-489a-8e80-1fc2428b61b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ffde71b6-fa82-44cb-bc85-3ce2f746a62e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:05.889333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:05.891453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:05.893706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:05.893706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:05.893706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:05.893706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:05.893706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:05.893706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:05.893706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:05.893706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:05.893706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:24:05.893706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:05.900426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 299/618] 10.222.0.66 () {56 vars in 1093 bytes} [Fri Jul 15 20:24:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:05.900426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde71b6-fa82-44cb-bc85-3ce2f746a62e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:05.904749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128993b-0c32-489a-8e80-1fc2428b61b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:05.906403 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128993b-0c32-489a-8e80-1fc2428b61b7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-f128993b-0c32-489a-8e80-1fc2428b61b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:05.945336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:05.947437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:05.949747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:05.949747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:05.949747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:05.949747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:05.949747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 320/619] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:05.952864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128993b-0c32-489a-8e80-1fc2428b61b7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:05.999979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde71b6-fa82-44cb-bc85-3ce2f746a62e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:06.020432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:06.037482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd9086-a77a-460c-b0a5-a030bcc12065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:06.038374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd9086-a77a-460c-b0a5-a030bcc12065 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:06.038848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd9086-a77a-460c-b0a5-a030bcc12065 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:06.039204 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd9086-a77a-460c-b0a5-a030bcc12065 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:06.040370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd9086-a77a-460c-b0a5-a030bcc12065 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:06.040774 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd9086-a77a-460c-b0a5-a030bcc12065 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:06.042487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd9086-a77a-460c-b0a5-a030bcc12065 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:06.064515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 300/620] 10.222.0.66 () {56 vars in 1133 bytes} [Fri Jul 15 20:24:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:06.068516 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd9086-a77a-460c-b0a5-a030bcc12065 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:06.130961 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:06.180972 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd9086-a77a-460c-b0a5-a030bcc12065 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:06.199265 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128993b-0c32-489a-8e80-1fc2428b61b7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:06.241139 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686f2d6-a060-445f-9422-1dfe2226d79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:06.241791 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686f2d6-a060-445f-9422-1dfe2226d79c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:06.242070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686f2d6-a060-445f-9422-1dfe2226d79c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:06.242344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686f2d6-a060-445f-9422-1dfe2226d79c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:06.281089 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647a515-c35f-4c77-9f0a-238c7c53acb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:06.282131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647a515-c35f-4c77-9f0a-238c7c53acb2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:06.282620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647a515-c35f-4c77-9f0a-238c7c53acb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:06.283126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647a515-c35f-4c77-9f0a-238c7c53acb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:06.284044 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647a515-c35f-4c77-9f0a-238c7c53acb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:06.284557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647a515-c35f-4c77-9f0a-238c7c53acb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:06.286165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647a515-c35f-4c77-9f0a-238c7c53acb2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:06.300742 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:06.308512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 321/621] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:06.313806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647a515-c35f-4c77-9f0a-238c7c53acb2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:06.359030 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686f2d6-a060-445f-9422-1dfe2226d79c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:06.360888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686f2d6-a060-445f-9422-1dfe2226d79c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:06.496346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647a515-c35f-4c77-9f0a-238c7c53acb2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:06.537601 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c33b3-0c2e-47b5-a31e-f06a93f456e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:06.538967 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c33b3-0c2e-47b5-a31e-f06a93f456e9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:06.539983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c33b3-0c2e-47b5-a31e-f06a93f456e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:06.540491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c33b3-0c2e-47b5-a31e-f06a93f456e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:06.544739 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:06.552924 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c33b3-0c2e-47b5-a31e-f06a93f456e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:06.555451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c33b3-0c2e-47b5-a31e-f06a93f456e9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:06.567887 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 301/622] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:24:06.569607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e7a0d-5952-4f79-accd-0a5a8c644e3d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:06.570011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e7a0d-5952-4f79-accd-0a5a8c644e3d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:06.570382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e7a0d-5952-4f79-accd-0a5a8c644e3d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c86c33b3-0c2e-47b5-a31e-f06a93f456e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:06.573334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:06.574250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:06.575188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:06.575188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:06.575188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:06.575188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:06.575188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:06.575188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:06.575188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:06.575188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:06.575188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 20:24:06.575188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:06.576653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 302/623] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:06.577443 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 322/624] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:24:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:06.577969 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e7a0d-5952-4f79-accd-0a5a8c644e3d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:06.579177 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f6478-34b9-4dde-99c7-32ca7cb9f184 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:06.579645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f6478-34b9-4dde-99c7-32ca7cb9f184 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:06.580099 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f6478-34b9-4dde-99c7-32ca7cb9f184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:06.600909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-167f6478-34b9-4dde-99c7-32ca7cb9f184 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:06.602193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-167f6478-34b9-4dde-99c7-32ca7cb9f184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:06.673163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:06.676561 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 323/625] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:24:06.678189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f6478-34b9-4dde-99c7-32ca7cb9f184 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:06.711232 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e7a0d-5952-4f79-accd-0a5a8c644e3d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:06.761875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e96c4-7af6-44d9-8325-b946a223f016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:06.762926 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e96c4-7af6-44d9-8325-b946a223f016 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:06.763605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e96c4-7af6-44d9-8325-b946a223f016 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:06.764029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e96c4-7af6-44d9-8325-b946a223f016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:06.778683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e96c4-7af6-44d9-8325-b946a223f016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:06.780978 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e96c4-7af6-44d9-8325-b946a223f016 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:06.800246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f6478-34b9-4dde-99c7-32ca7cb9f184 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a06e96c4-7af6-44d9-8325-b946a223f016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:06.803323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:06.804220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:06.805247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:06.805247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:06.805247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:06.805247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:06.807505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 303/626] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:06.808495 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e96c4-7af6-44d9-8325-b946a223f016 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:06.839355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:06.853301 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190e9d-c1cd-409a-ba3a-d2ca45097a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:06.853993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190e9d-c1cd-409a-ba3a-d2ca45097a2d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:06.854276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190e9d-c1cd-409a-ba3a-d2ca45097a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:06.854564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190e9d-c1cd-409a-ba3a-d2ca45097a2d None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:06.856136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65190e9d-c1cd-409a-ba3a-d2ca45097a2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:06.856471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65190e9d-c1cd-409a-ba3a-d2ca45097a2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:06.858437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65190e9d-c1cd-409a-ba3a-d2ca45097a2d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:06.885563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 324/627] 10.222.0.66 () {56 vars in 1135 bytes} [Fri Jul 15 20:24:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:06.886786 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190e9d-c1cd-409a-ba3a-d2ca45097a2d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:06.929424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e96c4-7af6-44d9-8325-b946a223f016 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:06.953825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:06.967205 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef21e0-30cc-4998-b840-2720e3650c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:06.967980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef21e0-30cc-4998-b840-2720e3650c2d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:06.968269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef21e0-30cc-4998-b840-2720e3650c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:06.968577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef21e0-30cc-4998-b840-2720e3650c2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:06.980085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef21e0-30cc-4998-b840-2720e3650c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0bef21e0-30cc-4998-b840-2720e3650c2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:06.988486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:06.989981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:06.990896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:06.990896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:06.990896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:06.990896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:06.990896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:06.990896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:06.990896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:06.990896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:06.990896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:06.990896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:06.990896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:06.990896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:06.990896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 304/628] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:24:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:06.991596 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef21e0-30cc-4998-b840-2720e3650c2d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:06.995865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190e9d-c1cd-409a-ba3a-d2ca45097a2d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:07.032193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25ca6e-4044-4911-b46e-6515428c3bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:07.033275 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25ca6e-4044-4911-b46e-6515428c3bfb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:07.033764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25ca6e-4044-4911-b46e-6515428c3bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:07.034242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25ca6e-4044-4911-b46e-6515428c3bfb None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:07.035162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25ca6e-4044-4911-b46e-6515428c3bfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:07.035667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25ca6e-4044-4911-b46e-6515428c3bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:07.037757 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25ca6e-4044-4911-b46e-6515428c3bfb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:07.050274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 325/629] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:07.051369 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25ca6e-4044-4911-b46e-6515428c3bfb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:07.097960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:07.105536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef21e0-30cc-4998-b840-2720e3650c2d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:07.143625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76d494-6798-4284-ba26-9fae82788c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:07.144651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d494-6798-4284-ba26-9fae82788c79 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:07.144901 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d494-6798-4284-ba26-9fae82788c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:07.145182 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d494-6798-4284-ba26-9fae82788c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:07.157547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25ca6e-4044-4911-b46e-6515428c3bfb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:07.157803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76d494-6798-4284-ba26-9fae82788c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:07.159433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76d494-6798-4284-ba26-9fae82788c79 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ff76d494-6798-4284-ba26-9fae82788c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:07.180518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:07.181482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:07.182382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:07.182382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:07.182382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:07.182382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:07.186322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 305/630] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:07.187270 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76d494-6798-4284-ba26-9fae82788c79 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:07.197569 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf2202-3b2f-4180-a177-44715ac4a507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:07.198652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf2202-3b2f-4180-a177-44715ac4a507 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:07.199145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf2202-3b2f-4180-a177-44715ac4a507 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:07.199644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf2202-3b2f-4180-a177-44715ac4a507 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:07.200655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf2202-3b2f-4180-a177-44715ac4a507 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:07.201164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf2202-3b2f-4180-a177-44715ac4a507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:07.202731 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf2202-3b2f-4180-a177-44715ac4a507 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:07.212285 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 326/631] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:24:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:07.213526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf2202-3b2f-4180-a177-44715ac4a507 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:07.227547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:07.301279 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76d494-6798-4284-ba26-9fae82788c79 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:07.318559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf2202-3b2f-4180-a177-44715ac4a507 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:07.327407 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:07.339300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18184-9b26-410e-9a40-abbffe6127e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:07.340096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18184-9b26-410e-9a40-abbffe6127e1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:07.340378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18184-9b26-410e-9a40-abbffe6127e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:07.340682 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18184-9b26-410e-9a40-abbffe6127e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:07.347503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd18184-9b26-410e-9a40-abbffe6127e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:07.349504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd18184-9b26-410e-9a40-abbffe6127e1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:07.356448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719189f-e622-4613-bd11-fbd32b8edb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:07.357118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719189f-e622-4613-bd11-fbd32b8edb42 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:07.357403 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719189f-e622-4613-bd11-fbd32b8edb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:07.357679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719189f-e622-4613-bd11-fbd32b8edb42 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:07.358403 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719189f-e622-4613-bd11-fbd32b8edb42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:07.358708 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719189f-e622-4613-bd11-fbd32b8edb42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:07.360062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719189f-e622-4613-bd11-fbd32b8edb42 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-edd18184-9b26-410e-9a40-abbffe6127e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:07.363836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:07.365342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:07.366213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:07.366213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:07.366213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:07.366213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:07.366213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:07.366213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:07.366213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:07.366213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:07.370399 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 306/632] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:07.371241 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18184-9b26-410e-9a40-abbffe6127e1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:07.373263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 327/633] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:07.374866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7abf-f409-49c5-81f2-c85aad47b715 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:07.375159 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7abf-f409-49c5-81f2-c85aad47b715 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:07.375436 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7abf-f409-49c5-81f2-c85aad47b715 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:07.376833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 328/634] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:07.377396 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7abf-f409-49c5-81f2-c85aad47b715 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:07.495916 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:07.501432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7abf-f409-49c5-81f2-c85aad47b715 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:07.502268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18184-9b26-410e-9a40-abbffe6127e1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:07.540548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e083e-1379-466b-8f14-0e06d15bef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:07.541452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e083e-1379-466b-8f14-0e06d15bef16 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:07.541804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e083e-1379-466b-8f14-0e06d15bef16 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:07.542147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e083e-1379-466b-8f14-0e06d15bef16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:07.546096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbc614-0bed-4a70-b050-0e9253f587ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:07.546923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbc614-0bed-4a70-b050-0e9253f587ab None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:07.547351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbc614-0bed-4a70-b050-0e9253f587ab None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:07.547794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbc614-0bed-4a70-b050-0e9253f587ab None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:07.548754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbc614-0bed-4a70-b050-0e9253f587ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:07.549201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbc614-0bed-4a70-b050-0e9253f587ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:07.550775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbc614-0bed-4a70-b050-0e9253f587ab None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:07.552732 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e083e-1379-466b-8f14-0e06d15bef16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:07.554164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e083e-1379-466b-8f14-0e06d15bef16 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:07.568146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 329/635] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:07.568146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8254ab-9267-4f93-8f21-b3f1c744d034 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:07.568146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8254ab-9267-4f93-8f21-b3f1c744d034 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:07.568146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8254ab-9267-4f93-8f21-b3f1c744d034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-414e083e-1379-466b-8f14-0e06d15bef16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:07.578657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:07.579573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:07.580840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:07.580840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:07.580840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:07.580840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:07.583979 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7a8254ab-9267-4f93-8f21-b3f1c744d034 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:07.584694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 307/636] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:07.585280 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7a8254ab-9267-4f93-8f21-b3f1c744d034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:07.585895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e083e-1379-466b-8f14-0e06d15bef16 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:07.606755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:07.654652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 330/637] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:07.655310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8254ab-9267-4f93-8f21-b3f1c744d034 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:07.710153 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e083e-1379-466b-8f14-0e06d15bef16 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:07.745150 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee97606-5b0f-4ef1-9250-1aada5d4b5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:07.746003 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97606-5b0f-4ef1-9250-1aada5d4b5aa None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:07.746226 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97606-5b0f-4ef1-9250-1aada5d4b5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:07.746503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97606-5b0f-4ef1-9250-1aada5d4b5aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:07.753507 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee97606-5b0f-4ef1-9250-1aada5d4b5aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:07.755198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee97606-5b0f-4ef1-9250-1aada5d4b5aa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:07.762132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8254ab-9267-4f93-8f21-b3f1c744d034 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7ee97606-5b0f-4ef1-9250-1aada5d4b5aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:07.769403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:07.770371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:07.771853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:07.771853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:07.771853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:07.771853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:07.771853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:07.771853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:07.771853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:07.771853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:07.771853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 308/638] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:07.772352 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee97606-5b0f-4ef1-9250-1aada5d4b5aa None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:07.782954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:07.806003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d05a4-9039-4179-9f2f-6f853eb1ccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:07.806669 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d05a4-9039-4179-9f2f-6f853eb1ccf9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:07.806981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d05a4-9039-4179-9f2f-6f853eb1ccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:07.807258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d05a4-9039-4179-9f2f-6f853eb1ccf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:07.808079 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d05a4-9039-4179-9f2f-6f853eb1ccf9 None admin] RBAC: Adding query filter params (role.id=c81d50150272454fa5fe29cf1428c69e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=b042da9298894712a0a29787a343bf85) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:07.808409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d05a4-9039-4179-9f2f-6f853eb1ccf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:07.809845 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d05a4-9039-4179-9f2f-6f853eb1ccf9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:07.815905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 331/639] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:07 2022] GET /identity/v3/role_assignments?user.id=b042da9298894712a0a29787a343bf85&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=c81d50150272454fa5fe29cf1428c69e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:07.815905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d05a4-9039-4179-9f2f-6f853eb1ccf9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:07.841134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:07.901699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee97606-5b0f-4ef1-9250-1aada5d4b5aa None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:07.961412 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d05a4-9039-4179-9f2f-6f853eb1ccf9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:07.965141 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910e322-a57d-47b8-809e-67a1893271a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:07.965960 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910e322-a57d-47b8-809e-67a1893271a1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:07.966306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910e322-a57d-47b8-809e-67a1893271a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:07.966646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910e322-a57d-47b8-809e-67a1893271a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:07.967459 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910e322-a57d-47b8-809e-67a1893271a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:07.967830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910e322-a57d-47b8-809e-67a1893271a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:07.969354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910e322-a57d-47b8-809e-67a1893271a1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:07.994764 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 309/640] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:07.995472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910e322-a57d-47b8-809e-67a1893271a1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:08.025750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138c247-8f81-467b-b7ce-e2134c0243dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:08.026491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138c247-8f81-467b-b7ce-e2134c0243dc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:08.026779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138c247-8f81-467b-b7ce-e2134c0243dc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:08.027051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138c247-8f81-467b-b7ce-e2134c0243dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:08.040466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138c247-8f81-467b-b7ce-e2134c0243dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-4138c247-8f81-467b-b7ce-e2134c0243dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:08.050137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:08.051333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:08.052432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:08.052432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:08.052432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:08.052432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:08.052432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:08.052432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:08.052432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:08.052432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:08.052432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:08.052432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:08.052432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:08.052432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:08.055236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 332/641] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:24:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:08.056684 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c808ab-6f9c-487d-b26a-a9b165fd2fcf None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:08.056975 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c808ab-6f9c-487d-b26a-a9b165fd2fcf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:08.057252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c808ab-6f9c-487d-b26a-a9b165fd2fcf None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:08.059113 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 333/642] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:08.059658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c808ab-6f9c-487d-b26a-a9b165fd2fcf None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:08.091093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:08.127973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910e322-a57d-47b8-809e-67a1893271a1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:08.154433 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:08.165419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0feb947-5695-4e23-9129-edb2d3fd9bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:08.166159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0feb947-5695-4e23-9129-edb2d3fd9bff None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:08.166462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0feb947-5695-4e23-9129-edb2d3fd9bff None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:08.166729 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0feb947-5695-4e23-9129-edb2d3fd9bff None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:08.167517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0feb947-5695-4e23-9129-edb2d3fd9bff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:08.167830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0feb947-5695-4e23-9129-edb2d3fd9bff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:08.169307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0feb947-5695-4e23-9129-edb2d3fd9bff None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:08.179684 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c808ab-6f9c-487d-b26a-a9b165fd2fcf None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:08.182363 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 310/643] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:08.183027 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0feb947-5695-4e23-9129-edb2d3fd9bff None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:08.218070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaccd7-120f-437c-a2c2-584794e632d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:08.219145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaccd7-120f-437c-a2c2-584794e632d8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:08.219605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaccd7-120f-437c-a2c2-584794e632d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:08.220023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaccd7-120f-437c-a2c2-584794e632d8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:08.228450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebaccd7-120f-437c-a2c2-584794e632d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:08.230041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebaccd7-120f-437c-a2c2-584794e632d8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-aebaccd7-120f-437c-a2c2-584794e632d8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:08.245524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:08.246528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:08.247610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:08.247610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:08.247610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:08.247610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:08.247610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:08.247610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:08.247610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:08.247610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:08.247610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 20:24:08.247610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:08.247610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 334/644] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:24:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:08.248725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435f11-f0f0-4b36-b841-155fe8caade4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:08.248725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435f11-f0f0-4b36-b841-155fe8caade4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:08.248725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435f11-f0f0-4b36-b841-155fe8caade4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:08.266480 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ed435f11-f0f0-4b36-b841-155fe8caade4 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:08.267788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ed435f11-f0f0-4b36-b841-155fe8caade4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:08.290813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0feb947-5695-4e23-9129-edb2d3fd9bff None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:08.319772 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:08.328570 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a8500-546c-4d09-8721-7084ab64032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:08.329245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a8500-546c-4d09-8721-7084ab64032a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:08.329531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a8500-546c-4d09-8721-7084ab64032a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:08.329810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a8500-546c-4d09-8721-7084ab64032a None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:08.330556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a8500-546c-4d09-8721-7084ab64032a None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:08.330863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a8500-546c-4d09-8721-7084ab64032a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:08.332235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a8500-546c-4d09-8721-7084ab64032a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:08.341264 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 311/645] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:24:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:08.342046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a8500-546c-4d09-8721-7084ab64032a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:08.342610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 335/646] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:08.343955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed435f11-f0f0-4b36-b841-155fe8caade4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:08.419634 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:08.451556 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed435f11-f0f0-4b36-b841-155fe8caade4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:08.471330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a8500-546c-4d09-8721-7084ab64032a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:08.490002 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66173a-58b2-4782-90b0-a7871518dd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:08.490953 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66173a-58b2-4782-90b0-a7871518dd6c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:08.491437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66173a-58b2-4782-90b0-a7871518dd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:08.491964 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66173a-58b2-4782-90b0-a7871518dd6c None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:08.493027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66173a-58b2-4782-90b0-a7871518dd6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:08.493534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66173a-58b2-4782-90b0-a7871518dd6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:08.495380 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66173a-58b2-4782-90b0-a7871518dd6c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:08.506721 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037c855-c542-466e-ad3e-a4e2b472c589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:08.507603 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037c855-c542-466e-ad3e-a4e2b472c589 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:08.507882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037c855-c542-466e-ad3e-a4e2b472c589 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:08.508149 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037c855-c542-466e-ad3e-a4e2b472c589 None admin] PATH_INFO: `/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/4eed1d3c16354c8c9af8c01cb541c11c/roles/c81d50150272454fa5fe29cf1428c69e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:08.514512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 336/647] 10.222.0.66 () {56 vars in 1137 bytes} [Fri Jul 15 20:24:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:08.515528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66173a-58b2-4782-90b0-a7871518dd6c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:08.527105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037c855-c542-466e-ad3e-a4e2b472c589 None admin] RBAC: Authorizing `identity:create_grant(project_id=52dd45fcba114e3f8ff40d8b954ee5cc, user_id=4eed1d3c16354c8c9af8c01cb541c11c, role_id=c81d50150272454fa5fe29cf1428c69e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:08.528574 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037c855-c542-466e-ad3e-a4e2b472c589 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:08.544036 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 312/648] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:24:08 2022] PUT /identity/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/4eed1d3c16354c8c9af8c01cb541c11c/roles/c81d50150272454fa5fe29cf1428c69e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:24:08.544727 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037c855-c542-466e-ad3e-a4e2b472c589 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:08.606931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:08.670963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66173a-58b2-4782-90b0-a7871518dd6c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:08.690327 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037c855-c542-466e-ad3e-a4e2b472c589 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:08.711611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:08.726647 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91d8fc-fbed-48ab-93d9-f374c37f884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:08.727457 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91d8fc-fbed-48ab-93d9-f374c37f884b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:08.727745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91d8fc-fbed-48ab-93d9-f374c37f884b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:08.728024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91d8fc-fbed-48ab-93d9-f374c37f884b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:08.735984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e4452-6b52-471a-8e5a-2ff6f0586b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:08.736814 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e4452-6b52-471a-8e5a-2ff6f0586b7d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:08.737093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e4452-6b52-471a-8e5a-2ff6f0586b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:08.737943 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e4452-6b52-471a-8e5a-2ff6f0586b7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:08.738631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91d8fc-fbed-48ab-93d9-f374c37f884b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:08.740793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91d8fc-fbed-48ab-93d9-f374c37f884b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:08.761192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e4452-6b52-471a-8e5a-2ff6f0586b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ea91d8fc-fbed-48ab-93d9-f374c37f884b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:08.761544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:08.762873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:08.764064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:08.764064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:08.764064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:08.764064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:08.765623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 337/649] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:08.766526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91d8fc-fbed-48ab-93d9-f374c37f884b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-029e4452-6b52-471a-8e5a-2ff6f0586b7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:08.775709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:08.776961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:08.778008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:08.778008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:08.778008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:08.778008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:08.778008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:08.778008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:08.778008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:08.778008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:08.778008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:08.778008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:08.778008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:08.778008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:08.781043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 313/650] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:24:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:08.782012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e4452-6b52-471a-8e5a-2ff6f0586b7d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:08.883321 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91d8fc-fbed-48ab-93d9-f374c37f884b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:08.915261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:08.919409 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e4452-6b52-471a-8e5a-2ff6f0586b7d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:08.926677 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c96e0-0e6f-4aa9-ae20-9ad117b6c924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:08.927434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c96e0-0e6f-4aa9-ae20-9ad117b6c924 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:08.927990 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c96e0-0e6f-4aa9-ae20-9ad117b6c924 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:08.928342 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c96e0-0e6f-4aa9-ae20-9ad117b6c924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:08.960198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff799c-aa72-4ec8-af82-32f29a553eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:08.961249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff799c-aa72-4ec8-af82-32f29a553eeb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:08.961892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff799c-aa72-4ec8-af82-32f29a553eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:08.962382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff799c-aa72-4ec8-af82-32f29a553eeb None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:08.963445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff799c-aa72-4ec8-af82-32f29a553eeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:08.963973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff799c-aa72-4ec8-af82-32f29a553eeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:08.965718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff799c-aa72-4ec8-af82-32f29a553eeb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:08.980118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 314/651] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:08.980836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:08.982213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff799c-aa72-4ec8-af82-32f29a553eeb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:09.003415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c96e0-0e6f-4aa9-ae20-9ad117b6c924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:09.005480 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c96e0-0e6f-4aa9-ae20-9ad117b6c924 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:09.104948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff799c-aa72-4ec8-af82-32f29a553eeb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:09.116678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 338/652] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:24:09.117555 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c96e0-0e6f-4aa9-ae20-9ad117b6c924 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:09.146490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762b8cc-0309-48ec-bd7c-3f78cb605901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:09.147948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762b8cc-0309-48ec-bd7c-3f78cb605901 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:09.148586 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762b8cc-0309-48ec-bd7c-3f78cb605901 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:09.149085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762b8cc-0309-48ec-bd7c-3f78cb605901 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:09.150032 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762b8cc-0309-48ec-bd7c-3f78cb605901 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:09.150547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762b8cc-0309-48ec-bd7c-3f78cb605901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:09.152299 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762b8cc-0309-48ec-bd7c-3f78cb605901 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:09.161721 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 315/653] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:24:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:09.162945 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762b8cc-0309-48ec-bd7c-3f78cb605901 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:09.191517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:09.208156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:09.241879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c96e0-0e6f-4aa9-ae20-9ad117b6c924 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:09.278178 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74a86f-30c3-4013-bef4-e66c602e1605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:09.279341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74a86f-30c3-4013-bef4-e66c602e1605 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:09.279836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74a86f-30c3-4013-bef4-e66c602e1605 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:09.280321 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74a86f-30c3-4013-bef4-e66c602e1605 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:09.288119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74a86f-30c3-4013-bef4-e66c602e1605 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:09.290114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74a86f-30c3-4013-bef4-e66c602e1605 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:09.292569 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762b8cc-0309-48ec-bd7c-3f78cb605901 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-9b74a86f-30c3-4013-bef4-e66c602e1605 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:09.306503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:09.307516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:09.308617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:09.308617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:09.308617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:09.308617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:09.308617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:09.308617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:09.308617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:09.308617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:09.308617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 20:24:09.308617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:09.311282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 339/654] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:24:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:09.312368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74a86f-30c3-4013-bef4-e66c602e1605 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:09.332604 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f55e6-63d0-4651-8a1d-f648dc2119c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:09.333645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f55e6-63d0-4651-8a1d-f648dc2119c4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:09.333936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f55e6-63d0-4651-8a1d-f648dc2119c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:09.334218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f55e6-63d0-4651-8a1d-f648dc2119c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:09.345468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f55e6-63d0-4651-8a1d-f648dc2119c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:09.347013 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f55e6-63d0-4651-8a1d-f648dc2119c4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1d7f55e6-63d0-4651-8a1d-f648dc2119c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:09.365163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:09.366088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:09.366980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:09.366980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:09.366980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:09.366980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:09.366980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 316/655] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:09.367775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f55e6-63d0-4651-8a1d-f648dc2119c4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:09.428070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74a86f-30c3-4013-bef4-e66c602e1605 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:09.457353 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:09.486748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faceab-0420-4f4b-997e-2df0764b9554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:09.487583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faceab-0420-4f4b-997e-2df0764b9554 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:09.487958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faceab-0420-4f4b-997e-2df0764b9554 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:09.488142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faceab-0420-4f4b-997e-2df0764b9554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:09.491202 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f55e6-63d0-4651-8a1d-f648dc2119c4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:09.498071 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:09.501302 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faceab-0420-4f4b-997e-2df0764b9554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:09.503331 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faceab-0420-4f4b-997e-2df0764b9554 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-f9faceab-0420-4f4b-997e-2df0764b9554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:09.522899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:09.523853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:09.524773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:09.524773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:09.524773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:09.524773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:09.524773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 340/656] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:09.525586 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faceab-0420-4f4b-997e-2df0764b9554 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:09.536347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199925dc-2213-425d-aace-e5dacc012b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:09.537901 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199925dc-2213-425d-aace-e5dacc012b39 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:09.538682 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199925dc-2213-425d-aace-e5dacc012b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:09.539637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199925dc-2213-425d-aace-e5dacc012b39 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:09.540902 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199925dc-2213-425d-aace-e5dacc012b39 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:09.541544 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199925dc-2213-425d-aace-e5dacc012b39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:09.544194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199925dc-2213-425d-aace-e5dacc012b39 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:09.564688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 317/657] 10.222.0.66 () {56 vars in 1139 bytes} [Fri Jul 15 20:24:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:09.565838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199925dc-2213-425d-aace-e5dacc012b39 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:09.634804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faceab-0420-4f4b-997e-2df0764b9554 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:09.671203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e7556-a1fc-49e7-b3d0-520c63c9414a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:09.671878 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e7556-a1fc-49e7-b3d0-520c63c9414a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:09.672164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e7556-a1fc-49e7-b3d0-520c63c9414a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:09.672498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e7556-a1fc-49e7-b3d0-520c63c9414a None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:09.673274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e7556-a1fc-49e7-b3d0-520c63c9414a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:09.673584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e7556-a1fc-49e7-b3d0-520c63c9414a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:09.674213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199925dc-2213-425d-aace-e5dacc012b39 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:09.675014 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e7556-a1fc-49e7-b3d0-520c63c9414a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:09.687962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 341/658] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:09.688634 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e7556-a1fc-49e7-b3d0-520c63c9414a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:09.709304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:09.716278 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fa51d-9d4b-4e0f-b824-2a0be5251719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:09.717198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa51d-9d4b-4e0f-b824-2a0be5251719 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:09.717643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa51d-9d4b-4e0f-b824-2a0be5251719 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:09.718075 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa51d-9d4b-4e0f-b824-2a0be5251719 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:09.718954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fa51d-9d4b-4e0f-b824-2a0be5251719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:09.719421 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fa51d-9d4b-4e0f-b824-2a0be5251719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:09.720977 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fa51d-9d4b-4e0f-b824-2a0be5251719 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:09.733721 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 318/659] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:09.734747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fa51d-9d4b-4e0f-b824-2a0be5251719 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:09.746934 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:09.802841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e7556-a1fc-49e7-b3d0-520c63c9414a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:09.842820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba03a7-4cd8-41f1-a27f-2ec06226fb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:09.843508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba03a7-4cd8-41f1-a27f-2ec06226fb53 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:09.843796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba03a7-4cd8-41f1-a27f-2ec06226fb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:09.844075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba03a7-4cd8-41f1-a27f-2ec06226fb53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:09.870289 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fa51d-9d4b-4e0f-b824-2a0be5251719 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:09.914519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff92a7-f00f-4caa-9906-8b4ae136764f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:09.915851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff92a7-f00f-4caa-9906-8b4ae136764f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:09.916418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff92a7-f00f-4caa-9906-8b4ae136764f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:09.916713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff92a7-f00f-4caa-9906-8b4ae136764f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:09.917027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba03a7-4cd8-41f1-a27f-2ec06226fb53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:09.918692 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba03a7-4cd8-41f1-a27f-2ec06226fb53 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:09.925064 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff92a7-f00f-4caa-9906-8b4ae136764f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:09.926660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff92a7-f00f-4caa-9906-8b4ae136764f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3eff92a7-f00f-4caa-9906-8b4ae136764f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:09.946081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:09.946967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:09.947858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:09.947858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:09.947858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:09.947858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:09.947858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:09.947858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:09.947858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:09.947858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:09.948767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 319/660] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:09.950830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff92a7-f00f-4caa-9906-8b4ae136764f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:09.988770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:10.018601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:10.045624 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 342/661] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:24:10.046809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba03a7-4cd8-41f1-a27f-2ec06226fb53 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:10.076889 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff92a7-f00f-4caa-9906-8b4ae136764f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:10.119931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e0ffc-8814-4288-a21a-2552f86fb3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:10.120773 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0ffc-8814-4288-a21a-2552f86fb3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:10.121056 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0ffc-8814-4288-a21a-2552f86fb3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:10.121330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0ffc-8814-4288-a21a-2552f86fb3b2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:10.130207 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e0ffc-8814-4288-a21a-2552f86fb3b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:10.131647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e0ffc-8814-4288-a21a-2552f86fb3b2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-242e0ffc-8814-4288-a21a-2552f86fb3b2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:10.147679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:10.149281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:10.155365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:10.155365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:10.155365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:10.155365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:10.155365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:10.155365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:10.155365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:10.155365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:10.155365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:24:10.155365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:10.155365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 320/662] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:24:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:10.155365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb03bd0-5147-4cf5-9668-f2d65111ddaf None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:10.155365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb03bd0-5147-4cf5-9668-f2d65111ddaf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:10.156100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb03bd0-5147-4cf5-9668-f2d65111ddaf None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:10.156100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 321/663] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:10.156100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb03bd0-5147-4cf5-9668-f2d65111ddaf None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:10.159440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba03a7-4cd8-41f1-a27f-2ec06226fb53 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:10.197452 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663298aa-ffc8-4dba-b04d-17af9594aab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:10.198119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663298aa-ffc8-4dba-b04d-17af9594aab6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:10.198406 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663298aa-ffc8-4dba-b04d-17af9594aab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:10.198730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663298aa-ffc8-4dba-b04d-17af9594aab6 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:10.199518 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663298aa-ffc8-4dba-b04d-17af9594aab6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:10.199825 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663298aa-ffc8-4dba-b04d-17af9594aab6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:10.201300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663298aa-ffc8-4dba-b04d-17af9594aab6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:10.213535 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 343/664] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:10.218937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663298aa-ffc8-4dba-b04d-17af9594aab6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:10.235603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:10.266020 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb03bd0-5147-4cf5-9668-f2d65111ddaf None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:10.281121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:10.304120 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42355130-663a-44be-a1c2-48fae3e9fdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:10.304937 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42355130-663a-44be-a1c2-48fae3e9fdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:10.305220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42355130-663a-44be-a1c2-48fae3e9fdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:10.305494 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42355130-663a-44be-a1c2-48fae3e9fdd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:10.316040 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42355130-663a-44be-a1c2-48fae3e9fdd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:10.318469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42355130-663a-44be-a1c2-48fae3e9fdd2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:10.330323 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663298aa-ffc8-4dba-b04d-17af9594aab6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-42355130-663a-44be-a1c2-48fae3e9fdd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:10.336319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:10.337245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:10.338109 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:10.338109 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:10.338109 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:10.338109 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:10.340837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 322/665] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:10.341801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e2753-48e1-42f6-b16e-f829a5450b58 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:10.342087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e2753-48e1-42f6-b16e-f829a5450b58 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:10.342365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e2753-48e1-42f6-b16e-f829a5450b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:10.359361 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c70e2753-48e1-42f6-b16e-f829a5450b58 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:10.360359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c70e2753-48e1-42f6-b16e-f829a5450b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:10.367368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f53b60-144f-4d2f-9b63-174ff4b3e038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:10.368169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f53b60-144f-4d2f-9b63-174ff4b3e038 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:10.368483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f53b60-144f-4d2f-9b63-174ff4b3e038 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:10.368764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f53b60-144f-4d2f-9b63-174ff4b3e038 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:10.369603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f53b60-144f-4d2f-9b63-174ff4b3e038 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:10.369909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f53b60-144f-4d2f-9b63-174ff4b3e038 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:10.371339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f53b60-144f-4d2f-9b63-174ff4b3e038 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:10.390229 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 344/666] 10.222.0.66 () {56 vars in 1137 bytes} [Fri Jul 15 20:24:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:10.395503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f53b60-144f-4d2f-9b63-174ff4b3e038 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:10.444415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 323/667] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:10.444415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e2753-48e1-42f6-b16e-f829a5450b58 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:10.476953 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:10.509129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f53b60-144f-4d2f-9b63-174ff4b3e038 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:10.544671 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e1786-da3f-4eab-8484-768030b74b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:10.545333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e1786-da3f-4eab-8484-768030b74b28 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:10.545620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e1786-da3f-4eab-8484-768030b74b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:10.545898 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e1786-da3f-4eab-8484-768030b74b28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:10.546653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:10.546763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e1786-da3f-4eab-8484-768030b74b28 None admin] RBAC: Adding query filter params (role.id=c81d50150272454fa5fe29cf1428c69e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=93958c7dad0540b296b316169932d474) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:10.547040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e1786-da3f-4eab-8484-768030b74b28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:10.548874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e1786-da3f-4eab-8484-768030b74b28 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:10.555130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e2753-48e1-42f6-b16e-f829a5450b58 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:10.564570 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 345/668] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:10 2022] GET /identity/v3/role_assignments?user.id=93958c7dad0540b296b316169932d474&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=c81d50150272454fa5fe29cf1428c69e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:10.564570 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e1786-da3f-4eab-8484-768030b74b28 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:10.597220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309791f6-0fa3-42ad-b0d8-109c09cddf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:10.597870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309791f6-0fa3-42ad-b0d8-109c09cddf45 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:10.598156 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309791f6-0fa3-42ad-b0d8-109c09cddf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:10.598433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309791f6-0fa3-42ad-b0d8-109c09cddf45 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:10.599774 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309791f6-0fa3-42ad-b0d8-109c09cddf45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:10.600081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309791f6-0fa3-42ad-b0d8-109c09cddf45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:10.601540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309791f6-0fa3-42ad-b0d8-109c09cddf45 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:10.614967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 324/669] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:10.616216 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309791f6-0fa3-42ad-b0d8-109c09cddf45 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:10.702163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e1786-da3f-4eab-8484-768030b74b28 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:10.735222 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309791f6-0fa3-42ad-b0d8-109c09cddf45 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:10.742582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979565cd-5a98-421d-9bc0-44d9dc5a7ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:10.743235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979565cd-5a98-421d-9bc0-44d9dc5a7ede None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:10.743546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979565cd-5a98-421d-9bc0-44d9dc5a7ede None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:10.743796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979565cd-5a98-421d-9bc0-44d9dc5a7ede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:10.747031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:10.777318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2a2d4-e84e-4e12-b691-ada0d4c7dcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:10.778137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2a2d4-e84e-4e12-b691-ada0d4c7dcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:10.778420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2a2d4-e84e-4e12-b691-ada0d4c7dcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:10.778694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2a2d4-e84e-4e12-b691-ada0d4c7dcc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:10.791955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2a2d4-e84e-4e12-b691-ada0d4c7dcc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f5f2a2d4-e84e-4e12-b691-ada0d4c7dcc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:10.802342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:10.803521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:10.804490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:10.804490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:10.804490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:10.804490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:10.804490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:10.804490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:10.804490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:10.804490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:10.804490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:10.804490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:10.804490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:24:10.804490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:10.806897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 325/670] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:24:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:10.807925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2a2d4-e84e-4e12-b691-ada0d4c7dcc2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:10.826401 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:10.831665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979565cd-5a98-421d-9bc0-44d9dc5a7ede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:10.833741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979565cd-5a98-421d-9bc0-44d9dc5a7ede None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:10.927429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2a2d4-e84e-4e12-b691-ada0d4c7dcc2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:10.940262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 346/671] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:24:10.941711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22db3a-51b7-45ec-abf5-bd5bc544a0ec None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:10.942007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22db3a-51b7-45ec-abf5-bd5bc544a0ec None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:10.942428 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22db3a-51b7-45ec-abf5-bd5bc544a0ec None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:10.944147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 347/672] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:10.948763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22db3a-51b7-45ec-abf5-bd5bc544a0ec None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:10.965345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1488f9a-6326-40b8-8773-6c4cff3110b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:10.966168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1488f9a-6326-40b8-8773-6c4cff3110b5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:10.966453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1488f9a-6326-40b8-8773-6c4cff3110b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:10.966736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1488f9a-6326-40b8-8773-6c4cff3110b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:10.974854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1488f9a-6326-40b8-8773-6c4cff3110b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:10.976536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1488f9a-6326-40b8-8773-6c4cff3110b5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:10.988556 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e1488f9a-6326-40b8-8773-6c4cff3110b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:10.991037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:10.992173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:10.993555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:10.993555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:10.993555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:10.993555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:10.993555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:10.993555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:10.993555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:10.993555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:10.996906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 326/673] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:10.997649 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1488f9a-6326-40b8-8773-6c4cff3110b5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:11.060193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22db3a-51b7-45ec-abf5-bd5bc544a0ec None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:11.079285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:11.100069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e19fb0-a2bb-4c8f-8939-2b09024ec6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:11.100783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19fb0-a2bb-4c8f-8939-2b09024ec6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:11.101073 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19fb0-a2bb-4c8f-8939-2b09024ec6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:11.101356 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19fb0-a2bb-4c8f-8939-2b09024ec6d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:11.102105 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e19fb0-a2bb-4c8f-8939-2b09024ec6d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:11.102666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e19fb0-a2bb-4c8f-8939-2b09024ec6d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:11.105365 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e19fb0-a2bb-4c8f-8939-2b09024ec6d2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:11.112063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1488f9a-6326-40b8-8773-6c4cff3110b5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:11.116197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 348/674] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:24:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:11.116715 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b59a33-3c77-4c41-b189-fe8a8b9daf3c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:11.117011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b59a33-3c77-4c41-b189-fe8a8b9daf3c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:11.117294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b59a33-3c77-4c41-b189-fe8a8b9daf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:11.134073 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-91b59a33-3c77-4c41-b189-fe8a8b9daf3c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:11.135282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-91b59a33-3c77-4c41-b189-fe8a8b9daf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:11.163364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be8357-0974-4b40-8da1-d7839c301637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:11.165202 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be8357-0974-4b40-8da1-d7839c301637 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:11.165766 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be8357-0974-4b40-8da1-d7839c301637 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:11.166523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be8357-0974-4b40-8da1-d7839c301637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:11.179939 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be8357-0974-4b40-8da1-d7839c301637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:11.182304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be8357-0974-4b40-8da1-d7839c301637 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b1be8357-0974-4b40-8da1-d7839c301637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:11.202203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:11.203144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:11.204053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:11.204053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:11.204053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:11.204053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:11.208757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 327/675] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:11.209762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be8357-0974-4b40-8da1-d7839c301637 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:11.210852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 349/676] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:11.211649 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b59a33-3c77-4c41-b189-fe8a8b9daf3c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:11.239769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:11.322769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b59a33-3c77-4c41-b189-fe8a8b9daf3c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:11.324119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be8357-0974-4b40-8da1-d7839c301637 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:11.351063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:11.360212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd881e-8904-4857-ab08-ef93e4ed1671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:11.360912 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd881e-8904-4857-ab08-ef93e4ed1671 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:11.361202 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd881e-8904-4857-ab08-ef93e4ed1671 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:11.361483 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd881e-8904-4857-ab08-ef93e4ed1671 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:11.361976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38536f-5f4f-4d50-80a1-1e97d2e7da65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:11.362274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd881e-8904-4857-ab08-ef93e4ed1671 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:11.362585 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd881e-8904-4857-ab08-ef93e4ed1671 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:11.363263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38536f-5f4f-4d50-80a1-1e97d2e7da65 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:11.363702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38536f-5f4f-4d50-80a1-1e97d2e7da65 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:11.364089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd881e-8904-4857-ab08-ef93e4ed1671 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:11.364897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38536f-5f4f-4d50-80a1-1e97d2e7da65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:11.376353 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 328/677] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:11.377062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38536f-5f4f-4d50-80a1-1e97d2e7da65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:11.377178 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd881e-8904-4857-ab08-ef93e4ed1671 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:11.378945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38536f-5f4f-4d50-80a1-1e97d2e7da65 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-5d38536f-5f4f-4d50-80a1-1e97d2e7da65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:11.400060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:11.401195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:11.402287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:11.402287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:11.402287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:11.402287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:11.404158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 350/678] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:11.405185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38536f-5f4f-4d50-80a1-1e97d2e7da65 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:11.494322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd881e-8904-4857-ab08-ef93e4ed1671 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:11.500705 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:11.526451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38536f-5f4f-4d50-80a1-1e97d2e7da65 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:11.533517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addb53c-c0ef-4e2c-8d65-71fe7dc88151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:11.534180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addb53c-c0ef-4e2c-8d65-71fe7dc88151 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:11.534472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addb53c-c0ef-4e2c-8d65-71fe7dc88151 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:11.534759 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addb53c-c0ef-4e2c-8d65-71fe7dc88151 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:11.535480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addb53c-c0ef-4e2c-8d65-71fe7dc88151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:11.535787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addb53c-c0ef-4e2c-8d65-71fe7dc88151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:11.537896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addb53c-c0ef-4e2c-8d65-71fe7dc88151 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:11.549896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 329/679] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:11.550573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addb53c-c0ef-4e2c-8d65-71fe7dc88151 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:11.569922 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2059c1a-a178-410e-b66b-7db2e61ad6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:11.571017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2059c1a-a178-410e-b66b-7db2e61ad6df None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:11.571865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2059c1a-a178-410e-b66b-7db2e61ad6df None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:11.571865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2059c1a-a178-410e-b66b-7db2e61ad6df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:11.586034 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2059c1a-a178-410e-b66b-7db2e61ad6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e2059c1a-a178-410e-b66b-7db2e61ad6df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:11.593809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:11.594752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:11.601750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:11.601750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:11.601750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:11.601750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:11.601750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:11.601750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:11.601750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:11.601750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:11.601750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:11.601750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:11.601750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:11.601750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:11.601750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 351/680] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:24:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:11.601750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2059c1a-a178-410e-b66b-7db2e61ad6df None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:11.609436 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:11.669068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addb53c-c0ef-4e2c-8d65-71fe7dc88151 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:11.705950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cfdf3-17d0-4295-a811-20576af283cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:11.706603 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cfdf3-17d0-4295-a811-20576af283cf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:11.706889 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cfdf3-17d0-4295-a811-20576af283cf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:11.707172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cfdf3-17d0-4295-a811-20576af283cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:11.709235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cfdf3-17d0-4295-a811-20576af283cf None admin] RBAC: Adding query filter params (role.id=c81d50150272454fa5fe29cf1428c69e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=633e05f021544b669749f941f40cbf58) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:11.709562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cfdf3-17d0-4295-a811-20576af283cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:11.711012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cfdf3-17d0-4295-a811-20576af283cf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:11.714094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2059c1a-a178-410e-b66b-7db2e61ad6df None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:11.728836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 330/681] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:11 2022] GET /identity/v3/role_assignments?user.id=633e05f021544b669749f941f40cbf58&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=c81d50150272454fa5fe29cf1428c69e => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:11.730476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cfdf3-17d0-4295-a811-20576af283cf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:11.755877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa06c2-3bba-490e-bdde-90038a50ec90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:11.757071 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa06c2-3bba-490e-bdde-90038a50ec90 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:11.757576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa06c2-3bba-490e-bdde-90038a50ec90 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:11.758042 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa06c2-3bba-490e-bdde-90038a50ec90 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:11.759026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa06c2-3bba-490e-bdde-90038a50ec90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:11.759594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa06c2-3bba-490e-bdde-90038a50ec90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:11.761273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa06c2-3bba-490e-bdde-90038a50ec90 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:11.770115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:11.777234 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 352/682] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:11.778611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa06c2-3bba-490e-bdde-90038a50ec90 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:11.891691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cfdf3-17d0-4295-a811-20576af283cf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:11.903929 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:11.906853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa06c2-3bba-490e-bdde-90038a50ec90 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:11.932478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68dc37-395a-48e0-a735-40c78e34d440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:11.933388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68dc37-395a-48e0-a735-40c78e34d440 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:11.933676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68dc37-395a-48e0-a735-40c78e34d440 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:11.934138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68dc37-395a-48e0-a735-40c78e34d440 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:11.941581 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68dc37-395a-48e0-a735-40c78e34d440 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:11.945055 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68dc37-395a-48e0-a735-40c78e34d440 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:11.957041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eee1b-a929-4d97-bdc9-f0c240bac563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:11.958572 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eee1b-a929-4d97-bdc9-f0c240bac563 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:11.959389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eee1b-a929-4d97-bdc9-f0c240bac563 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:11.959677 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eee1b-a929-4d97-bdc9-f0c240bac563 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-fd68dc37-395a-48e0-a735-40c78e34d440 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:11.960124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:11.961136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:11.962026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:11.962026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:11.962026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:11.962026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:11.962026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:11.962026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:11.962026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:11.962026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:11.962463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91eee1b-a929-4d97-bdc9-f0c240bac563 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:11.962463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91eee1b-a929-4d97-bdc9-f0c240bac563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:11.962463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91eee1b-a929-4d97-bdc9-f0c240bac563 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:11.962652 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 331/683] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:11.967808 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68dc37-395a-48e0-a735-40c78e34d440 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:11.977554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 353/684] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:24:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:11.979423 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eee1b-a929-4d97-bdc9-f0c240bac563 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:12.050019 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:12.095760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eee1b-a929-4d97-bdc9-f0c240bac563 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:12.109679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68dc37-395a-48e0-a735-40c78e34d440 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:12.135603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495991b7-6ebc-4ccd-9f6c-cf2919d1fb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:12.136159 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495991b7-6ebc-4ccd-9f6c-cf2919d1fb6e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:12.136479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495991b7-6ebc-4ccd-9f6c-cf2919d1fb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:12.136764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495991b7-6ebc-4ccd-9f6c-cf2919d1fb6e None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:12.137702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495991b7-6ebc-4ccd-9f6c-cf2919d1fb6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:12.137924 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495991b7-6ebc-4ccd-9f6c-cf2919d1fb6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:12.139362 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495991b7-6ebc-4ccd-9f6c-cf2919d1fb6e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:12.152607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a11440-4887-4777-92b3-dcb2277eabe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:12.153168 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 354/685] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:12.154022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a11440-4887-4777-92b3-dcb2277eabe5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:12.154132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495991b7-6ebc-4ccd-9f6c-cf2919d1fb6e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:12.154602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a11440-4887-4777-92b3-dcb2277eabe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:12.155095 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a11440-4887-4777-92b3-dcb2277eabe5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:12.164026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a11440-4887-4777-92b3-dcb2277eabe5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:12.166602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a11440-4887-4777-92b3-dcb2277eabe5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-17a11440-4887-4777-92b3-dcb2277eabe5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:12.183782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:12.184870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:12.186029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:12.186029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:12.186029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:12.186029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:12.186029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:12.186029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:12.186029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:12.186029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:12.186029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:24:12.186029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:12.188374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 332/686] 10.222.0.66 () {56 vars in 1093 bytes} [Fri Jul 15 20:24:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:12.189544 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a11440-4887-4777-92b3-dcb2277eabe5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:12.222827 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:12.265002 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495991b7-6ebc-4ccd-9f6c-cf2919d1fb6e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:12.288565 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:12.304732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d66e4-1dae-4d5c-b27d-aaaae18c76f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:12.305463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d66e4-1dae-4d5c-b27d-aaaae18c76f5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:12.305749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d66e4-1dae-4d5c-b27d-aaaae18c76f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:12.306027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d66e4-1dae-4d5c-b27d-aaaae18c76f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:12.306364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a11440-4887-4777-92b3-dcb2277eabe5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:12.317637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d66e4-1dae-4d5c-b27d-aaaae18c76f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:12.319429 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d66e4-1dae-4d5c-b27d-aaaae18c76f5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-8b8d66e4-1dae-4d5c-b27d-aaaae18c76f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:12.338319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:12.339258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:12.340143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:12.340143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:12.340143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:12.340143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:12.344256 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 355/687] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:12.345151 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d66e4-1dae-4d5c-b27d-aaaae18c76f5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:12.347988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ee00f-2b60-4e0a-8d82-74d5e2af161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:12.349520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ee00f-2b60-4e0a-8d82-74d5e2af161f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:12.350021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ee00f-2b60-4e0a-8d82-74d5e2af161f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:12.350560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ee00f-2b60-4e0a-8d82-74d5e2af161f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:12.351610 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ee00f-2b60-4e0a-8d82-74d5e2af161f None admin] RBAC: Adding query filter params (role.id=c81d50150272454fa5fe29cf1428c69e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=1d4739b31f6647d89132f79f3f811d02) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:12.352122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ee00f-2b60-4e0a-8d82-74d5e2af161f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:12.353801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ee00f-2b60-4e0a-8d82-74d5e2af161f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:12.361370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 333/688] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:12 2022] GET /identity/v3/role_assignments?user.id=1d4739b31f6647d89132f79f3f811d02&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=c81d50150272454fa5fe29cf1428c69e => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:12.362730 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ee00f-2b60-4e0a-8d82-74d5e2af161f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:12.491391 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:12.500782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ee00f-2b60-4e0a-8d82-74d5e2af161f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:12.543608 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67306f88-4b64-47b2-910c-c9424c57338b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:12.544698 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67306f88-4b64-47b2-910c-c9424c57338b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:12.545845 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67306f88-4b64-47b2-910c-c9424c57338b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:12.546330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67306f88-4b64-47b2-910c-c9424c57338b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:12.547403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67306f88-4b64-47b2-910c-c9424c57338b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:12.547932 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67306f88-4b64-47b2-910c-c9424c57338b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:12.549850 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67306f88-4b64-47b2-910c-c9424c57338b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:12.564105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 334/689] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:12.571279 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67306f88-4b64-47b2-910c-c9424c57338b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:12.593363 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d66e4-1dae-4d5c-b27d-aaaae18c76f5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:12.652779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33374ddb-3bb5-461c-aa3f-05e324ec0525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:12.653835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374ddb-3bb5-461c-aa3f-05e324ec0525 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:12.654573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374ddb-3bb5-461c-aa3f-05e324ec0525 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:12.655259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374ddb-3bb5-461c-aa3f-05e324ec0525 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:12.657128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33374ddb-3bb5-461c-aa3f-05e324ec0525 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:12.657795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33374ddb-3bb5-461c-aa3f-05e324ec0525 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:12.659856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33374ddb-3bb5-461c-aa3f-05e324ec0525 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:12.683936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 356/690] 10.222.0.66 () {56 vars in 1133 bytes} [Fri Jul 15 20:24:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:12.689065 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33374ddb-3bb5-461c-aa3f-05e324ec0525 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:12.721025 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67306f88-4b64-47b2-910c-c9424c57338b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:12.730103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:12.761502 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aeda3-481b-400e-97c3-07bc165de1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:12.762409 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aeda3-481b-400e-97c3-07bc165de1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:12.762700 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aeda3-481b-400e-97c3-07bc165de1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:12.762978 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aeda3-481b-400e-97c3-07bc165de1e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:12.774830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52aeda3-481b-400e-97c3-07bc165de1e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:12.776417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52aeda3-481b-400e-97c3-07bc165de1e6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b52aeda3-481b-400e-97c3-07bc165de1e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:12.793981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:12.794981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:12.796011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:12.796011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:12.796011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:12.796011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:12.796011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:12.796011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:12.796011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:12.796011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:12.796011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 20:24:12.796011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:12.796011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 335/691] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:24:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:12.802257 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8831a63-195b-49ef-a8df-04d380048d2d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:12.802557 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8831a63-195b-49ef-a8df-04d380048d2d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:12.802943 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8831a63-195b-49ef-a8df-04d380048d2d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:12.804677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 336/692] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:12.805408 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8831a63-195b-49ef-a8df-04d380048d2d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:12.823933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33374ddb-3bb5-461c-aa3f-05e324ec0525 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:12.824711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:12.865864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9793df-91b4-4403-9fc5-4bffbc551fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:12.866658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9793df-91b4-4403-9fc5-4bffbc551fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:12.867011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9793df-91b4-4403-9fc5-4bffbc551fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:12.867362 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9793df-91b4-4403-9fc5-4bffbc551fa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:12.936292 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8831a63-195b-49ef-a8df-04d380048d2d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:12.949235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9793df-91b4-4403-9fc5-4bffbc551fa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:12.950828 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9793df-91b4-4403-9fc5-4bffbc551fa5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:12.972992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe3de5-3db8-4d5c-a776-c484669c67ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:12.974443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3de5-3db8-4d5c-a776-c484669c67ff None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:12.974798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3de5-3db8-4d5c-a776-c484669c67ff None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:12.975150 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3de5-3db8-4d5c-a776-c484669c67ff None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:12.976099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe3de5-3db8-4d5c-a776-c484669c67ff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:12.976514 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe3de5-3db8-4d5c-a776-c484669c67ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:12.978037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe3de5-3db8-4d5c-a776-c484669c67ff None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:12.984164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:12.999677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 337/693] 10.222.0.66 () {56 vars in 1135 bytes} [Fri Jul 15 20:24:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:13.005602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e748110-321e-48cc-aca3-bfe625df423a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:13.005962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e748110-321e-48cc-aca3-bfe625df423a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:13.006315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e748110-321e-48cc-aca3-bfe625df423a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:13.023586 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4e748110-321e-48cc-aca3-bfe625df423a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:13.024834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4e748110-321e-48cc-aca3-bfe625df423a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:13.076671 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 357/694] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 20:24:13.077496 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9793df-91b4-4403-9fc5-4bffbc551fa5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:13.112851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 338/695] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:13.113719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e748110-321e-48cc-aca3-bfe625df423a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:13.122322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:13.226945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9793df-91b4-4403-9fc5-4bffbc551fa5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:13.242484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e748110-321e-48cc-aca3-bfe625df423a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:13.265373 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:13.274320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b6c67-0986-4037-a64f-1cefde3c63b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:13.275232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b6c67-0986-4037-a64f-1cefde3c63b6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:13.275519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b6c67-0986-4037-a64f-1cefde3c63b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:13.276033 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b6c67-0986-4037-a64f-1cefde3c63b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:13.281820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f985bd-3b7d-4430-94c7-769898f2ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:13.282691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f985bd-3b7d-4430-94c7-769898f2ea6c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:13.283044 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f985bd-3b7d-4430-94c7-769898f2ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:13.283412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f985bd-3b7d-4430-94c7-769898f2ea6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:13.295826 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f985bd-3b7d-4430-94c7-769898f2ea6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:13.297553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f985bd-3b7d-4430-94c7-769898f2ea6c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-54f985bd-3b7d-4430-94c7-769898f2ea6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:13.316680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:13.318644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:13.320677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:13.320677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:13.320677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:13.320677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:13.320677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 339/696] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:13.321319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f985bd-3b7d-4430-94c7-769898f2ea6c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:13.359378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b6c67-0986-4037-a64f-1cefde3c63b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:13.360780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b6c67-0986-4037-a64f-1cefde3c63b6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:13.399044 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:13.462031 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f985bd-3b7d-4430-94c7-769898f2ea6c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:13.492728 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 358/697] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:24:13.493842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b6c67-0986-4037-a64f-1cefde3c63b6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:13.507836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b33e6a-a38a-42f9-ba21-fc229362665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:13.509235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b33e6a-a38a-42f9-ba21-fc229362665a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:13.509628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b33e6a-a38a-42f9-ba21-fc229362665a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:13.510002 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b33e6a-a38a-42f9-ba21-fc229362665a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:13.524985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b33e6a-a38a-42f9-ba21-fc229362665a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:13.527293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b33e6a-a38a-42f9-ba21-fc229362665a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:13.528289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d3b33e6a-a38a-42f9-ba21-fc229362665a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:13.553233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:13.554330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:13.555217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:13.555217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:13.555217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:13.555217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:13.560534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 340/698] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:13.561605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b33e6a-a38a-42f9-ba21-fc229362665a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:13.617393 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b6c67-0986-4037-a64f-1cefde3c63b6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:13.655413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e7bb6-f078-4699-b830-ae1d03a379c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:13.656462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e7bb6-f078-4699-b830-ae1d03a379c5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:13.656948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e7bb6-f078-4699-b830-ae1d03a379c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:13.657409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e7bb6-f078-4699-b830-ae1d03a379c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:13.658523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e7bb6-f078-4699-b830-ae1d03a379c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:13.659069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e7bb6-f078-4699-b830-ae1d03a379c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:13.660638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e7bb6-f078-4699-b830-ae1d03a379c5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:13.675000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 359/699] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:13.676226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e7bb6-f078-4699-b830-ae1d03a379c5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:13.689041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b33e6a-a38a-42f9-ba21-fc229362665a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:13.697076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:13.728991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf85db1-172c-41e1-ad90-7f42caf14d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:13.729605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf85db1-172c-41e1-ad90-7f42caf14d74 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:13.729979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf85db1-172c-41e1-ad90-7f42caf14d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:13.730329 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf85db1-172c-41e1-ad90-7f42caf14d74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:13.741041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf85db1-172c-41e1-ad90-7f42caf14d74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:13.742594 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf85db1-172c-41e1-ad90-7f42caf14d74 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-bcf85db1-172c-41e1-ad90-7f42caf14d74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:13.760870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:13.761817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:13.762696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:13.762696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:13.762696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:13.762696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:13.766675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 341/700] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:13.767521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf85db1-172c-41e1-ad90-7f42caf14d74 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:13.786144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:13.798700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e7bb6-f078-4699-b830-ae1d03a379c5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:13.837137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ed8e0-72c8-42d0-a7b0-37c517c64800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:13.838189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ed8e0-72c8-42d0-a7b0-37c517c64800 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:13.838680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ed8e0-72c8-42d0-a7b0-37c517c64800 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:13.839158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ed8e0-72c8-42d0-a7b0-37c517c64800 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:13.840154 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ed8e0-72c8-42d0-a7b0-37c517c64800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:13.840738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ed8e0-72c8-42d0-a7b0-37c517c64800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:13.842328 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ed8e0-72c8-42d0-a7b0-37c517c64800 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:13.856151 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 360/701] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:13.857384 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ed8e0-72c8-42d0-a7b0-37c517c64800 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:13.877926 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf85db1-172c-41e1-ad90-7f42caf14d74 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:13.914575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3bf37-a07a-41d1-9d25-2de5b3307f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:13.915373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3bf37-a07a-41d1-9d25-2de5b3307f56 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:13.915658 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3bf37-a07a-41d1-9d25-2de5b3307f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:13.915934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3bf37-a07a-41d1-9d25-2de5b3307f56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:13.923378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3bf37-a07a-41d1-9d25-2de5b3307f56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:13.925229 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3bf37-a07a-41d1-9d25-2de5b3307f56 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-62d3bf37-a07a-41d1-9d25-2de5b3307f56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:13.939346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:13.940259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:13.941175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:13.941175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:13.941175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:13.941175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:13.941175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:13.941175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:13.941175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:13.941175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:13.943963 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 342/702] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:13.944574 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3bf37-a07a-41d1-9d25-2de5b3307f56 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:13.966172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:13.972165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ed8e0-72c8-42d0-a7b0-37c517c64800 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:14.010457 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f7617-77b6-4330-bb55-94a28675c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:14.011059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f7617-77b6-4330-bb55-94a28675c689 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:14.011346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f7617-77b6-4330-bb55-94a28675c689 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:14.011663 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f7617-77b6-4330-bb55-94a28675c689 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:14.012354 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f7617-77b6-4330-bb55-94a28675c689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:14.012680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f7617-77b6-4330-bb55-94a28675c689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:14.014056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f7617-77b6-4330-bb55-94a28675c689 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:14.030679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 361/703] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:14.030679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945e4c7-f0e4-404e-abb8-cd76cf4f5f14 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:14.030679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945e4c7-f0e4-404e-abb8-cd76cf4f5f14 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:14.030679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945e4c7-f0e4-404e-abb8-cd76cf4f5f14 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:14.030679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 362/704] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:14.030679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945e4c7-f0e4-404e-abb8-cd76cf4f5f14 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:14.045053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:14.060078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3bf37-a07a-41d1-9d25-2de5b3307f56 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:14.104299 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb45209-dc48-46ab-82f7-6d0424da15c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:14.105580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45209-dc48-46ab-82f7-6d0424da15c4 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:14.105876 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45209-dc48-46ab-82f7-6d0424da15c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:14.106158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45209-dc48-46ab-82f7-6d0424da15c4 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:14.107154 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb45209-dc48-46ab-82f7-6d0424da15c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:14.109734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb45209-dc48-46ab-82f7-6d0424da15c4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:14.135583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 343/705] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:24:13 2022] POST /identity/v3/users => generated 254 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:24:14.136360 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb45209-dc48-46ab-82f7-6d0424da15c4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:14.149405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945e4c7-f0e4-404e-abb8-cd76cf4f5f14 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:14.193673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92ff92-4220-435b-9abb-c2e1346d7ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:14.194859 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ff92-4220-435b-9abb-c2e1346d7ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:14.195248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ff92-4220-435b-9abb-c2e1346d7ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:14.195626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ff92-4220-435b-9abb-c2e1346d7ec5 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:14.196698 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92ff92-4220-435b-9abb-c2e1346d7ec5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:14.197125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92ff92-4220-435b-9abb-c2e1346d7ec5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:14.199014 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92ff92-4220-435b-9abb-c2e1346d7ec5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:14.215490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 363/706] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:14.216644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368952f-bec9-49c3-b6c0-c90bdd59e726 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:14.217000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368952f-bec9-49c3-b6c0-c90bdd59e726 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:14.217285 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368952f-bec9-49c3-b6c0-c90bdd59e726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:14.237436 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4368952f-bec9-49c3-b6c0-c90bdd59e726 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:14.238573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4368952f-bec9-49c3-b6c0-c90bdd59e726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:14.270462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:14.315451 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb45209-dc48-46ab-82f7-6d0424da15c4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:14.325032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:14.330805 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 364/707] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:14.331621 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368952f-bec9-49c3-b6c0-c90bdd59e726 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:14.359498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82d7ab-fc7d-43bd-bf1b-c19a3fe042d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:14.360720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82d7ab-fc7d-43bd-bf1b-c19a3fe042d0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:14.361295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82d7ab-fc7d-43bd-bf1b-c19a3fe042d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:14.362245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82d7ab-fc7d-43bd-bf1b-c19a3fe042d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:14.374335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82d7ab-fc7d-43bd-bf1b-c19a3fe042d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:14.375451 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82d7ab-fc7d-43bd-bf1b-c19a3fe042d0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-bc82d7ab-fc7d-43bd-bf1b-c19a3fe042d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:14.396051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:14.397291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:14.398194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:14.398194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:14.398194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:14.398194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:14.398194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:14.398194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:14.398194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:14.398194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:14.398194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 344/708] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:14.404906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82d7ab-fc7d-43bd-bf1b-c19a3fe042d0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:14.474632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368952f-bec9-49c3-b6c0-c90bdd59e726 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:14.521127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b84fec-a756-40ec-a236-378c43708830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:14.522264 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84fec-a756-40ec-a236-378c43708830 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:14.523989 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84fec-a756-40ec-a236-378c43708830 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:14.524339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84fec-a756-40ec-a236-378c43708830 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:14.526053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b84fec-a756-40ec-a236-378c43708830 None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=b042da9298894712a0a29787a343bf85) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:14.527244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b84fec-a756-40ec-a236-378c43708830 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:14.528819 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b84fec-a756-40ec-a236-378c43708830 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:14.535109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 365/709] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:14 2022] GET /identity/v3/role_assignments?user.id=b042da9298894712a0a29787a343bf85&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=43e0afe364894278be44a97662ca6f8e => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:14.544689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b84fec-a756-40ec-a236-378c43708830 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:14.548580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82d7ab-fc7d-43bd-bf1b-c19a3fe042d0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:14.587536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebdf13-8daa-48a7-839f-2fe525ccbed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:14.588693 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebdf13-8daa-48a7-839f-2fe525ccbed5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:14.589115 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebdf13-8daa-48a7-839f-2fe525ccbed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:14.589537 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebdf13-8daa-48a7-839f-2fe525ccbed5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:14.590357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebdf13-8daa-48a7-839f-2fe525ccbed5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:14.591997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebdf13-8daa-48a7-839f-2fe525ccbed5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:14.594375 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ffebdf13-8daa-48a7-839f-2fe525ccbed5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:14.609008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:14.610215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:14.611218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:14.611218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:14.611218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:14.611218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:14.611218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:14.611218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:14.611218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:14.611218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:14.611218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:14.611218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:14.611218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:14.611218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:14.611218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:24:14.611218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:14.613888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 345/710] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:14 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:14.620160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebdf13-8daa-48a7-839f-2fe525ccbed5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:14.667609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:14.727376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b84fec-a756-40ec-a236-378c43708830 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:14.740966 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebdf13-8daa-48a7-839f-2fe525ccbed5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:14.768131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efe29a-2711-41a8-a185-b26643b43cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:14.769623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efe29a-2711-41a8-a185-b26643b43cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:14.770061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efe29a-2711-41a8-a185-b26643b43cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:14.771028 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efe29a-2711-41a8-a185-b26643b43cd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:14.772477 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efe29a-2711-41a8-a185-b26643b43cd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:14.773088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efe29a-2711-41a8-a185-b26643b43cd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:14.774949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efe29a-2711-41a8-a185-b26643b43cd2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:14.780547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05404d12-9017-4598-af24-f0cd1f7ff226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:14.781294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05404d12-9017-4598-af24-f0cd1f7ff226 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:14.781651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05404d12-9017-4598-af24-f0cd1f7ff226 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:14.781999 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05404d12-9017-4598-af24-f0cd1f7ff226 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:14.782798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05404d12-9017-4598-af24-f0cd1f7ff226 None admin] RBAC: Adding query filter params (name=network) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:14.783171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05404d12-9017-4598-af24-f0cd1f7ff226 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:14.785123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05404d12-9017-4598-af24-f0cd1f7ff226 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:14.791597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 366/711] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:14.793159 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94a2e2-d52d-4a5c-81b3-88871a63a0f1 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:14.793600 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94a2e2-d52d-4a5c-81b3-88871a63a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:14.794032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94a2e2-d52d-4a5c-81b3-88871a63a0f1 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:14.795679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 367/712] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:14.796326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 346/713] 10.222.0.66 () {56 vars in 1112 bytes} [Fri Jul 15 20:24:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:14.796901 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94a2e2-d52d-4a5c-81b3-88871a63a0f1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:14.797529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05404d12-9017-4598-af24-f0cd1f7ff226 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:14.872832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:14.912598 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94a2e2-d52d-4a5c-81b3-88871a63a0f1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:14.916615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05404d12-9017-4598-af24-f0cd1f7ff226 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:14.939964 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:14.954201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d89878-eb8d-430b-8068-070d39f18207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:14.954966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d89878-eb8d-430b-8068-070d39f18207 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:14.955307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d89878-eb8d-430b-8068-070d39f18207 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:14.955653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d89878-eb8d-430b-8068-070d39f18207 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:14.956581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d89878-eb8d-430b-8068-070d39f18207 None admin] RBAC: Adding query filter params (type=network) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:14.956762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7054726-a089-4095-a9c9-486d2d0d37b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:14.957010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d89878-eb8d-430b-8068-070d39f18207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:14.958344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7054726-a089-4095-a9c9-486d2d0d37b4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:14.958972 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7054726-a089-4095-a9c9-486d2d0d37b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:14.959197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d89878-eb8d-430b-8068-070d39f18207 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:14.959547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7054726-a089-4095-a9c9-486d2d0d37b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:14.960673 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7054726-a089-4095-a9c9-486d2d0d37b4 None admin] RBAC: Adding query filter params (role.id=c81d50150272454fa5fe29cf1428c69e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=4eed1d3c16354c8c9af8c01cb541c11c) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:14.961132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7054726-a089-4095-a9c9-486d2d0d37b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:14.962802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7054726-a089-4095-a9c9-486d2d0d37b4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:14.966290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 368/714] 10.222.0.66 () {56 vars in 1112 bytes} [Fri Jul 15 20:24:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:14.967412 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de831f-6dd4-44c4-b08c-e86dc11b4bb1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:14.967770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de831f-6dd4-44c4-b08c-e86dc11b4bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:14.968064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de831f-6dd4-44c4-b08c-e86dc11b4bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:14.970386 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 347/715] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:14 2022] GET /identity/v3/role_assignments?user.id=4eed1d3c16354c8c9af8c01cb541c11c&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=c81d50150272454fa5fe29cf1428c69e => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:15.002447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-57de831f-6dd4-44c4-b08c-e86dc11b4bb1 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:15.004139 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-57de831f-6dd4-44c4-b08c-e86dc11b4bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:15.118050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 369/716] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:15.154350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7054726-a089-4095-a9c9-486d2d0d37b4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:15.272891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7054726-a089-4095-a9c9-486d2d0d37b4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:15.301956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:15.311640 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bb2cf-7e34-43b4-a875-90abb0aa7827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:15.312473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb2cf-7e34-43b4-a875-90abb0aa7827 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:15.312763 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb2cf-7e34-43b4-a875-90abb0aa7827 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:15.313039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb2cf-7e34-43b4-a875-90abb0aa7827 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:15.313694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bb2cf-7e34-43b4-a875-90abb0aa7827 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:15.315060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bb2cf-7e34-43b4-a875-90abb0aa7827 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-051bb2cf-7e34-43b4-a875-90abb0aa7827 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:15.327841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:15.328903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:15.329762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 348/717] 10.222.0.66 () {56 vars in 1129 bytes} [Fri Jul 15 20:24:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:15.337385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de831f-6dd4-44c4-b08c-e86dc11b4bb1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:15.447219 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de831f-6dd4-44c4-b08c-e86dc11b4bb1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:15.467131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:15.489595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e8169-28b0-4f46-b08e-1ea1d11cbadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:15.490276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e8169-28b0-4f46-b08e-1ea1d11cbadd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:15.490562 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e8169-28b0-4f46-b08e-1ea1d11cbadd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:15.490841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e8169-28b0-4f46-b08e-1ea1d11cbadd None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:15.491563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e8169-28b0-4f46-b08e-1ea1d11cbadd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:15.491869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e8169-28b0-4f46-b08e-1ea1d11cbadd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:15.493277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e8169-28b0-4f46-b08e-1ea1d11cbadd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:15.498472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 370/718] 10.222.0.66 () {56 vars in 1124 bytes} [Fri Jul 15 20:24:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:15.504524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bb2cf-7e34-43b4-a875-90abb0aa7827 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:15.663470 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bb2cf-7e34-43b4-a875-90abb0aa7827 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:15.711505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144c547-cd60-4242-91ef-716fb4a399d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:15.712173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144c547-cd60-4242-91ef-716fb4a399d8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:15.712480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144c547-cd60-4242-91ef-716fb4a399d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:15.712764 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144c547-cd60-4242-91ef-716fb4a399d8 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:15.713473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144c547-cd60-4242-91ef-716fb4a399d8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:15.713779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144c547-cd60-4242-91ef-716fb4a399d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:15.715149 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144c547-cd60-4242-91ef-716fb4a399d8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:15.721220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 349/719] 10.222.0.66 () {56 vars in 1124 bytes} [Fri Jul 15 20:24:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:16.764377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51a757-e66a-437a-b849-147a31e2f8a0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:16.765062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51a757-e66a-437a-b849-147a31e2f8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:16.765062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51a757-e66a-437a-b849-147a31e2f8a0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:16.766466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 371/720] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:16.771932 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76fbdb-b1a7-4c9c-b7dd-44e2aeb2c035 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:16.772469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76fbdb-b1a7-4c9c-b7dd-44e2aeb2c035 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:16.772644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76fbdb-b1a7-4c9c-b7dd-44e2aeb2c035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:16.797333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fd76fbdb-b1a7-4c9c-b7dd-44e2aeb2c035 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:16.798516 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fd76fbdb-b1a7-4c9c-b7dd-44e2aeb2c035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:16.865529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:16.890771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 350/721] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 20:24:16.925658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51a757-e66a-437a-b849-147a31e2f8a0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:16.994767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1b669-4f6b-4e48-9655-a9a25efc8f52 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:16.995406 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1b669-4f6b-4e48-9655-a9a25efc8f52 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:16.995910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1b669-4f6b-4e48-9655-a9a25efc8f52 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:16.997946 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 351/722] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:24:17.003112 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1757a3-5569-4d90-8a01-e005be2cad6e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:17.003625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1757a3-5569-4d90-8a01-e005be2cad6e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:17.004105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1757a3-5569-4d90-8a01-e005be2cad6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:17.022503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cc1757a3-5569-4d90-8a01-e005be2cad6e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:17.024128 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cc1757a3-5569-4d90-8a01-e005be2cad6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:17.085629 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51a757-e66a-437a-b849-147a31e2f8a0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:17.122581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84926d3a-de37-46c8-9bd7-4cf7f382b1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:17.123802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84926d3a-de37-46c8-9bd7-4cf7f382b1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:17.124331 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84926d3a-de37-46c8-9bd7-4cf7f382b1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:17.124851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84926d3a-de37-46c8-9bd7-4cf7f382b1c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:17.136897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84926d3a-de37-46c8-9bd7-4cf7f382b1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-84926d3a-de37-46c8-9bd7-4cf7f382b1c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:17.145101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:17.146603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:17.147465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:17.147465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:17.147465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:17.147465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:17.147465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:17.147465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:17.147465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:17.147465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:17.147465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:17.147465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:17.147465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:17.147465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:17.150374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 372/724] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:24:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:17.150489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 352/724] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:17.155942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1757a3-5569-4d90-8a01-e005be2cad6e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:17.174183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84926d3a-de37-46c8-9bd7-4cf7f382b1c5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:17.274432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:17.294559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1757a3-5569-4d90-8a01-e005be2cad6e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:17.318098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:17.362215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec1a4b-2800-4c3e-816e-629a1a87bf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:17.362891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec1a4b-2800-4c3e-816e-629a1a87bf21 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:17.363176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec1a4b-2800-4c3e-816e-629a1a87bf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:17.363450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec1a4b-2800-4c3e-816e-629a1a87bf21 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:17.364967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec1a4b-2800-4c3e-816e-629a1a87bf21 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:17.365276 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec1a4b-2800-4c3e-816e-629a1a87bf21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:17.366258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84926d3a-de37-46c8-9bd7-4cf7f382b1c5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:17.366770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec1a4b-2800-4c3e-816e-629a1a87bf21 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:17.387955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 353/725] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:24:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:17.393363 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec1a4b-2800-4c3e-816e-629a1a87bf21 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:17.413083 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875a97f-cf42-4886-adde-d4e2fd2f3559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:17.414575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875a97f-cf42-4886-adde-d4e2fd2f3559 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:17.415064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875a97f-cf42-4886-adde-d4e2fd2f3559 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:17.415538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875a97f-cf42-4886-adde-d4e2fd2f3559 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:17.442190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875a97f-cf42-4886-adde-d4e2fd2f3559 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e875a97f-cf42-4886-adde-d4e2fd2f3559 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:17.447971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:17.448994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:17.449857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:17.449857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:17.449857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:17.449857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:17.449857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:17.449857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:17.449857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:17.449857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:17.449857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:17.449857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:17.449857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:24:17.449857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:17.461520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 373/726] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:17.462447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875a97f-cf42-4886-adde-d4e2fd2f3559 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:17.569375 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec1a4b-2800-4c3e-816e-629a1a87bf21 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:17.617503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978daa40-5695-42d7-90b1-bc2dd4cb015c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:17.618544 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978daa40-5695-42d7-90b1-bc2dd4cb015c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:17.618986 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978daa40-5695-42d7-90b1-bc2dd4cb015c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:17.619268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978daa40-5695-42d7-90b1-bc2dd4cb015c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:17.630886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978daa40-5695-42d7-90b1-bc2dd4cb015c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:17.632337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978daa40-5695-42d7-90b1-bc2dd4cb015c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:17.636276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875a97f-cf42-4886-adde-d4e2fd2f3559 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:17.638004 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-978daa40-5695-42d7-90b1-bc2dd4cb015c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:17.651119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:17.652835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:17.653743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:17.653743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:17.653743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:17.653743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:17.653743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 354/727] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:17.653743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce5b64-d48f-4a92-9d32-4a4986d4ae9d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:17.654085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce5b64-d48f-4a92-9d32-4a4986d4ae9d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:17.654432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce5b64-d48f-4a92-9d32-4a4986d4ae9d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:17.655609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 355/728] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:17.660630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c58cf-578c-4ff4-934d-4670dfb329a3 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:17.661023 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c58cf-578c-4ff4-934d-4670dfb329a3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:17.661643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c58cf-578c-4ff4-934d-4670dfb329a3 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:17.664431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 356/729] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:17.664431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c58cf-578c-4ff4-934d-4670dfb329a3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:17.688623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ad429-018c-4370-a94e-45b7641d5c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:17.689387 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ad429-018c-4370-a94e-45b7641d5c30 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:17.689684 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ad429-018c-4370-a94e-45b7641d5c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:17.689968 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ad429-018c-4370-a94e-45b7641d5c30 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:17.690720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ad429-018c-4370-a94e-45b7641d5c30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:17.691028 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ad429-018c-4370-a94e-45b7641d5c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:17.693590 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ad429-018c-4370-a94e-45b7641d5c30 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:17.695633 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:17.702741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 374/730] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:17.703978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01d244-77eb-4f8d-910e-343b5f0e1acb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:17.704274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01d244-77eb-4f8d-910e-343b5f0e1acb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:17.704588 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01d244-77eb-4f8d-910e-343b5f0e1acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:17.724451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9e01d244-77eb-4f8d-910e-343b5f0e1acb None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:17.725742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9e01d244-77eb-4f8d-910e-343b5f0e1acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:17.788414 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c58cf-578c-4ff4-934d-4670dfb329a3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:17.798267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 375/731] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:17.798267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059d07b-5c4b-49fd-b998-8c447bcab6d0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:17.798267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059d07b-5c4b-49fd-b998-8c447bcab6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:17.798871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059d07b-5c4b-49fd-b998-8c447bcab6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:17.816037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2059d07b-5c4b-49fd-b998-8c447bcab6d0 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:17.818609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2059d07b-5c4b-49fd-b998-8c447bcab6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:17.834473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c9f35-ecac-4c3f-9e51-3773ccc717c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:17.835164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c9f35-ecac-4c3f-9e51-3773ccc717c2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:17.835514 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c9f35-ecac-4c3f-9e51-3773ccc717c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:17.835877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c9f35-ecac-4c3f-9e51-3773ccc717c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:17.836711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c9f35-ecac-4c3f-9e51-3773ccc717c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:17.837087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c9f35-ecac-4c3f-9e51-3773ccc717c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:17.838528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c9f35-ecac-4c3f-9e51-3773ccc717c2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:17.850821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 357/732] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:17.851711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c9f35-ecac-4c3f-9e51-3773ccc717c2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:17.908433 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 376/733] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:17.908433 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059d07b-5c4b-49fd-b998-8c447bcab6d0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:17.936662 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:17.956530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:17.971555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c9f35-ecac-4c3f-9e51-3773ccc717c2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:18.007272 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a4f9e-c3a6-4440-b1d8-1ca32dd814db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:18.008328 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a4f9e-c3a6-4440-b1d8-1ca32dd814db None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:18.008793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a4f9e-c3a6-4440-b1d8-1ca32dd814db None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:18.009078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a4f9e-c3a6-4440-b1d8-1ca32dd814db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:18.018141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059d07b-5c4b-49fd-b998-8c447bcab6d0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:18.020699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a4f9e-c3a6-4440-b1d8-1ca32dd814db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:18.022338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a4f9e-c3a6-4440-b1d8-1ca32dd814db None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-878a4f9e-c3a6-4440-b1d8-1ca32dd814db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:18.040613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:18.041556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:18.042454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:18.042454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:18.042454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:18.042454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:18.042454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 358/734] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:18.042729 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a4f9e-c3a6-4440-b1d8-1ca32dd814db None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:18.061605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee772a2-aef3-4b7d-99a3-daae75132841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:18.062512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee772a2-aef3-4b7d-99a3-daae75132841 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:18.062957 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee772a2-aef3-4b7d-99a3-daae75132841 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:18.063242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee772a2-aef3-4b7d-99a3-daae75132841 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:18.063975 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee772a2-aef3-4b7d-99a3-daae75132841 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:18.065512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee772a2-aef3-4b7d-99a3-daae75132841 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:18.083386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 377/735] 10.222.0.66 () {60 vars in 1141 bytes} [Fri Jul 15 20:24:17 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:24:18.084704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee772a2-aef3-4b7d-99a3-daae75132841 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:18.172991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a4f9e-c3a6-4440-b1d8-1ca32dd814db None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:18.207162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:18.220031 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d55a26-15aa-4f1f-b6a1-87cf1c32e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:18.220888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d55a26-15aa-4f1f-b6a1-87cf1c32e393 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:18.221207 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d55a26-15aa-4f1f-b6a1-87cf1c32e393 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:18.221495 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d55a26-15aa-4f1f-b6a1-87cf1c32e393 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:18.225658 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:18.228538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee772a2-aef3-4b7d-99a3-daae75132841 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:18.237218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d55a26-15aa-4f1f-b6a1-87cf1c32e393 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:18.238697 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d55a26-15aa-4f1f-b6a1-87cf1c32e393 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f2d55a26-15aa-4f1f-b6a1-87cf1c32e393 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:18.256201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:18.257923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:18.258855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:18.258855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:18.258855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:18.258855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:18.258855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:18.258855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:18.258855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:18.258855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:18.258855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 20:24:18.258855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:18.260553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 359/736] 10.222.0.66 () {56 vars in 1117 bytes} [Fri Jul 15 20:24:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:18.261702 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d55a26-15aa-4f1f-b6a1-87cf1c32e393 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:18.273249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fae69-ff32-4cbb-b3be-5f9630cb0857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:18.274056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fae69-ff32-4cbb-b3be-5f9630cb0857 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:18.274338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fae69-ff32-4cbb-b3be-5f9630cb0857 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:18.274615 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fae69-ff32-4cbb-b3be-5f9630cb0857 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:18.286167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fae69-ff32-4cbb-b3be-5f9630cb0857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-721fae69-ff32-4cbb-b3be-5f9630cb0857 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:18.294270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:18.295410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:18.296470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:18.296470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:18.296470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:18.296470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:18.296470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:18.296470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:18.296470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:18.296470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:18.296470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:18.296470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:18.296470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:24:18.296470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:18.296470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 378/737] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:24:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:18.297203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d950bd1-5c34-49ac-a6cc-2e1357fda082 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:18.297557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d950bd1-5c34-49ac-a6cc-2e1357fda082 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:18.297724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d950bd1-5c34-49ac-a6cc-2e1357fda082 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:18.299164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 379/738] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:18.304486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d950bd1-5c34-49ac-a6cc-2e1357fda082 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:18.377829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d55a26-15aa-4f1f-b6a1-87cf1c32e393 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:18.411070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d950bd1-5c34-49ac-a6cc-2e1357fda082 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:18.412675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cfd11-f078-4a99-a273-b98a1f0ad101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:18.414059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cfd11-f078-4a99-a273-b98a1f0ad101 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:18.414059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cfd11-f078-4a99-a273-b98a1f0ad101 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:18.414059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cfd11-f078-4a99-a273-b98a1f0ad101 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:18.414858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cfd11-f078-4a99-a273-b98a1f0ad101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:18.415164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cfd11-f078-4a99-a273-b98a1f0ad101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:18.416573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cfd11-f078-4a99-a273-b98a1f0ad101 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:18.434337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 360/739] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:18.434337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cfd11-f078-4a99-a273-b98a1f0ad101 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:18.461779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ad593-2c2c-4b1b-9bc4-4c70fa64e29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:18.462669 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad593-2c2c-4b1b-9bc4-4c70fa64e29f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:18.463095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad593-2c2c-4b1b-9bc4-4c70fa64e29f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:18.463525 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad593-2c2c-4b1b-9bc4-4c70fa64e29f None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:18.464542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ad593-2c2c-4b1b-9bc4-4c70fa64e29f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:18.465006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ad593-2c2c-4b1b-9bc4-4c70fa64e29f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:18.466443 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ad593-2c2c-4b1b-9bc4-4c70fa64e29f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:18.491848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 380/740] 10.222.0.66 () {56 vars in 1149 bytes} [Fri Jul 15 20:24:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:18.491848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9058-e3ac-4d48-8d0c-d056d0e90679 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:18.491848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9058-e3ac-4d48-8d0c-d056d0e90679 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:18.491848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9058-e3ac-4d48-8d0c-d056d0e90679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:18.494773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:18.503591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:18.507174 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-68ae9058-e3ac-4d48-8d0c-d056d0e90679 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:18.508366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-68ae9058-e3ac-4d48-8d0c-d056d0e90679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:18.552089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cfd11-f078-4a99-a273-b98a1f0ad101 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:18.582329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 381/741] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:18 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 20:24:18.583296 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae9058-e3ac-4d48-8d0c-d056d0e90679 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:18.592828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c1149-b001-4363-a511-06300ddadd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:18.593875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1149-b001-4363-a511-06300ddadd2d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:18.594477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1149-b001-4363-a511-06300ddadd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:18.594962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1149-b001-4363-a511-06300ddadd2d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:18.595909 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c1149-b001-4363-a511-06300ddadd2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:18.596443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c1149-b001-4363-a511-06300ddadd2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:18.598813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c1149-b001-4363-a511-06300ddadd2d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:18.608286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 361/742] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:24:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:18.609474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c1149-b001-4363-a511-06300ddadd2d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:18.691251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae9058-e3ac-4d48-8d0c-d056d0e90679 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:18.714222 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c1149-b001-4363-a511-06300ddadd2d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:18.725164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:18.730419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169ec61-e1d3-4e14-a101-9c3994a99d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:18.731205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ec61-e1d3-4e14-a101-9c3994a99d7d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:18.731489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ec61-e1d3-4e14-a101-9c3994a99d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:18.731764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ec61-e1d3-4e14-a101-9c3994a99d7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:18.732524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:18.742023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169ec61-e1d3-4e14-a101-9c3994a99d7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:18.743651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169ec61-e1d3-4e14-a101-9c3994a99d7d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:18.751342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2ba10-25ab-480c-888a-23660dc081dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:18.751997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2ba10-25ab-480c-888a-23660dc081dc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:18.752286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2ba10-25ab-480c-888a-23660dc081dc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:18.752611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2ba10-25ab-480c-888a-23660dc081dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2169ec61-e1d3-4e14-a101-9c3994a99d7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:18.758513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:18.759448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:18.760409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:18.760409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:18.760409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:18.760409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:18.760409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:18.760409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:18.760409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:18.760409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:18.760409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:24:18.760409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:18.764482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 382/743] 10.222.0.66 () {56 vars in 1093 bytes} [Fri Jul 15 20:24:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:18.765165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169ec61-e1d3-4e14-a101-9c3994a99d7d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:18.827656 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2ba10-25ab-480c-888a-23660dc081dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:18.829160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2ba10-25ab-480c-888a-23660dc081dc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:18.870017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169ec61-e1d3-4e14-a101-9c3994a99d7d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:18.904105 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29d3d7-35cc-4fe6-a5d1-f66d9abdf117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:18.904924 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29d3d7-35cc-4fe6-a5d1-f66d9abdf117 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:18.905209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29d3d7-35cc-4fe6-a5d1-f66d9abdf117 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:18.905482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29d3d7-35cc-4fe6-a5d1-f66d9abdf117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:18.916862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29d3d7-35cc-4fe6-a5d1-f66d9abdf117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:18.918304 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29d3d7-35cc-4fe6-a5d1-f66d9abdf117 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:18.942286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 362/744] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:18 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 20:24:18.942286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2ba10-25ab-480c-888a-23660dc081dc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-7f29d3d7-35cc-4fe6-a5d1-f66d9abdf117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:18.942557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:18.943542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:18.944657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:18.944657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:18.944657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:18.944657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:18.944657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 383/745] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:18.944657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29d3d7-35cc-4fe6-a5d1-f66d9abdf117 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:18.965373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:18.995072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:19.056208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2ba10-25ab-480c-888a-23660dc081dc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:19.056579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29d3d7-35cc-4fe6-a5d1-f66d9abdf117 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:19.092235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b978-cb54-4a67-a82a-3644397735f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:19.092962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b978-cb54-4a67-a82a-3644397735f7 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:19.093254 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b978-cb54-4a67-a82a-3644397735f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:19.093352 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434026b6-db1e-4eec-8552-95c7ce6cf65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:19.093531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b978-cb54-4a67-a82a-3644397735f7 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:19.093931 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434026b6-db1e-4eec-8552-95c7ce6cf65e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:19.094220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434026b6-db1e-4eec-8552-95c7ce6cf65e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:19.094312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11b978-cb54-4a67-a82a-3644397735f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:19.094502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434026b6-db1e-4eec-8552-95c7ce6cf65e None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:19.095346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434026b6-db1e-4eec-8552-95c7ce6cf65e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:19.095597 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11b978-cb54-4a67-a82a-3644397735f7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:19.095699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434026b6-db1e-4eec-8552-95c7ce6cf65e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:19.097098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434026b6-db1e-4eec-8552-95c7ce6cf65e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:19.120432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 363/746] 10.222.0.66 () {60 vars in 1141 bytes} [Fri Jul 15 20:24:18 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:24:19.120432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b978-cb54-4a67-a82a-3644397735f7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:19.127234 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 384/747] 10.222.0.66 () {56 vars in 1133 bytes} [Fri Jul 15 20:24:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:19.128366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434026b6-db1e-4eec-8552-95c7ce6cf65e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:19.247985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b978-cb54-4a67-a82a-3644397735f7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:19.256811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:19.278390 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434026b6-db1e-4eec-8552-95c7ce6cf65e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:19.280095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:19.296771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6a80c-e7d7-4698-8c79-74f434680352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:19.298452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6a80c-e7d7-4698-8c79-74f434680352 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:19.298934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6a80c-e7d7-4698-8c79-74f434680352 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:19.299392 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6a80c-e7d7-4698-8c79-74f434680352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:19.314230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6a80c-e7d7-4698-8c79-74f434680352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:19.315710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6a80c-e7d7-4698-8c79-74f434680352 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:19.327364 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c681abd-27e9-49b6-9c4e-af505b77028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:19.328286 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c681abd-27e9-49b6-9c4e-af505b77028f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:19.328767 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c681abd-27e9-49b6-9c4e-af505b77028f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:19.329195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c681abd-27e9-49b6-9c4e-af505b77028f None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:19.330079 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c681abd-27e9-49b6-9c4e-af505b77028f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:19.330545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c681abd-27e9-49b6-9c4e-af505b77028f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:19.332061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c681abd-27e9-49b6-9c4e-af505b77028f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-dfb6a80c-e7d7-4698-8c79-74f434680352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:19.337458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:19.338350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:19.339233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:19.339233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:19.339233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:19.339233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:19.339233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 364/748] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:19.339915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6a80c-e7d7-4698-8c79-74f434680352 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:19.347767 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 385/749] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:19.348625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c681abd-27e9-49b6-9c4e-af505b77028f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:19.471362 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6a80c-e7d7-4698-8c79-74f434680352 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:19.482376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c681abd-27e9-49b6-9c4e-af505b77028f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:19.508188 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:19.519690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc52999-02c6-46c1-846b-4a0a81f47134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:19.521608 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc52999-02c6-46c1-846b-4a0a81f47134 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:19.522384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc52999-02c6-46c1-846b-4a0a81f47134 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:19.523124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc52999-02c6-46c1-846b-4a0a81f47134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:19.527465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f2d5-fffe-46a5-bca5-edc29e0f9361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:19.528146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f2d5-fffe-46a5-bca5-edc29e0f9361 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:19.528469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f2d5-fffe-46a5-bca5-edc29e0f9361 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:19.528754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f2d5-fffe-46a5-bca5-edc29e0f9361 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:19.529484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6f2d5-fffe-46a5-bca5-edc29e0f9361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:19.529793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6f2d5-fffe-46a5-bca5-edc29e0f9361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:19.531162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6f2d5-fffe-46a5-bca5-edc29e0f9361 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:19.536654 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc52999-02c6-46c1-846b-4a0a81f47134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:19.538400 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc52999-02c6-46c1-846b-4a0a81f47134 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:19.550683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 386/750] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:19.550683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f2d5-fffe-46a5-bca5-edc29e0f9361 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-5bc52999-02c6-46c1-846b-4a0a81f47134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:19.568070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:19.569080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:19.569944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:19.569944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:19.569944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:19.569944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:19.572188 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 365/751] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:19.573298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc52999-02c6-46c1-846b-4a0a81f47134 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:19.578260 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:19.686511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f2d5-fffe-46a5-bca5-edc29e0f9361 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:19.691077 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc52999-02c6-46c1-846b-4a0a81f47134 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:19.731662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cb49a-4c5c-4341-b0b4-ed9fc73e00c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:19.732292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2927d6-2496-4e9e-8c56-9397811b4258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:19.732516 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cb49a-4c5c-4341-b0b4-ed9fc73e00c2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:19.732766 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cb49a-4c5c-4341-b0b4-ed9fc73e00c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:19.733047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cb49a-4c5c-4341-b0b4-ed9fc73e00c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:19.734053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2927d6-2496-4e9e-8c56-9397811b4258 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:19.734537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2927d6-2496-4e9e-8c56-9397811b4258 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:19.735053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2927d6-2496-4e9e-8c56-9397811b4258 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:19.741594 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723cb49a-4c5c-4341-b0b4-ed9fc73e00c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:19.743352 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723cb49a-4c5c-4341-b0b4-ed9fc73e00c2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:19.743858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2927d6-2496-4e9e-8c56-9397811b4258 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:19.745533 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2927d6-2496-4e9e-8c56-9397811b4258 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-723cb49a-4c5c-4341-b0b4-ed9fc73e00c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:19.759168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:19.760054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:19.760962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:19.760962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:19.760962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:19.760962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:19.760962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:19.760962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:19.760962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:19.760962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-cd2927d6-2496-4e9e-8c56-9397811b4258 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:19.763427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:19.764300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:19.765501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:19.765501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:19.765501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:19.765501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:19.765501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:19.765501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:19.765501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:19.765501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:19.765501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 20:24:19.765501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:19.766016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 366/752] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:19.766096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cb49a-4c5c-4341-b0b4-ed9fc73e00c2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:19.767720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 387/753] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:24:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:19.768709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2927d6-2496-4e9e-8c56-9397811b4258 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:19.813978 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:19.861501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:19.882739 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cb49a-4c5c-4341-b0b4-ed9fc73e00c2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:19.884451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2927d6-2496-4e9e-8c56-9397811b4258 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:19.919701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9705dde-2f0e-402f-8d1e-ad5cc4a7c345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:19.920179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9705dde-2f0e-402f-8d1e-ad5cc4a7c345 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:19.920486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9705dde-2f0e-402f-8d1e-ad5cc4a7c345 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:19.920768 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9705dde-2f0e-402f-8d1e-ad5cc4a7c345 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:19.921597 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9705dde-2f0e-402f-8d1e-ad5cc4a7c345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:19.921910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9705dde-2f0e-402f-8d1e-ad5cc4a7c345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:19.923590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9705dde-2f0e-402f-8d1e-ad5cc4a7c345 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:19.926112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1796b32-0d2a-4734-9f30-0e3ddc7947ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:19.927084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1796b32-0d2a-4734-9f30-0e3ddc7947ef None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:19.927592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1796b32-0d2a-4734-9f30-0e3ddc7947ef None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:19.928071 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1796b32-0d2a-4734-9f30-0e3ddc7947ef None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:19.929134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1796b32-0d2a-4734-9f30-0e3ddc7947ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:19.929681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1796b32-0d2a-4734-9f30-0e3ddc7947ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:19.931288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1796b32-0d2a-4734-9f30-0e3ddc7947ef None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:19.936215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 367/754] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:19.937089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9705dde-2f0e-402f-8d1e-ad5cc4a7c345 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:19.944941 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 388/755] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:19.946036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1796b32-0d2a-4734-9f30-0e3ddc7947ef None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:20.043590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:20.048468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9705dde-2f0e-402f-8d1e-ad5cc4a7c345 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:20.057172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1796b32-0d2a-4734-9f30-0e3ddc7947ef None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:20.085143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4b7d8-7b41-4217-a9bf-7ab84c491d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:20.085831 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4b7d8-7b41-4217-a9bf-7ab84c491d81 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:20.086096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4b7d8-7b41-4217-a9bf-7ab84c491d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:20.086382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4b7d8-7b41-4217-a9bf-7ab84c491d81 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:20.087219 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4b7d8-7b41-4217-a9bf-7ab84c491d81 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:20.087567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4b7d8-7b41-4217-a9bf-7ab84c491d81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:20.088984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4b7d8-7b41-4217-a9bf-7ab84c491d81 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:20.095366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8a075-7594-469a-8f73-268c1b4da200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:20.096443 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a075-7594-469a-8f73-268c1b4da200 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:20.096942 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a075-7594-469a-8f73-268c1b4da200 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:20.097692 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a075-7594-469a-8f73-268c1b4da200 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:20.106935 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8a075-7594-469a-8f73-268c1b4da200 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:20.108748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8a075-7594-469a-8f73-268c1b4da200 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:20.112708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 368/756] 10.222.0.66 () {56 vars in 1135 bytes} [Fri Jul 15 20:24:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:20.113591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4b7d8-7b41-4217-a9bf-7ab84c491d81 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-bfe8a075-7594-469a-8f73-268c1b4da200 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:20.129997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:20.130917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:20.131790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:20.131790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:20.131790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:20.131790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:20.131790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:20.131790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:20.131790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:20.131790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:20.134273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 389/757] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:20.135328 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8a075-7594-469a-8f73-268c1b4da200 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:20.138313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:20.221609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4b7d8-7b41-4217-a9bf-7ab84c491d81 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:20.245106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8a075-7594-469a-8f73-268c1b4da200 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:20.284311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdbef0-717a-4211-987c-9fe2f6123376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:20.285007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdbef0-717a-4211-987c-9fe2f6123376 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:20.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdbef0-717a-4211-987c-9fe2f6123376 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:20.285597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdbef0-717a-4211-987c-9fe2f6123376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:20.366042 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdbef0-717a-4211-987c-9fe2f6123376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:20.367854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdbef0-717a-4211-987c-9fe2f6123376 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:20.370167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:20.374863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12911026-c3b2-43d6-ae91-dbeb6b57ce21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:20.375520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12911026-c3b2-43d6-ae91-dbeb6b57ce21 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:20.375802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12911026-c3b2-43d6-ae91-dbeb6b57ce21 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:20.376078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12911026-c3b2-43d6-ae91-dbeb6b57ce21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:20.376949 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12911026-c3b2-43d6-ae91-dbeb6b57ce21 None admin] RBAC: Adding query filter params (role.id=c81d50150272454fa5fe29cf1428c69e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=c02568cd42484dfc9c39c2088f024060) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:20.377263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12911026-c3b2-43d6-ae91-dbeb6b57ce21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:20.378694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12911026-c3b2-43d6-ae91-dbeb6b57ce21 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:20.384953 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 369/758] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:20 2022] GET /identity/v3/role_assignments?user.id=c02568cd42484dfc9c39c2088f024060&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=c81d50150272454fa5fe29cf1428c69e => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:20.385744 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12911026-c3b2-43d6-ae91-dbeb6b57ce21 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:20.422797 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:20.530529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12911026-c3b2-43d6-ae91-dbeb6b57ce21 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:20.539760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 390/759] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:24:20.541480 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea113976-9054-4f85-8527-11008e832e92 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:20.542010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea113976-9054-4f85-8527-11008e832e92 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:20.542361 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea113976-9054-4f85-8527-11008e832e92 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:20.544137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 391/760] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:20.544946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea113976-9054-4f85-8527-11008e832e92 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:20.580983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d1c75-c80f-40d5-872d-45a4dede3fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:20.583301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d1c75-c80f-40d5-872d-45a4dede3fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:20.583974 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d1c75-c80f-40d5-872d-45a4dede3fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:20.584532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d1c75-c80f-40d5-872d-45a4dede3fc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:20.585518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d1c75-c80f-40d5-872d-45a4dede3fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:20.586034 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d1c75-c80f-40d5-872d-45a4dede3fc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:20.588712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d1c75-c80f-40d5-872d-45a4dede3fc0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:20.609240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 370/761] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:20.612732 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee1d80-196c-4b5d-a187-2a19393b1700 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:20.613021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee1d80-196c-4b5d-a187-2a19393b1700 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:20.613299 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee1d80-196c-4b5d-a187-2a19393b1700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:20.630986 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c1ee1d80-196c-4b5d-a187-2a19393b1700 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:20.632095 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c1ee1d80-196c-4b5d-a187-2a19393b1700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:20.674437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea113976-9054-4f85-8527-11008e832e92 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:20.677328 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:20.704083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 371/762] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:20.705016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee1d80-196c-4b5d-a187-2a19393b1700 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:20.717405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:20.737707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204a75a-7c83-4a44-915c-2f44d0e4b393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:20.738515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204a75a-7c83-4a44-915c-2f44d0e4b393 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:20.739431 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204a75a-7c83-4a44-915c-2f44d0e4b393 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:20.739762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204a75a-7c83-4a44-915c-2f44d0e4b393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:20.752526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204a75a-7c83-4a44-915c-2f44d0e4b393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:20.753985 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204a75a-7c83-4a44-915c-2f44d0e4b393 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e204a75a-7c83-4a44-915c-2f44d0e4b393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:20.772956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:20.773936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:20.774807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:20.774807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:20.774807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:20.774807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:20.774807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 392/763] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:20.775103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204a75a-7c83-4a44-915c-2f44d0e4b393 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:20.830573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee1d80-196c-4b5d-a187-2a19393b1700 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:20.868297 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfff09-115b-429b-9a3b-a4fe2ead15ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:20.869582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfff09-115b-429b-9a3b-a4fe2ead15ba None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:20.870078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfff09-115b-429b-9a3b-a4fe2ead15ba None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:20.870654 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfff09-115b-429b-9a3b-a4fe2ead15ba None admin] PATH_INFO: `/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/b042da9298894712a0a29787a343bf85/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:20.872970 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfff09-115b-429b-9a3b-a4fe2ead15ba None admin] RBAC: Authorizing `identity:create_grant(project_id=52dd45fcba114e3f8ff40d8b954ee5cc, user_id=b042da9298894712a0a29787a343bf85, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:20.874706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfff09-115b-429b-9a3b-a4fe2ead15ba None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:20.887915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204a75a-7c83-4a44-915c-2f44d0e4b393 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:20.893011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 372/764] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:24:20 2022] PUT /identity/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/b042da9298894712a0a29787a343bf85/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:24:20.894435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfff09-115b-429b-9a3b-a4fe2ead15ba None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:20.946155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75b65c-8bf6-43e4-bac9-4238f403a23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:20.947333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75b65c-8bf6-43e4-bac9-4238f403a23c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:20.948267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75b65c-8bf6-43e4-bac9-4238f403a23c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:20.948725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75b65c-8bf6-43e4-bac9-4238f403a23c None admin] PATH_INFO: `/v3/services/network` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:20.950110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75b65c-8bf6-43e4-bac9-4238f403a23c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:20.952284 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75b65c-8bf6-43e4-bac9-4238f403a23c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ae75b65c-8bf6-43e4-bac9-4238f403a23c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:20.974193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:20.975449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:20.976515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:20.976515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:20.976515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:20.976515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:20.976515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:20.976515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:20.976515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:20.976515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:20.976515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:20.976515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:20.976515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:20.976515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:20.976515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:24:20.976515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:20.979068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 393/765] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:20 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:20.985260 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75b65c-8bf6-43e4-bac9-4238f403a23c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:20.986793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:21.009600 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:21.029036 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfff09-115b-429b-9a3b-a4fe2ead15ba None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:21.086294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4554ac7-9f2d-4515-a4f8-7fc6a847349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:21.088547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554ac7-9f2d-4515-a4f8-7fc6a847349a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:21.090613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554ac7-9f2d-4515-a4f8-7fc6a847349a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:21.091113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554ac7-9f2d-4515-a4f8-7fc6a847349a None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:21.094021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4554ac7-9f2d-4515-a4f8-7fc6a847349a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:21.094641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4554ac7-9f2d-4515-a4f8-7fc6a847349a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:21.096263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4554ac7-9f2d-4515-a4f8-7fc6a847349a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:21.115172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 373/766] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:21.125839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4554ac7-9f2d-4515-a4f8-7fc6a847349a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:21.126554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75b65c-8bf6-43e4-bac9-4238f403a23c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:21.167257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc6b5b-bbf3-4149-b14a-accfdfc8117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:21.168517 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc6b5b-bbf3-4149-b14a-accfdfc8117a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:21.169027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc6b5b-bbf3-4149-b14a-accfdfc8117a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:21.169522 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc6b5b-bbf3-4149-b14a-accfdfc8117a None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:21.170486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc6b5b-bbf3-4149-b14a-accfdfc8117a None admin] RBAC: Adding query filter params (name=network) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:21.170992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc6b5b-bbf3-4149-b14a-accfdfc8117a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:21.172614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc6b5b-bbf3-4149-b14a-accfdfc8117a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:21.179023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 394/767] 10.222.0.66 () {56 vars in 1112 bytes} [Fri Jul 15 20:24:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:21.185257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc6b5b-bbf3-4149-b14a-accfdfc8117a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:21.241612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4554ac7-9f2d-4515-a4f8-7fc6a847349a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:21.271289 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:21.278486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6b3d0-256b-40dc-a17c-8c8e571447a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:21.279118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6b3d0-256b-40dc-a17c-8c8e571447a6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:21.279402 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6b3d0-256b-40dc-a17c-8c8e571447a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:21.279677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6b3d0-256b-40dc-a17c-8c8e571447a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:21.284737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:21.287335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6b3d0-256b-40dc-a17c-8c8e571447a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:21.288958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6b3d0-256b-40dc-a17c-8c8e571447a6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-32d6b3d0-256b-40dc-a17c-8c8e571447a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:21.305688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:21.306663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:21.307556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:21.307556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:21.307556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:21.307556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:21.307556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:21.307556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:21.307556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:21.307556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:21.307556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 374/768] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:21.312170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc6b5b-bbf3-4149-b14a-accfdfc8117a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:21.312811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6b3d0-256b-40dc-a17c-8c8e571447a6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:21.350817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad457a4-a71b-4b29-98c2-792047643b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:21.351918 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad457a4-a71b-4b29-98c2-792047643b77 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:21.352456 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad457a4-a71b-4b29-98c2-792047643b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:21.352939 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad457a4-a71b-4b29-98c2-792047643b77 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:21.353849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad457a4-a71b-4b29-98c2-792047643b77 None admin] RBAC: Adding query filter params (type=network) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:21.354356 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad457a4-a71b-4b29-98c2-792047643b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:21.356024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad457a4-a71b-4b29-98c2-792047643b77 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:21.362900 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 395/769] 10.222.0.66 () {56 vars in 1112 bytes} [Fri Jul 15 20:24:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:21.369949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdd5a7-f999-4aa3-8769-e806114c49f3 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:21.370507 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdd5a7-f999-4aa3-8769-e806114c49f3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:21.370988 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdd5a7-f999-4aa3-8769-e806114c49f3 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:21.372925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 396/770] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:21.373937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdd5a7-f999-4aa3-8769-e806114c49f3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:21.420334 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6b3d0-256b-40dc-a17c-8c8e571447a6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:21.471006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954adf47-d0b1-4562-998c-dfcffa250d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:21.471857 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954adf47-d0b1-4562-998c-dfcffa250d6a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:21.472077 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954adf47-d0b1-4562-998c-dfcffa250d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:21.472468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954adf47-d0b1-4562-998c-dfcffa250d6a None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:21.473540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954adf47-d0b1-4562-998c-dfcffa250d6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:21.474144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954adf47-d0b1-4562-998c-dfcffa250d6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:21.475427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954adf47-d0b1-4562-998c-dfcffa250d6a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:21.488582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 375/771] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:21.495175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0980d-0f5b-4fea-b847-b3ef10a79220 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:21.495545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0980d-0f5b-4fea-b847-b3ef10a79220 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:21.495898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0980d-0f5b-4fea-b847-b3ef10a79220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:21.504369 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdd5a7-f999-4aa3-8769-e806114c49f3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:21.512494 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-97d0980d-0f5b-4fea-b847-b3ef10a79220 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:21.513748 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-97d0980d-0f5b-4fea-b847-b3ef10a79220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:21.550366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47c64-b402-47d3-a190-b4fc5bdc230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:21.551973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47c64-b402-47d3-a190-b4fc5bdc230c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:21.552889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47c64-b402-47d3-a190-b4fc5bdc230c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:21.553388 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47c64-b402-47d3-a190-b4fc5bdc230c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:21.555263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47c64-b402-47d3-a190-b4fc5bdc230c None admin] RBAC: Adding query filter params (interface=public, service_id=2224d136e62b466a842c821ec46a8ec0, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:21.555764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47c64-b402-47d3-a190-b4fc5bdc230c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:21.557339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47c64-b402-47d3-a190-b4fc5bdc230c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:21.565716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:21.574550 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 397/772] 10.222.0.66 () {56 vars in 1251 bytes} [Fri Jul 15 20:24:21 2022] GET /identity/v3/endpoints?service_id=2224d136e62b466a842c821ec46a8ec0&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:21.574550 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47c64-b402-47d3-a190-b4fc5bdc230c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:21.594836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:21.596779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 376/773] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:21.598728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0980d-0f5b-4fea-b847-b3ef10a79220 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:21.723803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47c64-b402-47d3-a190-b4fc5bdc230c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:21.739636 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0980d-0f5b-4fea-b847-b3ef10a79220 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:21.759574 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b54606-0670-4b78-9f0a-fbd8bfa99e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:21.760238 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b54606-0670-4b78-9f0a-fbd8bfa99e90 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:21.760569 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b54606-0670-4b78-9f0a-fbd8bfa99e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:21.760854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b54606-0670-4b78-9f0a-fbd8bfa99e90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:21.761699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b54606-0670-4b78-9f0a-fbd8bfa99e90 None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=4eed1d3c16354c8c9af8c01cb541c11c) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:21.762016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b54606-0670-4b78-9f0a-fbd8bfa99e90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:21.763470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b54606-0670-4b78-9f0a-fbd8bfa99e90 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:21.769637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 398/774] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:21 2022] GET /identity/v3/role_assignments?user.id=4eed1d3c16354c8c9af8c01cb541c11c&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=43e0afe364894278be44a97662ca6f8e => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:21.771072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b54606-0670-4b78-9f0a-fbd8bfa99e90 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:21.802017 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b388be2-bb63-452e-91df-178d5cc7b97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:21.802712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b388be2-bb63-452e-91df-178d5cc7b97e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:21.803001 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b388be2-bb63-452e-91df-178d5cc7b97e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:21.803282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b388be2-bb63-452e-91df-178d5cc7b97e None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:21.803989 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b388be2-bb63-452e-91df-178d5cc7b97e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:21.805467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b388be2-bb63-452e-91df-178d5cc7b97e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:21.818510 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 377/775] 10.222.0.66 () {56 vars in 1087 bytes} [Fri Jul 15 20:24:21 2022] GET /identity/v3/services => generated 772 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:21.877902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:21.909355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b54606-0670-4b78-9f0a-fbd8bfa99e90 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:21.956294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64b2de-16dc-42c6-99cc-27455d5e28d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:21.957299 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64b2de-16dc-42c6-99cc-27455d5e28d4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:21.958208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64b2de-16dc-42c6-99cc-27455d5e28d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:21.958619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64b2de-16dc-42c6-99cc-27455d5e28d4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:21.959359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64b2de-16dc-42c6-99cc-27455d5e28d4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:21.960824 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64b2de-16dc-42c6-99cc-27455d5e28d4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-6d64b2de-16dc-42c6-99cc-27455d5e28d4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:21.976104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:21.977156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:21.978422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 399/776] 10.222.0.66 () {56 vars in 1129 bytes} [Fri Jul 15 20:24:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:21.983615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b388be2-bb63-452e-91df-178d5cc7b97e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:22.045452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:22.102385 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b388be2-bb63-452e-91df-178d5cc7b97e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:22.139471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2c09b-b990-4f06-87c4-977f3fb7ecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:22.140139 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2c09b-b990-4f06-87c4-977f3fb7ecac None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:22.140440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2c09b-b990-4f06-87c4-977f3fb7ecac None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:22.140723 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2c09b-b990-4f06-87c4-977f3fb7ecac None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:22.141429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2c09b-b990-4f06-87c4-977f3fb7ecac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:22.141734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2c09b-b990-4f06-87c4-977f3fb7ecac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:22.143100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2c09b-b990-4f06-87c4-977f3fb7ecac None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:22.148919 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 378/777] 10.222.0.66 () {56 vars in 1124 bytes} [Fri Jul 15 20:24:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:22.154201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64b2de-16dc-42c6-99cc-27455d5e28d4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:22.277372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64b2de-16dc-42c6-99cc-27455d5e28d4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:22.330458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3bdd5-a3e2-42b6-8684-fd80c1875c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:22.331130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3bdd5-a3e2-42b6-8684-fd80c1875c4d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:22.331416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3bdd5-a3e2-42b6-8684-fd80c1875c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:22.331693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3bdd5-a3e2-42b6-8684-fd80c1875c4d None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:22.333007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3bdd5-a3e2-42b6-8684-fd80c1875c4d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:22.333507 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3bdd5-a3e2-42b6-8684-fd80c1875c4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:22.334899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3bdd5-a3e2-42b6-8684-fd80c1875c4d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:22.340316 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 400/778] 10.222.0.66 () {56 vars in 1124 bytes} [Fri Jul 15 20:24:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:22.345820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2c09b-b990-4f06-87c4-977f3fb7ecac None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:22.486720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2c09b-b990-4f06-87c4-977f3fb7ecac None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:22.506918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:22.542535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfda76-3b1f-432f-82e5-d542e7c99fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:22.543116 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfda76-3b1f-432f-82e5-d542e7c99fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:22.543399 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfda76-3b1f-432f-82e5-d542e7c99fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:22.543718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfda76-3b1f-432f-82e5-d542e7c99fc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:22.544583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfda76-3b1f-432f-82e5-d542e7c99fc6 None admin] RBAC: Adding query filter params (interface=public, service_id=158fa40ec40c43b08cdc58d12b8bacd6, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:22.544900 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfda76-3b1f-432f-82e5-d542e7c99fc6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:22.546331 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfda76-3b1f-432f-82e5-d542e7c99fc6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:22.558892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 379/779] 10.222.0.66 () {56 vars in 1251 bytes} [Fri Jul 15 20:24:22 2022] GET /identity/v3/endpoints?service_id=158fa40ec40c43b08cdc58d12b8bacd6&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:22.563914 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3bdd5-a3e2-42b6-8684-fd80c1875c4d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:22.567393 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:22.645990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546615d-39fc-449c-9643-f05b1f18665d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:22.646317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546615d-39fc-449c-9643-f05b1f18665d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:22.646554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546615d-39fc-449c-9643-f05b1f18665d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:22.648196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 380/780] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:22.653399 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bec9ad-ba1b-486e-9f60-635ba96860f6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:22.653690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bec9ad-ba1b-486e-9f60-635ba96860f6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:22.653972 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bec9ad-ba1b-486e-9f60-635ba96860f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:22.677984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a3bec9ad-ba1b-486e-9f60-635ba96860f6 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:22.679223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a3bec9ad-ba1b-486e-9f60-635ba96860f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:22.797078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 381/781] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:24:22.819844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3bdd5-a3e2-42b6-8684-fd80c1875c4d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:22.838852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bec9ad-ba1b-486e-9f60-635ba96860f6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:22.880256 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbab4d7-c87a-4836-a1f0-8814a786ca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:22.881133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbab4d7-c87a-4836-a1f0-8814a786ca7c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:22.881546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbab4d7-c87a-4836-a1f0-8814a786ca7c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:22.881829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbab4d7-c87a-4836-a1f0-8814a786ca7c None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:22.884138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbab4d7-c87a-4836-a1f0-8814a786ca7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:22.886862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbab4d7-c87a-4836-a1f0-8814a786ca7c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:22.894980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 401/782] 10.222.0.66 () {56 vars in 1087 bytes} [Fri Jul 15 20:24:22 2022] GET /identity/v3/services => generated 772 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:22.976697 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bec9ad-ba1b-486e-9f60-635ba96860f6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:22.978394 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:23.015844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3673612-dd72-47fe-81f5-e0a507bcb5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:23.016667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3673612-dd72-47fe-81f5-e0a507bcb5de None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:23.016956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3673612-dd72-47fe-81f5-e0a507bcb5de None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:23.017234 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3673612-dd72-47fe-81f5-e0a507bcb5de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:23.029930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3673612-dd72-47fe-81f5-e0a507bcb5de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e3673612-dd72-47fe-81f5-e0a507bcb5de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:23.038582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:23.039776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:23.041078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:23.041078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:23.041078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:23.041078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:23.041078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:23.041078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:23.041078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:23.041078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:23.041078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:23.041078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:23.041078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:23.041078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:23.041078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 382/783] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:24:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:23.046664 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbab4d7-c87a-4836-a1f0-8814a786ca7c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:23.131396 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:23.170186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbab4d7-c87a-4836-a1f0-8814a786ca7c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:23.220024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47849866-33de-48d1-be39-f967a740e8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:23.220751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47849866-33de-48d1-be39-f967a740e8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:23.221044 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47849866-33de-48d1-be39-f967a740e8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:23.221311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47849866-33de-48d1-be39-f967a740e8a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:23.222071 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47849866-33de-48d1-be39-f967a740e8a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:23.222381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47849866-33de-48d1-be39-f967a740e8a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:23.223996 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47849866-33de-48d1-be39-f967a740e8a2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:23.233582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 402/784] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:24:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:23.239294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3673612-dd72-47fe-81f5-e0a507bcb5de None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:23.348006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3673612-dd72-47fe-81f5-e0a507bcb5de None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:23.384024 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9da89-25a5-4f9e-b2a6-1b2c726f69e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:23.384775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9da89-25a5-4f9e-b2a6-1b2c726f69e2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:23.385067 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9da89-25a5-4f9e-b2a6-1b2c726f69e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:23.385346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9da89-25a5-4f9e-b2a6-1b2c726f69e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:23.396928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9da89-25a5-4f9e-b2a6-1b2c726f69e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:23.398376 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9da89-25a5-4f9e-b2a6-1b2c726f69e2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-63a9da89-25a5-4f9e-b2a6-1b2c726f69e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:23.416355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:23.418600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:23.420855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:23.420855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:23.420855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:23.420855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:23.420855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 383/785] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:23.423570 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47849866-33de-48d1-be39-f967a740e8a2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:23.567196 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47849866-33de-48d1-be39-f967a740e8a2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:23.602995 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:23.614890 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f35760-7cc1-4b9c-bf4b-0b3d5d58f98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:23.615566 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f35760-7cc1-4b9c-bf4b-0b3d5d58f98f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:23.615896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f35760-7cc1-4b9c-bf4b-0b3d5d58f98f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:23.616171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f35760-7cc1-4b9c-bf4b-0b3d5d58f98f None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:23.616580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db1e80-ea3a-44df-a442-06fa8ea36386 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:23.616870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db1e80-ea3a-44df-a442-06fa8ea36386 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:23.617035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f35760-7cc1-4b9c-bf4b-0b3d5d58f98f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:23.617184 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db1e80-ea3a-44df-a442-06fa8ea36386 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:23.617342 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f35760-7cc1-4b9c-bf4b-0b3d5d58f98f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:23.618517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 384/786] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:23.618746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f35760-7cc1-4b9c-bf4b-0b3d5d58f98f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:23.624046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243bef-1888-4853-9840-fd59d09b7922 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:23.624619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243bef-1888-4853-9840-fd59d09b7922 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:23.625110 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243bef-1888-4853-9840-fd59d09b7922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:23.639927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 403/787] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:23.643355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a4243bef-1888-4853-9840-fd59d09b7922 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:23.645532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f35760-7cc1-4b9c-bf4b-0b3d5d58f98f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:23.646080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a4243bef-1888-4853-9840-fd59d09b7922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:23.659255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:23.734928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 385/788] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:24:23.759050 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4243bef-1888-4853-9840-fd59d09b7922 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:23.857747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f35760-7cc1-4b9c-bf4b-0b3d5d58f98f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:23.896827 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3004454-be99-48f3-a38d-cc3bb0637370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:23.898286 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3004454-be99-48f3-a38d-cc3bb0637370 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:23.899806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3004454-be99-48f3-a38d-cc3bb0637370 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:23.900306 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3004454-be99-48f3-a38d-cc3bb0637370 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:23.909019 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3004454-be99-48f3-a38d-cc3bb0637370 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:23.911946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3004454-be99-48f3-a38d-cc3bb0637370 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e3004454-be99-48f3-a38d-cc3bb0637370 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:23.929579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:23.930544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:23.931478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:23.931478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:23.931478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:23.931478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:23.931478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:23.931478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:23.931478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:23.931478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:23.931478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 20:24:23.931478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:23.934274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 404/789] 10.222.0.66 () {56 vars in 1117 bytes} [Fri Jul 15 20:24:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:23.943673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3004454-be99-48f3-a38d-cc3bb0637370 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:23.966962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4243bef-1888-4853-9840-fd59d09b7922 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:24.014117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:24.057141 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8961d6-543b-48ce-b8d0-2fe2dda0dc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:24.057955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8961d6-543b-48ce-b8d0-2fe2dda0dc3f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:24.058243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8961d6-543b-48ce-b8d0-2fe2dda0dc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:24.058523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8961d6-543b-48ce-b8d0-2fe2dda0dc3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:24.067202 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3004454-be99-48f3-a38d-cc3bb0637370 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:24.082762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8961d6-543b-48ce-b8d0-2fe2dda0dc3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-bc8961d6-543b-48ce-b8d0-2fe2dda0dc3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:24.090804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:24.091817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:24.092716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:24.092716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:24.092716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:24.092716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:24.092716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:24.092716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:24.092716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:24.092716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:24.092716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:24.092716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:24.092716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:24:24.092716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:24.102026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 386/790] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:24:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:24.103181 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f63c94-86b2-40db-8c28-c767e851cbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:24.103868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f63c94-86b2-40db-8c28-c767e851cbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:24.104156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f63c94-86b2-40db-8c28-c767e851cbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:24.104452 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f63c94-86b2-40db-8c28-c767e851cbb4 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:24.105298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f63c94-86b2-40db-8c28-c767e851cbb4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:24.105610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f63c94-86b2-40db-8c28-c767e851cbb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:24.107038 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f63c94-86b2-40db-8c28-c767e851cbb4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:24.109689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8961d6-543b-48ce-b8d0-2fe2dda0dc3f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:24.118301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:24.136497 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 405/791] 10.222.0.66 () {56 vars in 1149 bytes} [Fri Jul 15 20:24:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:24.141955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f63c94-86b2-40db-8c28-c767e851cbb4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:24.226936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8961d6-543b-48ce-b8d0-2fe2dda0dc3f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:24.268144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9211e-3be6-48aa-992a-76557e7b6a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:24.268839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9211e-3be6-48aa-992a-76557e7b6a82 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:24.269120 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9211e-3be6-48aa-992a-76557e7b6a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:24.269396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9211e-3be6-48aa-992a-76557e7b6a82 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:24.270679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9211e-3be6-48aa-992a-76557e7b6a82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:24.270984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9211e-3be6-48aa-992a-76557e7b6a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:24.272399 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9211e-3be6-48aa-992a-76557e7b6a82 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:24.285800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 387/792] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:24:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:24.285800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae0f9e-cd13-4dd8-9e66-f7e1a404c075 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:24.285800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae0f9e-cd13-4dd8-9e66-f7e1a404c075 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:24.285800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae0f9e-cd13-4dd8-9e66-f7e1a404c075 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:24.285800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 388/793] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:24.291746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae0f9e-cd13-4dd8-9e66-f7e1a404c075 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:24.345481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f63c94-86b2-40db-8c28-c767e851cbb4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:24.357660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:24.370155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:24.400221 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d6ba2-0c63-42b3-b3a4-2aafd661eb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:24.401623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d6ba2-0c63-42b3-b3a4-2aafd661eb52 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:24.402483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d6ba2-0c63-42b3-b3a4-2aafd661eb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:24.402919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d6ba2-0c63-42b3-b3a4-2aafd661eb52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:24.409159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae0f9e-cd13-4dd8-9e66-f7e1a404c075 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:24.418506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d6ba2-0c63-42b3-b3a4-2aafd661eb52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:24.420197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d6ba2-0c63-42b3-b3a4-2aafd661eb52 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2f6d6ba2-0c63-42b3-b3a4-2aafd661eb52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:24.448754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:24.449835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:24.450730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:24.450730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:24.450730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:24.450730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:24.451128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 406/794] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:24.452520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e564a-b52d-4f2c-af67-614d7597781f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:24.452952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e564a-b52d-4f2c-af67-614d7597781f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:24.453419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e564a-b52d-4f2c-af67-614d7597781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:24.468993 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8937f-bb91-4de0-829a-42216425f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:24.468993 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8937f-bb91-4de0-829a-42216425f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:24.468993 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8937f-bb91-4de0-829a-42216425f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:24.468993 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8937f-bb91-4de0-829a-42216425f6a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:24.478821 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b05e564a-b52d-4f2c-af67-614d7597781f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:24.479938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b05e564a-b52d-4f2c-af67-614d7597781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:24.483733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8937f-bb91-4de0-829a-42216425f6a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:24.485422 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8937f-bb91-4de0-829a-42216425f6a7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-cef8937f-bb91-4de0-829a-42216425f6a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:24.512680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:24.513660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:24.519446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:24.519446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:24.519446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:24.519446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:24.519446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 389/795] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:24.519446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8937f-bb91-4de0-829a-42216425f6a7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:24.567621 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 407/796] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:24.568381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e564a-b52d-4f2c-af67-614d7597781f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:24.643487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8937f-bb91-4de0-829a-42216425f6a7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:24.663371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:24.675977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:24.682237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e36708-d922-4088-a5ba-b2a31bbd3203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:24.682912 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e36708-d922-4088-a5ba-b2a31bbd3203 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:24.683592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e36708-d922-4088-a5ba-b2a31bbd3203 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:24.683592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e36708-d922-4088-a5ba-b2a31bbd3203 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:24.684281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e36708-d922-4088-a5ba-b2a31bbd3203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:24.684817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e36708-d922-4088-a5ba-b2a31bbd3203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:24.686052 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e36708-d922-4088-a5ba-b2a31bbd3203 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:24.696293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e564a-b52d-4f2c-af67-614d7597781f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:24.699550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 390/797] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:24.700218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e36708-d922-4088-a5ba-b2a31bbd3203 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:24.732833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88c59f-5e5a-4005-8fe8-79253f8dcfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:24.733425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88c59f-5e5a-4005-8fe8-79253f8dcfff None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:24.733713 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88c59f-5e5a-4005-8fe8-79253f8dcfff None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:24.733999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88c59f-5e5a-4005-8fe8-79253f8dcfff None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:24.734721 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88c59f-5e5a-4005-8fe8-79253f8dcfff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:24.735043 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88c59f-5e5a-4005-8fe8-79253f8dcfff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:24.736463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88c59f-5e5a-4005-8fe8-79253f8dcfff None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:24.747836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 408/798] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:24.749162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db7961-3638-433a-8d99-3350963f0de6 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:24.749462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db7961-3638-433a-8d99-3350963f0de6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:24.749742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db7961-3638-433a-8d99-3350963f0de6 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:24.751143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 409/799] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:24.751739 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db7961-3638-433a-8d99-3350963f0de6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:24.829677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e36708-d922-4088-a5ba-b2a31bbd3203 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:24.858292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db7961-3638-433a-8d99-3350963f0de6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:24.866770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca9d09-b2a3-455b-96c0-c2b427580f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:24.867561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca9d09-b2a3-455b-96c0-c2b427580f5f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:24.867838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca9d09-b2a3-455b-96c0-c2b427580f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:24.868116 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca9d09-b2a3-455b-96c0-c2b427580f5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:24.878314 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca9d09-b2a3-455b-96c0-c2b427580f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ebca9d09-b2a3-455b-96c0-c2b427580f5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:24.886541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:24.887471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:24.888296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:24.888296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:24.888296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:24.888296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:24.888296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:24.888296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:24.888296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:24.888296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:24.888296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:24.888296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:24.888296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:24:24.888296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:24.888296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 391/800] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:24:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:24.889484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f83617-4998-4009-a334-adf487832e02 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:24.889484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f83617-4998-4009-a334-adf487832e02 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:24.889484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f83617-4998-4009-a334-adf487832e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:24.900691 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294a7d6-94b0-4d6d-a970-bd8a742545de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:24.901482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294a7d6-94b0-4d6d-a970-bd8a742545de None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:24.901768 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294a7d6-94b0-4d6d-a970-bd8a742545de None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:24.902044 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294a7d6-94b0-4d6d-a970-bd8a742545de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:24.906246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-65f83617-4998-4009-a334-adf487832e02 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:24.907426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-65f83617-4998-4009-a334-adf487832e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:24.908885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294a7d6-94b0-4d6d-a970-bd8a742545de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:24.910336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294a7d6-94b0-4d6d-a970-bd8a742545de None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-1294a7d6-94b0-4d6d-a970-bd8a742545de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:24.925233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:24.926240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:24.927117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:24.927117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:24.927117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:24.927117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:24.927117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:24.927117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:24.927117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:24.927117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:24.927117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 410/801] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:24.927626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294a7d6-94b0-4d6d-a970-bd8a742545de None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:24.939261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:24.944836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:24.992937 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 392/802] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:24.993701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f83617-4998-4009-a334-adf487832e02 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:25.062738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294a7d6-94b0-4d6d-a970-bd8a742545de None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:25.108226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33489df-1adb-4363-8e69-0e0910357a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:25.109365 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33489df-1adb-4363-8e69-0e0910357a32 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:25.109796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33489df-1adb-4363-8e69-0e0910357a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:25.110086 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33489df-1adb-4363-8e69-0e0910357a32 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:25.112228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f83617-4998-4009-a334-adf487832e02 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:25.118329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33489df-1adb-4363-8e69-0e0910357a32 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:25.119791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33489df-1adb-4363-8e69-0e0910357a32 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-f33489df-1adb-4363-8e69-0e0910357a32 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:25.134006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:25.134956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:25.140683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:25.140683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:25.140683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:25.140683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:25.140683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:25.140683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:25.140683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:25.140683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:25.140683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:24:25.140683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:25.140683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 411/803] 10.222.0.66 () {56 vars in 1093 bytes} [Fri Jul 15 20:24:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:25.140683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33489df-1adb-4363-8e69-0e0910357a32 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:25.151835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24dcd2-0d05-42cf-b288-c336e25d3460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:25.152530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24dcd2-0d05-42cf-b288-c336e25d3460 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:25.152816 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24dcd2-0d05-42cf-b288-c336e25d3460 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:25.153090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24dcd2-0d05-42cf-b288-c336e25d3460 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:25.153843 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24dcd2-0d05-42cf-b288-c336e25d3460 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:25.154147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24dcd2-0d05-42cf-b288-c336e25d3460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:25.155508 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24dcd2-0d05-42cf-b288-c336e25d3460 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:25.169793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 393/804] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:24:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:25.169793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24dcd2-0d05-42cf-b288-c336e25d3460 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:25.199355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:25.213186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:25.250598 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33489df-1adb-4363-8e69-0e0910357a32 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:25.274082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24dcd2-0d05-42cf-b288-c336e25d3460 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:25.288963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27942e-dbd8-407b-9524-066103a29c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:25.289946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27942e-dbd8-407b-9524-066103a29c5d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:25.290182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27942e-dbd8-407b-9524-066103a29c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:25.290465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27942e-dbd8-407b-9524-066103a29c5d None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:25.291261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27942e-dbd8-407b-9524-066103a29c5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:25.291574 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27942e-dbd8-407b-9524-066103a29c5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:25.293030 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27942e-dbd8-407b-9524-066103a29c5d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:25.306253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 412/805] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:25.307066 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27942e-dbd8-407b-9524-066103a29c5d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:25.315283 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96198046-ba7f-4240-8405-9ff8eadc0a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:25.316084 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96198046-ba7f-4240-8405-9ff8eadc0a91 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:25.316371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96198046-ba7f-4240-8405-9ff8eadc0a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:25.317204 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96198046-ba7f-4240-8405-9ff8eadc0a91 None admin] PATH_INFO: `/v3/services/network` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:25.318393 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96198046-ba7f-4240-8405-9ff8eadc0a91 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:25.319593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96198046-ba7f-4240-8405-9ff8eadc0a91 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-96198046-ba7f-4240-8405-9ff8eadc0a91 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:25.331973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:25.333584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:25.334404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 394/806] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:25 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:25.336437 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96198046-ba7f-4240-8405-9ff8eadc0a91 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:25.423554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27942e-dbd8-407b-9524-066103a29c5d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:25.439245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:25.447210 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96198046-ba7f-4240-8405-9ff8eadc0a91 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:25.451503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:25.460964 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41d4d7-d5cd-45ba-a84e-688375e90e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:25.461637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41d4d7-d5cd-45ba-a84e-688375e90e9e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:25.461917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41d4d7-d5cd-45ba-a84e-688375e90e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:25.462490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41d4d7-d5cd-45ba-a84e-688375e90e9e None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:25.463029 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41d4d7-d5cd-45ba-a84e-688375e90e9e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:25.463336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41d4d7-d5cd-45ba-a84e-688375e90e9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:25.464780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41d4d7-d5cd-45ba-a84e-688375e90e9e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:25.481503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 413/807] 10.222.0.66 () {56 vars in 1133 bytes} [Fri Jul 15 20:24:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:25.482262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41d4d7-d5cd-45ba-a84e-688375e90e9e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:25.483233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669bacc-6b33-4472-95d5-5ff2c67b4f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:25.484029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669bacc-6b33-4472-95d5-5ff2c67b4f59 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:25.484315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669bacc-6b33-4472-95d5-5ff2c67b4f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:25.484660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669bacc-6b33-4472-95d5-5ff2c67b4f59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:25.496301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669bacc-6b33-4472-95d5-5ff2c67b4f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:25.497772 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669bacc-6b33-4472-95d5-5ff2c67b4f59 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f669bacc-6b33-4472-95d5-5ff2c67b4f59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:25.515223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:25.516088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:25.517011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:25.517011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:25.517011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:25.517011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:25.517011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 395/808] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:25.517284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669bacc-6b33-4472-95d5-5ff2c67b4f59 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:25.579527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41d4d7-d5cd-45ba-a84e-688375e90e9e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:25.612608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b9ba4-5c28-49d5-8b7c-93214e99e84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:25.613511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b9ba4-5c28-49d5-8b7c-93214e99e84e None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:25.613825 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b9ba4-5c28-49d5-8b7c-93214e99e84e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:25.614105 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b9ba4-5c28-49d5-8b7c-93214e99e84e None admin] PATH_INFO: `/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/c02568cd42484dfc9c39c2088f024060/roles/c81d50150272454fa5fe29cf1428c69e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:25.616363 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669bacc-6b33-4472-95d5-5ff2c67b4f59 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:25.628094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b9ba4-5c28-49d5-8b7c-93214e99e84e None admin] RBAC: Authorizing `identity:create_grant(project_id=52dd45fcba114e3f8ff40d8b954ee5cc, user_id=c02568cd42484dfc9c39c2088f024060, role_id=c81d50150272454fa5fe29cf1428c69e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:25.630103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b9ba4-5c28-49d5-8b7c-93214e99e84e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:25.642412 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 414/809] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:24:25 2022] PUT /identity/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/c02568cd42484dfc9c39c2088f024060/roles/c81d50150272454fa5fe29cf1428c69e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:24:25.643745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a961bc-ce8e-435f-beaa-324fe3b08ab6 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:25.644046 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a961bc-ce8e-435f-beaa-324fe3b08ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:25.644326 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a961bc-ce8e-435f-beaa-324fe3b08ab6 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:25.647219 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 415/810] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:25.647966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a961bc-ce8e-435f-beaa-324fe3b08ab6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:25.659732 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a82f90-5ce8-4871-ae94-31ab89c8f10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:25.660541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a82f90-5ce8-4871-ae94-31ab89c8f10d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:25.661478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a82f90-5ce8-4871-ae94-31ab89c8f10d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:25.661478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a82f90-5ce8-4871-ae94-31ab89c8f10d None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:25.662141 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a82f90-5ce8-4871-ae94-31ab89c8f10d None admin] RBAC: Adding query filter params (name=network) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:25.662455 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a82f90-5ce8-4871-ae94-31ab89c8f10d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:25.663882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a82f90-5ce8-4871-ae94-31ab89c8f10d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:25.669751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 396/811] 10.222.0.66 () {56 vars in 1112 bytes} [Fri Jul 15 20:24:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:25.670412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a82f90-5ce8-4871-ae94-31ab89c8f10d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:25.684982 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:25.693946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:25.774969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a961bc-ce8e-435f-beaa-324fe3b08ab6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:25.790557 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a82f90-5ce8-4871-ae94-31ab89c8f10d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:25.821480 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ce47e-07e8-4ec7-9378-009f93d6a255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:25.822516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ce47e-07e8-4ec7-9378-009f93d6a255 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:25.822858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ce47e-07e8-4ec7-9378-009f93d6a255 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:25.823123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ce47e-07e8-4ec7-9378-009f93d6a255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:25.832542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a1ee8-407e-4c6d-a753-ba7ad811f67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:25.833234 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a1ee8-407e-4c6d-a753-ba7ad811f67a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:25.833515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a1ee8-407e-4c6d-a753-ba7ad811f67a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:25.833793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a1ee8-407e-4c6d-a753-ba7ad811f67a None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:25.834508 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a1ee8-407e-4c6d-a753-ba7ad811f67a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:25.834809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a1ee8-407e-4c6d-a753-ba7ad811f67a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:25.836170 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a1ee8-407e-4c6d-a753-ba7ad811f67a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:25.852429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 397/812] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:25.852429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d59d0-3f4e-43fe-b5da-cbb0a50a5b04 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:25.852429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d59d0-3f4e-43fe-b5da-cbb0a50a5b04 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:25.852429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d59d0-3f4e-43fe-b5da-cbb0a50a5b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:25.868357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-154d59d0-3f4e-43fe-b5da-cbb0a50a5b04 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:25.869573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-154d59d0-3f4e-43fe-b5da-cbb0a50a5b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:25.902893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ce47e-07e8-4ec7-9378-009f93d6a255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:25.904355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ce47e-07e8-4ec7-9378-009f93d6a255 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:25.936873 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:25.938440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:25.944947 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 398/813] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:25.945567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d59d0-3f4e-43fe-b5da-cbb0a50a5b04 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:26.027330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 416/814] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:24:26.028123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ce47e-07e8-4ec7-9378-009f93d6a255 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:26.055002 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d59d0-3f4e-43fe-b5da-cbb0a50a5b04 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:26.091601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62cbe3-3449-4970-b914-76477fbe2def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:26.092266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62cbe3-3449-4970-b914-76477fbe2def None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:26.092577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62cbe3-3449-4970-b914-76477fbe2def None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:26.092854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62cbe3-3449-4970-b914-76477fbe2def None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:26.093554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62cbe3-3449-4970-b914-76477fbe2def None admin] RBAC: Adding query filter params (type=network) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:26.093860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62cbe3-3449-4970-b914-76477fbe2def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:26.095231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62cbe3-3449-4970-b914-76477fbe2def None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:26.100945 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 399/815] 10.222.0.66 () {56 vars in 1112 bytes} [Fri Jul 15 20:24:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:26.101722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62cbe3-3449-4970-b914-76477fbe2def None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:26.149788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ce47e-07e8-4ec7-9378-009f93d6a255 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:26.163322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:26.190633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ddf3d-d19a-408b-81e8-3c3a9bf2342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:26.192318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ddf3d-d19a-408b-81e8-3c3a9bf2342a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:26.193123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ddf3d-d19a-408b-81e8-3c3a9bf2342a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:26.193563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ddf3d-d19a-408b-81e8-3c3a9bf2342a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:26.196761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:26.202967 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ddf3d-d19a-408b-81e8-3c3a9bf2342a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:26.203288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62cbe3-3449-4970-b914-76477fbe2def None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:26.205044 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ddf3d-d19a-408b-81e8-3c3a9bf2342a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-0b3ddf3d-d19a-408b-81e8-3c3a9bf2342a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:26.220690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:26.221823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:26.223532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:26.223532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:26.223532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:26.223532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:26.223532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:26.223532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:26.223532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:26.223532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:26.223532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 20:24:26.223532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:26.224671 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 417/816] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:24:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:26.225355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ddf3d-d19a-408b-81e8-3c3a9bf2342a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:26.250700 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a21aef-21d0-4b15-ada2-c2906c7ebb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:26.251623 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a21aef-21d0-4b15-ada2-c2906c7ebb87 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:26.251902 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a21aef-21d0-4b15-ada2-c2906c7ebb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:26.252280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a21aef-21d0-4b15-ada2-c2906c7ebb87 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:26.252958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a21aef-21d0-4b15-ada2-c2906c7ebb87 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:26.254350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a21aef-21d0-4b15-ada2-c2906c7ebb87 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-63a21aef-21d0-4b15-ada2-c2906c7ebb87 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:26.267512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:26.268660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:26.269985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 400/817] 10.222.0.66 () {56 vars in 1129 bytes} [Fri Jul 15 20:24:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:26.270858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a21aef-21d0-4b15-ada2-c2906c7ebb87 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:26.340556 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ddf3d-d19a-408b-81e8-3c3a9bf2342a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:26.379416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7204e29-bd70-4760-903c-5111fa362801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:26.380214 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7204e29-bd70-4760-903c-5111fa362801 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:26.380522 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7204e29-bd70-4760-903c-5111fa362801 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:26.380786 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7204e29-bd70-4760-903c-5111fa362801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:26.385649 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a21aef-21d0-4b15-ada2-c2906c7ebb87 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:26.391413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7204e29-bd70-4760-903c-5111fa362801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:26.392884 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7204e29-bd70-4760-903c-5111fa362801 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c7204e29-bd70-4760-903c-5111fa362801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:26.409427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:26.410885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:26.411798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:26.411798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:26.411798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:26.411798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:26.411798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 418/818] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:26.412534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7204e29-bd70-4760-903c-5111fa362801 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:26.419779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:26.429796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a64d1-3a5c-43f3-a19a-233bb1d60bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:26.430842 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a64d1-3a5c-43f3-a19a-233bb1d60bd9 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:26.431306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a64d1-3a5c-43f3-a19a-233bb1d60bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:26.431734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a64d1-3a5c-43f3-a19a-233bb1d60bd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:26.432777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a64d1-3a5c-43f3-a19a-233bb1d60bd9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:26.434327 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a64d1-3a5c-43f3-a19a-233bb1d60bd9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:26.464449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 401/819] 10.222.0.66 () {60 vars in 1144 bytes} [Fri Jul 15 20:24:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:24:26.464449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a64d1-3a5c-43f3-a19a-233bb1d60bd9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:26.488095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:26.555468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7204e29-bd70-4760-903c-5111fa362801 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:26.612997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8f9aa-8e79-461e-8730-7c48afe3685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:26.614298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8f9aa-8e79-461e-8730-7c48afe3685c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:26.614740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8f9aa-8e79-461e-8730-7c48afe3685c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:26.615019 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8f9aa-8e79-461e-8730-7c48afe3685c None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:26.615976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8f9aa-8e79-461e-8730-7c48afe3685c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:26.616348 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8f9aa-8e79-461e-8730-7c48afe3685c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:26.616951 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a64d1-3a5c-43f3-a19a-233bb1d60bd9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:26.617937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8f9aa-8e79-461e-8730-7c48afe3685c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:26.643141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 419/820] 10.222.0.66 () {56 vars in 1135 bytes} [Fri Jul 15 20:24:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:26.644132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8f9aa-8e79-461e-8730-7c48afe3685c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:26.662264 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c020076-5e0b-4ec4-836f-8685e299d52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:26.662944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020076-5e0b-4ec4-836f-8685e299d52e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:26.663227 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020076-5e0b-4ec4-836f-8685e299d52e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:26.663505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020076-5e0b-4ec4-836f-8685e299d52e None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:26.664896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c020076-5e0b-4ec4-836f-8685e299d52e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:26.664896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c020076-5e0b-4ec4-836f-8685e299d52e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:26.666175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c020076-5e0b-4ec4-836f-8685e299d52e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:26.672099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 402/821] 10.222.0.66 () {56 vars in 1124 bytes} [Fri Jul 15 20:24:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:26.672950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c020076-5e0b-4ec4-836f-8685e299d52e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:26.738287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:26.766716 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8f9aa-8e79-461e-8730-7c48afe3685c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:26.768494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:26.803247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c020076-5e0b-4ec4-836f-8685e299d52e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:26.803716 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98947cf2-d1cf-4d37-8d66-205e094a9bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:26.804409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98947cf2-d1cf-4d37-8d66-205e094a9bdc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:26.804715 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98947cf2-d1cf-4d37-8d66-205e094a9bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:26.805004 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98947cf2-d1cf-4d37-8d66-205e094a9bdc None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:26.805739 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98947cf2-d1cf-4d37-8d66-205e094a9bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:26.806038 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98947cf2-d1cf-4d37-8d66-205e094a9bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:26.807447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98947cf2-d1cf-4d37-8d66-205e094a9bdc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:26.819842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 420/822] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:26.820745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98947cf2-d1cf-4d37-8d66-205e094a9bdc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:26.844420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49cd6c-7899-4d8a-b659-b650555a3124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:26.845722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49cd6c-7899-4d8a-b659-b650555a3124 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:26.846009 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49cd6c-7899-4d8a-b659-b650555a3124 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:26.846290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49cd6c-7899-4d8a-b659-b650555a3124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:26.857903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49cd6c-7899-4d8a-b659-b650555a3124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:26.859345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49cd6c-7899-4d8a-b659-b650555a3124 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ce49cd6c-7899-4d8a-b659-b650555a3124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:26.876539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:26.877417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:26.878301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:26.878301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:26.878301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:26.878301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:26.878301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 403/823] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:26.878583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49cd6c-7899-4d8a-b659-b650555a3124 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:26.930531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98947cf2-d1cf-4d37-8d66-205e094a9bdc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:26.965251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f711e38-3ba0-4a8d-b7a1-961ef76893aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:26.965920 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f711e38-3ba0-4a8d-b7a1-961ef76893aa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:26.966204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f711e38-3ba0-4a8d-b7a1-961ef76893aa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:26.966483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f711e38-3ba0-4a8d-b7a1-961ef76893aa None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:26.967188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f711e38-3ba0-4a8d-b7a1-961ef76893aa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:26.967496 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f711e38-3ba0-4a8d-b7a1-961ef76893aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:26.968892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f711e38-3ba0-4a8d-b7a1-961ef76893aa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:26.973677 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 421/824] 10.222.0.66 () {56 vars in 1124 bytes} [Fri Jul 15 20:24:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:26.974447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f711e38-3ba0-4a8d-b7a1-961ef76893aa None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:26.987052 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:26.990877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49cd6c-7899-4d8a-b659-b650555a3124 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:27.003640 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:27.031092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc0aa1-90f8-4c72-ba4e-985d71ebffd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:27.032174 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc0aa1-90f8-4c72-ba4e-985d71ebffd3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:27.032636 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc0aa1-90f8-4c72-ba4e-985d71ebffd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:27.033063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc0aa1-90f8-4c72-ba4e-985d71ebffd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:27.041586 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc0aa1-90f8-4c72-ba4e-985d71ebffd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:27.043225 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc0aa1-90f8-4c72-ba4e-985d71ebffd3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f0cc0aa1-90f8-4c72-ba4e-985d71ebffd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:27.059104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:27.060166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:27.061132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:27.061132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:27.061132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:27.061132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:27.061132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:27.061132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:27.061132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:27.061132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:27.061970 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 404/825] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:27.062735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc0aa1-90f8-4c72-ba4e-985d71ebffd3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:27.090308 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f711e38-3ba0-4a8d-b7a1-961ef76893aa None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:27.128115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28976535-5717-4119-9d6e-b8dff0416638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:27.129100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28976535-5717-4119-9d6e-b8dff0416638 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:27.129792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28976535-5717-4119-9d6e-b8dff0416638 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:27.129792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28976535-5717-4119-9d6e-b8dff0416638 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:27.130820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28976535-5717-4119-9d6e-b8dff0416638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:27.131133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28976535-5717-4119-9d6e-b8dff0416638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:27.132547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28976535-5717-4119-9d6e-b8dff0416638 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:27.146344 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 422/826] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:27.147054 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28976535-5717-4119-9d6e-b8dff0416638 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:27.174898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc0aa1-90f8-4c72-ba4e-985d71ebffd3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:27.211794 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3a8ec-2d71-4d11-bb81-b2f1005d7834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:27.212468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3a8ec-2d71-4d11-bb81-b2f1005d7834 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:27.212774 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3a8ec-2d71-4d11-bb81-b2f1005d7834 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:27.213055 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3a8ec-2d71-4d11-bb81-b2f1005d7834 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:27.213784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3a8ec-2d71-4d11-bb81-b2f1005d7834 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:27.215155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3a8ec-2d71-4d11-bb81-b2f1005d7834 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:27.235161 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 405/827] 10.222.0.66 () {60 vars in 1144 bytes} [Fri Jul 15 20:24:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:24:27.236210 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3a8ec-2d71-4d11-bb81-b2f1005d7834 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:27.252154 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:27.258535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:27.280707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28976535-5717-4119-9d6e-b8dff0416638 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:27.346119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818ff78-39d6-458b-b1ab-624185265ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:27.347198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818ff78-39d6-458b-b1ab-624185265ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:27.347681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818ff78-39d6-458b-b1ab-624185265ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:27.348802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818ff78-39d6-458b-b1ab-624185265ae5 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:27.350268 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818ff78-39d6-458b-b1ab-624185265ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:27.350795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818ff78-39d6-458b-b1ab-624185265ae5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:27.353435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818ff78-39d6-458b-b1ab-624185265ae5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:27.362143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3a8ec-2d71-4d11-bb81-b2f1005d7834 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:27.376986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 423/828] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:27.381200 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818ff78-39d6-458b-b1ab-624185265ae5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:27.407587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c982153-bf76-486a-8f40-7b3bb6e41752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:27.408384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c982153-bf76-486a-8f40-7b3bb6e41752 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:27.408701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c982153-bf76-486a-8f40-7b3bb6e41752 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:27.408972 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c982153-bf76-486a-8f40-7b3bb6e41752 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:27.416979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c982153-bf76-486a-8f40-7b3bb6e41752 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:27.418415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c982153-bf76-486a-8f40-7b3bb6e41752 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-2c982153-bf76-486a-8f40-7b3bb6e41752 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:27.438480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:27.439591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:27.440750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:27.440750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:27.440750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:27.440750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:27.440750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:27.440750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:27.440750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:27.440750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:27.440750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 406/829] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:27.450107 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c982153-bf76-486a-8f40-7b3bb6e41752 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:27.518318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818ff78-39d6-458b-b1ab-624185265ae5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:27.567846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b709f-0f28-45fb-9411-bd38129dc135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:27.568687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b709f-0f28-45fb-9411-bd38129dc135 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:27.569095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b709f-0f28-45fb-9411-bd38129dc135 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:27.569475 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b709f-0f28-45fb-9411-bd38129dc135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:27.569881 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:27.570602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b709f-0f28-45fb-9411-bd38129dc135 None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=b042da9298894712a0a29787a343bf85) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:27.571148 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b709f-0f28-45fb-9411-bd38129dc135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:27.572507 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b709f-0f28-45fb-9411-bd38129dc135 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:27.579794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 424/830] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:27 2022] GET /identity/v3/role_assignments?user.id=b042da9298894712a0a29787a343bf85&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=43e0afe364894278be44a97662ca6f8e => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:27.600693 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c982153-bf76-486a-8f40-7b3bb6e41752 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:27.642274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f980e4c-5859-462b-877a-3e23e2a08c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:27.643215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f980e4c-5859-462b-877a-3e23e2a08c83 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:27.643649 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f980e4c-5859-462b-877a-3e23e2a08c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:27.644076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f980e4c-5859-462b-877a-3e23e2a08c83 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:27.645823 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f980e4c-5859-462b-877a-3e23e2a08c83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:27.646317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f980e4c-5859-462b-877a-3e23e2a08c83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:27.648014 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f980e4c-5859-462b-877a-3e23e2a08c83 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:27.663247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 407/831] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:27.669947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b709f-0f28-45fb-9411-bd38129dc135 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:27.680538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:27.696542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c90f-08a3-4c7c-afce-2c0153037feb None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:27.696917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c90f-08a3-4c7c-afce-2c0153037feb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:27.697132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c90f-08a3-4c7c-afce-2c0153037feb None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:27.699043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 408/832] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:27.704996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772808fb-bba9-4d06-84b8-660065830e5e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:27.705296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772808fb-bba9-4d06-84b8-660065830e5e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:27.705560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772808fb-bba9-4d06-84b8-660065830e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:27.725173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-772808fb-bba9-4d06-84b8-660065830e5e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:27.726632 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-772808fb-bba9-4d06-84b8-660065830e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:27.801830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b709f-0f28-45fb-9411-bd38129dc135 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:27.812868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 409/833] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:24:27.836914 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772808fb-bba9-4d06-84b8-660065830e5e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:27.845668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc689d0-1a62-46d8-9882-5c60c715dd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:27.846577 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc689d0-1a62-46d8-9882-5c60c715dd24 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:27.846890 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc689d0-1a62-46d8-9882-5c60c715dd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:27.847150 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc689d0-1a62-46d8-9882-5c60c715dd24 None admin] PATH_INFO: `/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/4eed1d3c16354c8c9af8c01cb541c11c/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:27.849930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc689d0-1a62-46d8-9882-5c60c715dd24 None admin] RBAC: Authorizing `identity:create_grant(project_id=52dd45fcba114e3f8ff40d8b954ee5cc, user_id=4eed1d3c16354c8c9af8c01cb541c11c, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:27.851377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc689d0-1a62-46d8-9882-5c60c715dd24 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:27.872497 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 425/834] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:24:27 2022] PUT /identity/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/4eed1d3c16354c8c9af8c01cb541c11c/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:24:27.919591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:27.960860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772808fb-bba9-4d06-84b8-660065830e5e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:28.011219 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57bd5f-42d4-4d8c-b9c9-ad5b186325de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:28.012117 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57bd5f-42d4-4d8c-b9c9-ad5b186325de None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:28.012423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57bd5f-42d4-4d8c-b9c9-ad5b186325de None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:28.012713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57bd5f-42d4-4d8c-b9c9-ad5b186325de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:28.026237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57bd5f-42d4-4d8c-b9c9-ad5b186325de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4d57bd5f-42d4-4d8c-b9c9-ad5b186325de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:28.034602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:28.035657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:28.036519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:28.036519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:28.036519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:28.036519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:28.036519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:28.036519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:28.036519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:28.036519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:28.036519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:28.036519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:28.036519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:24:28.036519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:28.037703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 410/835] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:24:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:28.043871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc689d0-1a62-46d8-9882-5c60c715dd24 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:28.121249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:28.163791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc689d0-1a62-46d8-9882-5c60c715dd24 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:28.205358 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3f35d-b53b-4be5-b40d-d309c9615805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:28.205955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3f35d-b53b-4be5-b40d-d309c9615805 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:28.206240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3f35d-b53b-4be5-b40d-d309c9615805 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:28.206518 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3f35d-b53b-4be5-b40d-d309c9615805 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:28.207801 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3f35d-b53b-4be5-b40d-d309c9615805 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:28.208110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3f35d-b53b-4be5-b40d-d309c9615805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:28.209519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3f35d-b53b-4be5-b40d-d309c9615805 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:28.218353 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 426/836] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:24:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:28.224372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57bd5f-42d4-4d8c-b9c9-ad5b186325de None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:28.338326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57bd5f-42d4-4d8c-b9c9-ad5b186325de None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:28.365987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:28.375561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d841e3-a686-4d1b-a638-9dd7bc2cb95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:28.376363 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d841e3-a686-4d1b-a638-9dd7bc2cb95e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:28.376676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d841e3-a686-4d1b-a638-9dd7bc2cb95e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:28.376958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d841e3-a686-4d1b-a638-9dd7bc2cb95e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:28.388668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d841e3-a686-4d1b-a638-9dd7bc2cb95e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:28.390142 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d841e3-a686-4d1b-a638-9dd7bc2cb95e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-55d841e3-a686-4d1b-a638-9dd7bc2cb95e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:28.408344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:28.409637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:28.411489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:28.411489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:28.411489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:28.411489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:28.411489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 411/837] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:28.417522 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3f35d-b53b-4be5-b40d-d309c9615805 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:28.531212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3f35d-b53b-4be5-b40d-d309c9615805 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:28.561873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:28.572017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43f900-4b30-4d21-bce4-c999ff5a09bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:28.573079 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f900-4b30-4d21-bce4-c999ff5a09bf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:28.573568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f900-4b30-4d21-bce4-c999ff5a09bf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:28.574060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f900-4b30-4d21-bce4-c999ff5a09bf None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:28.574986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43f900-4b30-4d21-bce4-c999ff5a09bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:28.575505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43f900-4b30-4d21-bce4-c999ff5a09bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:28.577123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43f900-4b30-4d21-bce4-c999ff5a09bf None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:28.590916 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 427/838] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:28.596547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d841e3-a686-4d1b-a638-9dd7bc2cb95e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:28.712157 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d841e3-a686-4d1b-a638-9dd7bc2cb95e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:28.747432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d5aa8-2553-4773-9fa9-20b2b77b1647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:28.748241 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d5aa8-2553-4773-9fa9-20b2b77b1647 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:28.748567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d5aa8-2553-4773-9fa9-20b2b77b1647 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:28.748846 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d5aa8-2553-4773-9fa9-20b2b77b1647 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:28.757189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d5aa8-2553-4773-9fa9-20b2b77b1647 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:28.758637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d5aa8-2553-4773-9fa9-20b2b77b1647 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-662d5aa8-2553-4773-9fa9-20b2b77b1647 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:28.773615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:28.774538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:28.775515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:28.775515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:28.775515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:28.775515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:28.775515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:28.775515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:28.775515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:28.775515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:28.775515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 20:24:28.775515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:28.775515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 412/839] 10.222.0.66 () {56 vars in 1117 bytes} [Fri Jul 15 20:24:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:28.780467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43f900-4b30-4d21-bce4-c999ff5a09bf None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:28.894215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43f900-4b30-4d21-bce4-c999ff5a09bf None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:28.930976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1473e-ec73-40b9-97e1-137ccb788c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:28.932011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1473e-ec73-40b9-97e1-137ccb788c04 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:28.932526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1473e-ec73-40b9-97e1-137ccb788c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:28.933005 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1473e-ec73-40b9-97e1-137ccb788c04 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:28.934058 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1473e-ec73-40b9-97e1-137ccb788c04 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:28.934666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1473e-ec73-40b9-97e1-137ccb788c04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:28.936287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1473e-ec73-40b9-97e1-137ccb788c04 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:28.954618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 428/840] 10.222.0.66 () {56 vars in 1149 bytes} [Fri Jul 15 20:24:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:28.960584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d5aa8-2553-4773-9fa9-20b2b77b1647 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:29.004180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:29.070632 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d5aa8-2553-4773-9fa9-20b2b77b1647 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:29.110952 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c0743-fc98-4e00-971f-1ef72a7f13ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:29.111605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c0743-fc98-4e00-971f-1ef72a7f13ab None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:29.111891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c0743-fc98-4e00-971f-1ef72a7f13ab None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:29.112170 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c0743-fc98-4e00-971f-1ef72a7f13ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:29.182624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c0743-fc98-4e00-971f-1ef72a7f13ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:29.184098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c0743-fc98-4e00-971f-1ef72a7f13ab None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:29.224635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:29.287262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 413/841] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:24:29.292918 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1473e-ec73-40b9-97e1-137ccb788c04 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:29.342853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:29.401839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1473e-ec73-40b9-97e1-137ccb788c04 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:29.446916 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337fd13-f23f-447b-9b7b-4fcaa2ab7dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:29.447756 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337fd13-f23f-447b-9b7b-4fcaa2ab7dbe None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:29.448059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337fd13-f23f-447b-9b7b-4fcaa2ab7dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:29.448340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337fd13-f23f-447b-9b7b-4fcaa2ab7dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:29.464231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337fd13-f23f-447b-9b7b-4fcaa2ab7dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:29.465915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337fd13-f23f-447b-9b7b-4fcaa2ab7dbe None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-5337fd13-f23f-447b-9b7b-4fcaa2ab7dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:29.484303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:29.485273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:29.486152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:29.486152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:29.486152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:29.486152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:29.488105 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 429/842] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:29.494734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c0743-fc98-4e00-971f-1ef72a7f13ab None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:29.510814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e95669-1259-4f2e-ad26-6ce4ba6969b0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:29.511242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e95669-1259-4f2e-ad26-6ce4ba6969b0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:29.511783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e95669-1259-4f2e-ad26-6ce4ba6969b0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:29.516466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 430/843] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:29.521435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de1370-142f-49ed-b8ff-9d64a433285f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:29.521820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de1370-142f-49ed-b8ff-9d64a433285f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:29.522175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de1370-142f-49ed-b8ff-9d64a433285f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:29.543575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-97de1370-142f-49ed-b8ff-9d64a433285f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:29.544887 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-97de1370-142f-49ed-b8ff-9d64a433285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:29.622502 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c0743-fc98-4e00-971f-1ef72a7f13ab None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:29.632520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 431/844] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:29.646721 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de1370-142f-49ed-b8ff-9d64a433285f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:29.661186 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244141c-9f76-4b6c-9f50-bf57c18b6338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:29.662156 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244141c-9f76-4b6c-9f50-bf57c18b6338 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:29.662445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244141c-9f76-4b6c-9f50-bf57c18b6338 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:29.662717 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244141c-9f76-4b6c-9f50-bf57c18b6338 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:29.663928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244141c-9f76-4b6c-9f50-bf57c18b6338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:29.664661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244141c-9f76-4b6c-9f50-bf57c18b6338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:29.666482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244141c-9f76-4b6c-9f50-bf57c18b6338 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:29.677022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:29.679322 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:29.688767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 414/845] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:29.694789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244141c-9f76-4b6c-9f50-bf57c18b6338 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:29.758503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de1370-142f-49ed-b8ff-9d64a433285f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:29.795375 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1920291-3f50-4a0f-8e89-44342587ccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:29.796428 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1920291-3f50-4a0f-8e89-44342587ccc0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:29.796863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1920291-3f50-4a0f-8e89-44342587ccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:29.797367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1920291-3f50-4a0f-8e89-44342587ccc0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:29.798167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1920291-3f50-4a0f-8e89-44342587ccc0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:29.799709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1920291-3f50-4a0f-8e89-44342587ccc0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:29.799826 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244141c-9f76-4b6c-9f50-bf57c18b6338 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c1920291-3f50-4a0f-8e89-44342587ccc0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:29.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:29.814210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:29.815138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:29.815138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:29.815138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:29.815138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:29.815138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:29.815138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:29.815138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:29.815138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:29.815138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:29.815138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:29.815138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:29.815138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:29.815138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:24:29.815138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:29.817714 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 432/846] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:24:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:29.819186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59177912-28d1-4a84-ab66-331fe64329fa None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:29.819724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59177912-28d1-4a84-ab66-331fe64329fa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:29.820157 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59177912-28d1-4a84-ab66-331fe64329fa None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:29.821610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 433/847] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:29.823960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59177912-28d1-4a84-ab66-331fe64329fa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:29.844529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1269f-0871-4895-a9c0-213b257f0849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:29.845326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1269f-0871-4895-a9c0-213b257f0849 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:29.845600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1269f-0871-4895-a9c0-213b257f0849 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:29.845877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1269f-0871-4895-a9c0-213b257f0849 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:29.853480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1269f-0871-4895-a9c0-213b257f0849 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:29.854926 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1269f-0871-4895-a9c0-213b257f0849 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0eb1269f-0871-4895-a9c0-213b257f0849 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:29.869261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:29.870171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:29.871072 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:29.871072 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:29.871072 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:29.871072 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:29.871072 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:29.871072 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:29.871072 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:29.871072 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:29.872811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 415/848] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:29.875022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cfd83-bc84-4618-9295-61d3976fc924 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:29.875528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cfd83-bc84-4618-9295-61d3976fc924 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:29.875813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cfd83-bc84-4618-9295-61d3976fc924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:29.892854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-849cfd83-bc84-4618-9295-61d3976fc924 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:29.894052 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-849cfd83-bc84-4618-9295-61d3976fc924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:29.923873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:29.935030 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59177912-28d1-4a84-ab66-331fe64329fa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:29.954760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:29.970759 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 416/849] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:29.971813 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548f6c5-4ff6-40ff-8495-58df9155d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:29.972527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548f6c5-4ff6-40ff-8495-58df9155d6aa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:29.972846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548f6c5-4ff6-40ff-8495-58df9155d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:29.973201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548f6c5-4ff6-40ff-8495-58df9155d6aa None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:29.973918 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548f6c5-4ff6-40ff-8495-58df9155d6aa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:29.974227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548f6c5-4ff6-40ff-8495-58df9155d6aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:29.974874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cfd83-bc84-4618-9295-61d3976fc924 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:29.975605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548f6c5-4ff6-40ff-8495-58df9155d6aa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:29.985008 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 434/850] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:24:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:29.990037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548f6c5-4ff6-40ff-8495-58df9155d6aa None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:30.084159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cfd83-bc84-4618-9295-61d3976fc924 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:30.096169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548f6c5-4ff6-40ff-8495-58df9155d6aa None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:30.117850 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690c707-f8b6-434e-964f-9576d2fa1ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:30.118509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c707-f8b6-434e-964f-9576d2fa1ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:30.118795 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c707-f8b6-434e-964f-9576d2fa1ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:30.119073 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c707-f8b6-434e-964f-9576d2fa1ca7 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:30.119854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690c707-f8b6-434e-964f-9576d2fa1ca7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:30.120166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690c707-f8b6-434e-964f-9576d2fa1ca7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:30.121642 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690c707-f8b6-434e-964f-9576d2fa1ca7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:30.129843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de57abb-3aa6-44b5-bb9f-32db01593d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:30.130669 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de57abb-3aa6-44b5-bb9f-32db01593d14 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:30.130950 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de57abb-3aa6-44b5-bb9f-32db01593d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:30.131225 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de57abb-3aa6-44b5-bb9f-32db01593d14 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:30.131929 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de57abb-3aa6-44b5-bb9f-32db01593d14 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:30.132232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de57abb-3aa6-44b5-bb9f-32db01593d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:30.133530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 417/851] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:30.133638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de57abb-3aa6-44b5-bb9f-32db01593d14 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:30.134325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690c707-f8b6-434e-964f-9576d2fa1ca7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:30.138102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 435/852] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:24:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:30.139476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476eb0bb-f235-4985-8543-119635249855 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:30.139770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476eb0bb-f235-4985-8543-119635249855 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:30.140048 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476eb0bb-f235-4985-8543-119635249855 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:30.141484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 436/853] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:30.145474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476eb0bb-f235-4985-8543-119635249855 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:30.172329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:30.193699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:30.256793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690c707-f8b6-434e-964f-9576d2fa1ca7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:30.267923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476eb0bb-f235-4985-8543-119635249855 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:30.293402 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bdf42-d995-41bf-b397-18db08989ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:30.294214 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bdf42-d995-41bf-b397-18db08989ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:30.294499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bdf42-d995-41bf-b397-18db08989ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:30.295190 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bdf42-d995-41bf-b397-18db08989ec7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:30.295425 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bdf42-d995-41bf-b397-18db08989ec7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:30.296841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bdf42-d995-41bf-b397-18db08989ec7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:30.311149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec0050-e337-4d11-ac87-e54d1ddbf22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:30.311811 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0050-e337-4d11-ac87-e54d1ddbf22a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c49bdf42-d995-41bf-b397-18db08989ec7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:30.312041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:30.313011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:24:30.313830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:30.314607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0050-e337-4d11-ac87-e54d1ddbf22a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:30.314607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0050-e337-4d11-ac87-e54d1ddbf22a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:30.314607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec0050-e337-4d11-ac87-e54d1ddbf22a None admin] RBAC: Adding query filter params (role.id=c81d50150272454fa5fe29cf1428c69e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=c02568cd42484dfc9c39c2088f024060) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:30.314813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 418/854] 10.222.0.66 () {56 vars in 1132 bytes} [Fri Jul 15 20:24:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:30.314893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec0050-e337-4d11-ac87-e54d1ddbf22a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:30.314963 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb95ba1-89bb-475c-a16a-a91df9a4d1bb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:30.314963 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb95ba1-89bb-475c-a16a-a91df9a4d1bb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:30.315083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb95ba1-89bb-475c-a16a-a91df9a4d1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:30.315148 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec0050-e337-4d11-ac87-e54d1ddbf22a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:30.324430 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 437/855] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:30 2022] GET /identity/v3/role_assignments?user.id=c02568cd42484dfc9c39c2088f024060&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=c81d50150272454fa5fe29cf1428c69e => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:30.327336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec0050-e337-4d11-ac87-e54d1ddbf22a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:30.333735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6cb95ba1-89bb-475c-a16a-a91df9a4d1bb None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:30.335100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6cb95ba1-89bb-475c-a16a-a91df9a4d1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:30.443732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:30.443934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 419/856] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:30.464633 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb95ba1-89bb-475c-a16a-a91df9a4d1bb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:30.468804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec0050-e337-4d11-ac87-e54d1ddbf22a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:30.512108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e823c7-b74f-4e5c-aa64-1c3e880bbcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:30.512108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e823c7-b74f-4e5c-aa64-1c3e880bbcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:30.512108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e823c7-b74f-4e5c-aa64-1c3e880bbcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:30.512924 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:30.513011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e823c7-b74f-4e5c-aa64-1c3e880bbcb5 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:30.513654 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e823c7-b74f-4e5c-aa64-1c3e880bbcb5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:30.514005 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e823c7-b74f-4e5c-aa64-1c3e880bbcb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:30.515694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e823c7-b74f-4e5c-aa64-1c3e880bbcb5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:30.522974 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 438/857] 10.222.0.66 () {56 vars in 1126 bytes} [Fri Jul 15 20:24:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:30.529315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e823c7-b74f-4e5c-aa64-1c3e880bbcb5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:30.584992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb95ba1-89bb-475c-a16a-a91df9a4d1bb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:30.627716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551c894-f0f2-4703-8927-79455d4fc74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:30.628475 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551c894-f0f2-4703-8927-79455d4fc74d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:30.628762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551c894-f0f2-4703-8927-79455d4fc74d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:30.629575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551c894-f0f2-4703-8927-79455d4fc74d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:30.643080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551c894-f0f2-4703-8927-79455d4fc74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3551c894-f0f2-4703-8927-79455d4fc74d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:30.653931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:30.654858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:30.655679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:30.655679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:30.655679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:30.655679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:30.655679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:30.655679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:30.655679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:30.655679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:30.655679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:30.655679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:30.655679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:24:30.655679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:30.656294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 420/858] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:24:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:30.662549 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551c894-f0f2-4703-8927-79455d4fc74d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:30.664341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e823c7-b74f-4e5c-aa64-1c3e880bbcb5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:30.708587 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee21672-9e37-45d2-8af9-f628fbdad9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:30.709278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee21672-9e37-45d2-8af9-f628fbdad9fb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:30.709568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee21672-9e37-45d2-8af9-f628fbdad9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:30.709847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee21672-9e37-45d2-8af9-f628fbdad9fb None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:30.710570 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee21672-9e37-45d2-8af9-f628fbdad9fb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:30.710881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee21672-9e37-45d2-8af9-f628fbdad9fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:30.712753 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee21672-9e37-45d2-8af9-f628fbdad9fb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:30.719258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 439/859] 10.222.0.66 () {56 vars in 1126 bytes} [Fri Jul 15 20:24:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:30.792799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551c894-f0f2-4703-8927-79455d4fc74d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:30.795818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:30.837891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be6b62-750d-4479-8b49-b2e0956c6167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:30.838641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be6b62-750d-4479-8b49-b2e0956c6167 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:30.838928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be6b62-750d-4479-8b49-b2e0956c6167 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:30.839205 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be6b62-750d-4479-8b49-b2e0956c6167 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:30.840017 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be6b62-750d-4479-8b49-b2e0956c6167 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:30.840331 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be6b62-750d-4479-8b49-b2e0956c6167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:30.841827 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be6b62-750d-4479-8b49-b2e0956c6167 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:30.852744 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 421/860] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:24:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:30.859202 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee21672-9e37-45d2-8af9-f628fbdad9fb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:30.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:30.967928 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee21672-9e37-45d2-8af9-f628fbdad9fb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:31.002056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4221381-9ac9-47ab-9058-eb09cd394e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:31.002847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4221381-9ac9-47ab-9058-eb09cd394e8c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:31.003133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4221381-9ac9-47ab-9058-eb09cd394e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:31.003405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4221381-9ac9-47ab-9058-eb09cd394e8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:31.014830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4221381-9ac9-47ab-9058-eb09cd394e8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:31.016315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4221381-9ac9-47ab-9058-eb09cd394e8c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c4221381-9ac9-47ab-9058-eb09cd394e8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:31.033977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:31.034873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:31.035851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:31.035851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:31.035851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:31.035851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:31.035851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 440/861] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:31.041764 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be6b62-750d-4479-8b49-b2e0956c6167 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:31.149829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be6b62-750d-4479-8b49-b2e0956c6167 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:31.186454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d576de-6076-493d-91c6-54232d44c624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:31.187122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d576de-6076-493d-91c6-54232d44c624 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:31.187406 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d576de-6076-493d-91c6-54232d44c624 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:31.187685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d576de-6076-493d-91c6-54232d44c624 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:31.188416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d576de-6076-493d-91c6-54232d44c624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:31.188734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d576de-6076-493d-91c6-54232d44c624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:31.190114 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d576de-6076-493d-91c6-54232d44c624 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:31.203718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 422/862] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:31.209515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4221381-9ac9-47ab-9058-eb09cd394e8c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:31.273910 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:31.315477 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4221381-9ac9-47ab-9058-eb09cd394e8c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:31.351022 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36cf6b-f8f3-4af5-aeb7-13fa0bb6639c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:31.351813 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36cf6b-f8f3-4af5-aeb7-13fa0bb6639c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:31.352095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36cf6b-f8f3-4af5-aeb7-13fa0bb6639c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:31.352439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36cf6b-f8f3-4af5-aeb7-13fa0bb6639c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:31.360199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36cf6b-f8f3-4af5-aeb7-13fa0bb6639c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:31.361732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36cf6b-f8f3-4af5-aeb7-13fa0bb6639c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-4e36cf6b-f8f3-4af5-aeb7-13fa0bb6639c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:31.375772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:31.376752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:31.377710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:31.377710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:31.377710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:31.377710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:31.377710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:31.377710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:31.377710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:31.377710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:31.377710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 20:24:31.377710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:31.377710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 441/863] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:24:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:31.383598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d576de-6076-493d-91c6-54232d44c624 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:31.411611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:31.495207 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d576de-6076-493d-91c6-54232d44c624 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:31.532673 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490a6c5-25f2-428c-9648-6ef827071726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:31.533269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a6c5-25f2-428c-9648-6ef827071726 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:31.533556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a6c5-25f2-428c-9648-6ef827071726 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:31.533834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a6c5-25f2-428c-9648-6ef827071726 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:31.534673 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490a6c5-25f2-428c-9648-6ef827071726 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:31.534983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490a6c5-25f2-428c-9648-6ef827071726 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:31.537035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490a6c5-25f2-428c-9648-6ef827071726 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:31.555688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 423/864] 10.222.0.66 () {56 vars in 1135 bytes} [Fri Jul 15 20:24:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:31.561289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36cf6b-f8f3-4af5-aeb7-13fa0bb6639c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:31.663706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36cf6b-f8f3-4af5-aeb7-13fa0bb6639c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:31.692545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:31.704035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8015d-fea6-4271-bbbf-084fa8ac5ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:31.704779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8015d-fea6-4271-bbbf-084fa8ac5ded None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:31.705215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8015d-fea6-4271-bbbf-084fa8ac5ded None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:31.705556 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8015d-fea6-4271-bbbf-084fa8ac5ded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:31.780785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8015d-fea6-4271-bbbf-084fa8ac5ded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:31.782252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8015d-fea6-4271-bbbf-084fa8ac5ded None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:31.887966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 442/865] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:24:31.896842 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490a6c5-25f2-428c-9648-6ef827071726 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:31.992664 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:32.011759 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490a6c5-25f2-428c-9648-6ef827071726 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:32.048717 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfab7cc-a583-46fa-83b8-e10e289be931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:32.049515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfab7cc-a583-46fa-83b8-e10e289be931 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:32.049799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfab7cc-a583-46fa-83b8-e10e289be931 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:32.050078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfab7cc-a583-46fa-83b8-e10e289be931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:32.061638 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfab7cc-a583-46fa-83b8-e10e289be931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:32.063094 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfab7cc-a583-46fa-83b8-e10e289be931 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ebfab7cc-a583-46fa-83b8-e10e289be931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:32.081442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:32.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:32.083418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:32.083418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:32.083418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:32.083418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:32.083634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 424/866] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:32.093499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8015d-fea6-4271-bbbf-084fa8ac5ded None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:32.120632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:32.201515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8015d-fea6-4271-bbbf-084fa8ac5ded None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:32.237927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897444bd-5560-4125-ab10-497b03e88d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:32.239229 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a3531-03cb-4e6d-aafb-8807ac3b6efe None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:32.239344 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897444bd-5560-4125-ab10-497b03e88d5d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:32.239528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a3531-03cb-4e6d-aafb-8807ac3b6efe None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:32.239631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897444bd-5560-4125-ab10-497b03e88d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:32.239803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a3531-03cb-4e6d-aafb-8807ac3b6efe None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:32.239899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897444bd-5560-4125-ab10-497b03e88d5d None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:32.240582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897444bd-5560-4125-ab10-497b03e88d5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:32.240893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897444bd-5560-4125-ab10-497b03e88d5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:32.241470 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 425/867] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:24:32.242332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897444bd-5560-4125-ab10-497b03e88d5d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:32.246334 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ccef-56ea-45b8-ab46-6df41261db75 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:32.246622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ccef-56ea-45b8-ab46-6df41261db75 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:32.246900 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ccef-56ea-45b8-ab46-6df41261db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:32.257030 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 443/868] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:32.262372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897444bd-5560-4125-ab10-497b03e88d5d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:32.267129 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a288ccef-56ea-45b8-ab46-6df41261db75 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:32.268655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a288ccef-56ea-45b8-ab46-6df41261db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:32.361010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:32.361208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 426/869] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:24:32.373404 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897444bd-5560-4125-ab10-497b03e88d5d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:32.378347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288ccef-56ea-45b8-ab46-6df41261db75 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:32.416823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51070199-c633-49c0-9a90-43a267e72a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:32.417982 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51070199-c633-49c0-9a90-43a267e72a35 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:32.418490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51070199-c633-49c0-9a90-43a267e72a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:32.419156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51070199-c633-49c0-9a90-43a267e72a35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:32.431970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51070199-c633-49c0-9a90-43a267e72a35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:32.434508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51070199-c633-49c0-9a90-43a267e72a35 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:32.452212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-51070199-c633-49c0-9a90-43a267e72a35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:32.455315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:32.456152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:32.457602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:32.457602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:32.457602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:32.457602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:32.457602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:32.457602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:32.457602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:32.457602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:32.465810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 444/870] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:32.468322 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51070199-c633-49c0-9a90-43a267e72a35 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:32.505353 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288ccef-56ea-45b8-ab46-6df41261db75 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:32.544766 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336720e-6ce7-4c5a-b6f9-52ef8ebdec3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:32.545443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336720e-6ce7-4c5a-b6f9-52ef8ebdec3a None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:32.545728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336720e-6ce7-4c5a-b6f9-52ef8ebdec3a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:32.546003 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336720e-6ce7-4c5a-b6f9-52ef8ebdec3a None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:32.546728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336720e-6ce7-4c5a-b6f9-52ef8ebdec3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:32.548317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336720e-6ce7-4c5a-b6f9-52ef8ebdec3a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:32.568486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 427/871] 10.222.0.66 () {60 vars in 1141 bytes} [Fri Jul 15 20:24:32 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:24:32.602440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51070199-c633-49c0-9a90-43a267e72a35 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:32.650951 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169a6d-9186-4d02-b985-3285bbd403cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:32.651635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456376e0-9d86-4e0d-9647-f5844a000b2c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:32.651932 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456376e0-9d86-4e0d-9647-f5844a000b2c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:32.652214 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456376e0-9d86-4e0d-9647-f5844a000b2c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:32.652868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169a6d-9186-4d02-b985-3285bbd403cc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:32.653350 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169a6d-9186-4d02-b985-3285bbd403cc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:32.653821 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169a6d-9186-4d02-b985-3285bbd403cc None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:32.654833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1169a6d-9186-4d02-b985-3285bbd403cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:32.655469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1169a6d-9186-4d02-b985-3285bbd403cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:32.657342 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1169a6d-9186-4d02-b985-3285bbd403cc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:32.657810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 428/872] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:24:32.659599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c7a54-9d16-4ad3-894d-1bac5a8426c8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:32.659895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c7a54-9d16-4ad3-894d-1bac5a8426c8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:32.660255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c7a54-9d16-4ad3-894d-1bac5a8426c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:32.670230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:32.674382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 445/873] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:32.682426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169a6d-9186-4d02-b985-3285bbd403cc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:32.683031 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6d0c7a54-9d16-4ad3-894d-1bac5a8426c8 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:32.684454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6d0c7a54-9d16-4ad3-894d-1bac5a8426c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:32.784520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 429/874] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:24:32.808203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169a6d-9186-4d02-b985-3285bbd403cc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:32.808603 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c7a54-9d16-4ad3-894d-1bac5a8426c8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:32.844416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcee92f-8dd7-4cbc-b031-4e83b371b6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:32.845417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcee92f-8dd7-4cbc-b031-4e83b371b6ac None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:32.845804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcee92f-8dd7-4cbc-b031-4e83b371b6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:32.846182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcee92f-8dd7-4cbc-b031-4e83b371b6ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:32.847132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcee92f-8dd7-4cbc-b031-4e83b371b6ac None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=4eed1d3c16354c8c9af8c01cb541c11c) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:32.848064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcee92f-8dd7-4cbc-b031-4e83b371b6ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:32.849659 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcee92f-8dd7-4cbc-b031-4e83b371b6ac None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:32.856292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 446/875] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:32 2022] GET /identity/v3/role_assignments?user.id=4eed1d3c16354c8c9af8c01cb541c11c&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=43e0afe364894278be44a97662ca6f8e => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:32.877991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:32.883239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062692b-dce5-4d47-af8b-16d1574bd9a0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:32.883565 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062692b-dce5-4d47-af8b-16d1574bd9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:32.883804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062692b-dce5-4d47-af8b-16d1574bd9a0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:32.885567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 447/876] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:24:32.892792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f193ce3-f371-4856-b589-3c1e241822db None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:32.893223 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f193ce3-f371-4856-b589-3c1e241822db None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:32.893633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f193ce3-f371-4856-b589-3c1e241822db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:32.912787 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1f193ce3-f371-4856-b589-3c1e241822db None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:32.915511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1f193ce3-f371-4856-b589-3c1e241822db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:32.941988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c7a54-9d16-4ad3-894d-1bac5a8426c8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:32.985858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c62a34-d9e1-425d-b690-affb964c8d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:32.986852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c62a34-d9e1-425d-b690-affb964c8d42 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:32.987236 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c62a34-d9e1-425d-b690-affb964c8d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:32.987615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c62a34-d9e1-425d-b690-affb964c8d42 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:32.996382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:33.000631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c62a34-d9e1-425d-b690-affb964c8d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e6c62a34-d9e1-425d-b690-affb964c8d42 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:33.010657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:33.011685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:33.012587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:33.012587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:33.012587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:33.012587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:33.012587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:33.012587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:33.012587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:33.012587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:33.012587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:33.012587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:33.012587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 20:24:33.012587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:33.012587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 430/877] 10.222.0.66 () {56 vars in 1120 bytes} [Fri Jul 15 20:24:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:33.020469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 448/878] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:33.020629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c62a34-d9e1-425d-b690-affb964c8d42 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:33.038918 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f193ce3-f371-4856-b589-3c1e241822db None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:33.149214 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c62a34-d9e1-425d-b690-affb964c8d42 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:33.157282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f193ce3-f371-4856-b589-3c1e241822db None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:33.169101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:33.194705 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e194f-3509-49f2-9294-e159d6ff1e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:33.195316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e194f-3509-49f2-9294-e159d6ff1e1a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:33.195596 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e194f-3509-49f2-9294-e159d6ff1e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:33.195870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e194f-3509-49f2-9294-e159d6ff1e1a None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:33.196670 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e194f-3509-49f2-9294-e159d6ff1e1a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:33.196977 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e194f-3509-49f2-9294-e159d6ff1e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:33.198704 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e194f-3509-49f2-9294-e159d6ff1e1a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:33.204760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dede6-ad09-4706-be18-dfa8465f607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:33.205931 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dede6-ad09-4706-be18-dfa8465f607c None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:33.206445 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dede6-ad09-4706-be18-dfa8465f607c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:33.207486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dede6-ad09-4706-be18-dfa8465f607c None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:33.207923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 431/879] 10.222.0.66 () {56 vars in 1115 bytes} [Fri Jul 15 20:24:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:33.208666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dede6-ad09-4706-be18-dfa8465f607c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:33.210237 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dede6-ad09-4706-be18-dfa8465f607c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:33.213376 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e194f-3509-49f2-9294-e159d6ff1e1a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:33.240447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 449/880] 10.222.0.66 () {60 vars in 1141 bytes} [Fri Jul 15 20:24:33 2022] POST /identity/v3/services => generated 269 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:24:33.341635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e194f-3509-49f2-9294-e159d6ff1e1a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:33.386836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec4583-8d31-4ddf-a87f-d37d3a4711cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:33.387913 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec4583-8d31-4ddf-a87f-d37d3a4711cb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:33.388359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec4583-8d31-4ddf-a87f-d37d3a4711cb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:33.388811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec4583-8d31-4ddf-a87f-d37d3a4711cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:33.401244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec4583-8d31-4ddf-a87f-d37d3a4711cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:33.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec4583-8d31-4ddf-a87f-d37d3a4711cb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6aec4583-8d31-4ddf-a87f-d37d3a4711cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:33.421078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:33.422090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:33.422981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:33.422981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:33.422981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:33.422981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:33.424328 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 432/881] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:33.431850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dede6-ad09-4706-be18-dfa8465f607c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:33.492321 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:33.543278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dede6-ad09-4706-be18-dfa8465f607c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:33.578241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f50b2e-56d5-4e79-9de3-81b4f1552bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:33.578914 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f50b2e-56d5-4e79-9de3-81b4f1552bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:33.579198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f50b2e-56d5-4e79-9de3-81b4f1552bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:33.579471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f50b2e-56d5-4e79-9de3-81b4f1552bb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:33.580195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f50b2e-56d5-4e79-9de3-81b4f1552bb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:33.580529 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f50b2e-56d5-4e79-9de3-81b4f1552bb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:33.581928 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f50b2e-56d5-4e79-9de3-81b4f1552bb1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:33.594680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 450/882] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:33.601088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec4583-8d31-4ddf-a87f-d37d3a4711cb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:33.627549 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:33.706777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec4583-8d31-4ddf-a87f-d37d3a4711cb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:33.744666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e5569-1d06-48d0-b351-72afaeb29c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:33.745484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e5569-1d06-48d0-b351-72afaeb29c2a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:33.745770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e5569-1d06-48d0-b351-72afaeb29c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:33.746047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e5569-1d06-48d0-b351-72afaeb29c2a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:33.755277 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e5569-1d06-48d0-b351-72afaeb29c2a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:33.756758 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e5569-1d06-48d0-b351-72afaeb29c2a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-be7e5569-1d06-48d0-b351-72afaeb29c2a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:33.772499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:33.773445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:33.774368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:33.774368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:33.774368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:33.774368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:33.774368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:33.774368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:33.774368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:33.774368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:33.774368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 20:24:33.774368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:33.774368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 433/883] 10.222.0.66 () {56 vars in 1117 bytes} [Fri Jul 15 20:24:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:33.781000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f50b2e-56d5-4e79-9de3-81b4f1552bb1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:33.893157 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f50b2e-56d5-4e79-9de3-81b4f1552bb1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:33.908498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:33.929877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaca2a7-8143-49f1-819f-bb1bcae4e7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:33.930553 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaca2a7-8143-49f1-819f-bb1bcae4e7ac None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:33.930835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaca2a7-8143-49f1-819f-bb1bcae4e7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:33.931110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaca2a7-8143-49f1-819f-bb1bcae4e7ac None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:33.932000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaca2a7-8143-49f1-819f-bb1bcae4e7ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:33.932311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaca2a7-8143-49f1-819f-bb1bcae4e7ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:33.933876 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaca2a7-8143-49f1-819f-bb1bcae4e7ac None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:33.951944 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 451/884] 10.222.0.66 () {56 vars in 1149 bytes} [Fri Jul 15 20:24:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:33.957648 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e5569-1d06-48d0-b351-72afaeb29c2a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:34.046012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:34.066030 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e5569-1d06-48d0-b351-72afaeb29c2a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:34.101575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09d219-d6ef-4c41-b81c-ab2afd0ef782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:34.102263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09d219-d6ef-4c41-b81c-ab2afd0ef782 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:34.102550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09d219-d6ef-4c41-b81c-ab2afd0ef782 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:34.102821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09d219-d6ef-4c41-b81c-ab2afd0ef782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:34.175472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09d219-d6ef-4c41-b81c-ab2afd0ef782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:34.177508 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09d219-d6ef-4c41-b81c-ab2afd0ef782 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:34.262584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:34.280319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 434/885] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:33 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:24:34.286122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaca2a7-8143-49f1-819f-bb1bcae4e7ac None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:34.389793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaca2a7-8143-49f1-819f-bb1bcae4e7ac None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:34.425569 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c10f0a-dbed-4c4e-ad1d-d5abbae90ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:34.426501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c10f0a-dbed-4c4e-ad1d-d5abbae90ece None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:34.426781 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c10f0a-dbed-4c4e-ad1d-d5abbae90ece None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:34.427053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c10f0a-dbed-4c4e-ad1d-d5abbae90ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:34.437478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c10f0a-dbed-4c4e-ad1d-d5abbae90ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:34.438979 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c10f0a-dbed-4c4e-ad1d-d5abbae90ece None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-b0c10f0a-dbed-4c4e-ad1d-d5abbae90ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:34.460872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:34.461745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:34.463036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:34.463036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:34.463036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:34.463036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:34.463036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 452/886] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:34.467936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09d219-d6ef-4c41-b81c-ab2afd0ef782 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:34.574645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09d219-d6ef-4c41-b81c-ab2afd0ef782 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:34.610477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c1af4-48e0-4ea7-91ce-2df93d436a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:34.610477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c1af4-48e0-4ea7-91ce-2df93d436a5b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:34.611382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c1af4-48e0-4ea7-91ce-2df93d436a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:34.611382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c1af4-48e0-4ea7-91ce-2df93d436a5b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:34.611683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c1af4-48e0-4ea7-91ce-2df93d436a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:34.616420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c1af4-48e0-4ea7-91ce-2df93d436a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:34.616420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c1af4-48e0-4ea7-91ce-2df93d436a5b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:34.625879 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 435/887] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:34.635349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c10f0a-dbed-4c4e-ad1d-d5abbae90ece None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:34.664812 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:34.727668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c315c2-88ec-4bac-b0a2-383a4533ca0f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:34.727855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c315c2-88ec-4bac-b0a2-383a4533ca0f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:34.728130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c315c2-88ec-4bac-b0a2-383a4533ca0f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:34.729943 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 436/888] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:24:34.738388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a82b3d-1eea-4ca4-a5fb-be4bd6cb2b00 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:34.738818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a82b3d-1eea-4ca4-a5fb-be4bd6cb2b00 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:34.739197 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a82b3d-1eea-4ca4-a5fb-be4bd6cb2b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:34.748148 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c10f0a-dbed-4c4e-ad1d-d5abbae90ece None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:34.760900 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c2a82b3d-1eea-4ca4-a5fb-be4bd6cb2b00 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:34.762338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c2a82b3d-1eea-4ca4-a5fb-be4bd6cb2b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:34.785476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5e4a3-0835-4b4a-8d8a-6303bc63992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:34.787050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5e4a3-0835-4b4a-8d8a-6303bc63992f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:34.787502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5e4a3-0835-4b4a-8d8a-6303bc63992f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:34.787930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5e4a3-0835-4b4a-8d8a-6303bc63992f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:34.795510 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5e4a3-0835-4b4a-8d8a-6303bc63992f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:34.797290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5e4a3-0835-4b4a-8d8a-6303bc63992f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d6a5e4a3-0835-4b4a-8d8a-6303bc63992f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:34.812909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:34.813790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:34.814682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:34.814682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:34.814682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:34.814682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:34.814682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:34.814682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:34.814682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:34.814682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:34.815899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:34.820024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 453/889] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:34.825051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5e4a3-0835-4b4a-8d8a-6303bc63992f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:34.860480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 437/890] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:34.873454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a82b3d-1eea-4ca4-a5fb-be4bd6cb2b00 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:34.936419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:34.958460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5e4a3-0835-4b4a-8d8a-6303bc63992f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:34.978773 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a82b3d-1eea-4ca4-a5fb-be4bd6cb2b00 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:35.003457 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e98fc8-ee34-406d-abb5-c4ca3dfdf906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:35.005300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e98fc8-ee34-406d-abb5-c4ca3dfdf906 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:35.005594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e98fc8-ee34-406d-abb5-c4ca3dfdf906 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:35.005875 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e98fc8-ee34-406d-abb5-c4ca3dfdf906 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:35.006741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e98fc8-ee34-406d-abb5-c4ca3dfdf906 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:35.006986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e98fc8-ee34-406d-abb5-c4ca3dfdf906 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:35.008529 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e98fc8-ee34-406d-abb5-c4ca3dfdf906 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:35.016127 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e15b97-755d-488f-86e5-c6ab9efcbbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:35.016974 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e15b97-755d-488f-86e5-c6ab9efcbbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:35.017261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e15b97-755d-488f-86e5-c6ab9efcbbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:35.017531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e15b97-755d-488f-86e5-c6ab9efcbbf7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:35.018184 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e15b97-755d-488f-86e5-c6ab9efcbbf7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:35.019566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e15b97-755d-488f-86e5-c6ab9efcbbf7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:35.021400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 454/891] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:35.022546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabcb8b-deec-4977-b8c7-6e4e40d19843 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:35.022842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabcb8b-deec-4977-b8c7-6e4e40d19843 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:35.023122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabcb8b-deec-4977-b8c7-6e4e40d19843 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:35.024532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 455/892] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:35.029256 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabcb8b-deec-4977-b8c7-6e4e40d19843 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f2e15b97-755d-488f-86e5-c6ab9efcbbf7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:35.037144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:35.038159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:35.039253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:35.039253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:35.039253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:35.039253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:35.039253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:35.039253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:35.039253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:35.039253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:35.039253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:35.039253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:35.039253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:35.039253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:35.039253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:24:35.039253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:35.044617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 438/893] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:24:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:35.046745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4507e7f-f855-46ce-9a5f-9e4a94a99260 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:35.047068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4507e7f-f855-46ce-9a5f-9e4a94a99260 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:35.047349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4507e7f-f855-46ce-9a5f-9e4a94a99260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:35.069340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f4507e7f-f855-46ce-9a5f-9e4a94a99260 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:35.070628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f4507e7f-f855-46ce-9a5f-9e4a94a99260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:35.105315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:35.146185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabcb8b-deec-4977-b8c7-6e4e40d19843 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:35.152789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 439/894] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:35.152789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4507e7f-f855-46ce-9a5f-9e4a94a99260 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:35.192986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68935d-56fc-4f7c-8105-4c879366cf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:35.193683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68935d-56fc-4f7c-8105-4c879366cf65 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:35.193972 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68935d-56fc-4f7c-8105-4c879366cf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:35.194254 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68935d-56fc-4f7c-8105-4c879366cf65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:35.195084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68935d-56fc-4f7c-8105-4c879366cf65 None admin] RBAC: Adding query filter params (role.id=8ba1a71f64804ac08b302f269ea99a20, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=c02568cd42484dfc9c39c2088f024060) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:35.195398 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68935d-56fc-4f7c-8105-4c879366cf65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:35.196865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68935d-56fc-4f7c-8105-4c879366cf65 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:35.202703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 456/895] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:35 2022] GET /identity/v3/role_assignments?user.id=c02568cd42484dfc9c39c2088f024060&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=8ba1a71f64804ac08b302f269ea99a20 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:35.203482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68935d-56fc-4f7c-8105-4c879366cf65 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:35.230109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:35.289633 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4507e7f-f855-46ce-9a5f-9e4a94a99260 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:35.342748 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ea302-6ad3-4eb2-876b-b9a9d6e1fa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:35.343864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ea302-6ad3-4eb2-876b-b9a9d6e1fa81 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:35.344435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ea302-6ad3-4eb2-876b-b9a9d6e1fa81 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:35.344724 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ea302-6ad3-4eb2-876b-b9a9d6e1fa81 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:35.345459 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ea302-6ad3-4eb2-876b-b9a9d6e1fa81 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:35.345770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ea302-6ad3-4eb2-876b-b9a9d6e1fa81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:35.346192 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68935d-56fc-4f7c-8105-4c879366cf65 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:35.347180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ea302-6ad3-4eb2-876b-b9a9d6e1fa81 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:35.354969 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 440/896] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:24:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:35.360344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ea302-6ad3-4eb2-876b-b9a9d6e1fa81 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:35.388927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caeea9-b962-4e73-a2f2-152dc7907403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:35.390130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caeea9-b962-4e73-a2f2-152dc7907403 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:35.390589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caeea9-b962-4e73-a2f2-152dc7907403 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:35.391037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caeea9-b962-4e73-a2f2-152dc7907403 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:35.391957 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8caeea9-b962-4e73-a2f2-152dc7907403 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:35.393611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8caeea9-b962-4e73-a2f2-152dc7907403 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-f8caeea9-b962-4e73-a2f2-152dc7907403 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:35.406340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:35.407357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:35.408176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:35.408176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:35.408176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:35.408176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:35.408176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:35.408176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:35.408176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:35.408176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:35.408176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:35.408176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:35.408176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:35.408176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:35.408176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:35.408176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:35.412119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 457/897] 10.222.0.66 () {56 vars in 1126 bytes} [Fri Jul 15 20:24:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:35.416834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:35.418157 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caeea9-b962-4e73-a2f2-152dc7907403 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:35.483676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ea302-6ad3-4eb2-876b-b9a9d6e1fa81 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:35.508460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:35.517905 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a8882-fa42-4f09-ae2d-2cd60353979d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:35.518560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a8882-fa42-4f09-ae2d-2cd60353979d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:35.518845 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a8882-fa42-4f09-ae2d-2cd60353979d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:35.519122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a8882-fa42-4f09-ae2d-2cd60353979d None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:35.520500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a8882-fa42-4f09-ae2d-2cd60353979d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:35.520959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a8882-fa42-4f09-ae2d-2cd60353979d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:35.522323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a8882-fa42-4f09-ae2d-2cd60353979d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:35.527412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 441/898] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:24:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:35.530257 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46288c3f-3088-45e0-aad0-ff2bc222c52d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:35.530926 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46288c3f-3088-45e0-aad0-ff2bc222c52d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:35.531489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46288c3f-3088-45e0-aad0-ff2bc222c52d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:35.533709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 442/899] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:35.535389 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46288c3f-3088-45e0-aad0-ff2bc222c52d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:35.543986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caeea9-b962-4e73-a2f2-152dc7907403 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:35.581528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904ae96-0754-49c1-a17f-e0c6ac72f10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:35.582276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ae96-0754-49c1-a17f-e0c6ac72f10e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:35.582541 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ae96-0754-49c1-a17f-e0c6ac72f10e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:35.582866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ae96-0754-49c1-a17f-e0c6ac72f10e None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:35.583564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904ae96-0754-49c1-a17f-e0c6ac72f10e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:35.583867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904ae96-0754-49c1-a17f-e0c6ac72f10e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:35.585248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904ae96-0754-49c1-a17f-e0c6ac72f10e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:35.595247 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 458/900] 10.222.0.66 () {56 vars in 1122 bytes} [Fri Jul 15 20:24:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:35.596621 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7eaca-f98e-4f65-9f94-749c0d04c46c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:35.596918 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7eaca-f98e-4f65-9f94-749c0d04c46c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:35.597191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7eaca-f98e-4f65-9f94-749c0d04c46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:35.614803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8ab7eaca-f98e-4f65-9f94-749c0d04c46c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:35.615978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8ab7eaca-f98e-4f65-9f94-749c0d04c46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:35.642352 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:35.650155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46288c3f-3088-45e0-aad0-ff2bc222c52d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:35.685833 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3f0a0-83ce-4857-9003-afbd4194371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:35.686523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3f0a0-83ce-4857-9003-afbd4194371a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:35.686820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3f0a0-83ce-4857-9003-afbd4194371a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:35.687096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3f0a0-83ce-4857-9003-afbd4194371a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:35.687888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3f0a0-83ce-4857-9003-afbd4194371a None admin] RBAC: Adding query filter params (interface=public, service_id=898e72844716478090f2ba5ac550ec2e, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:35.688205 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3f0a0-83ce-4857-9003-afbd4194371a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:35.696791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 459/901] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:35.696959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3f0a0-83ce-4857-9003-afbd4194371a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:35.697045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7eaca-f98e-4f65-9f94-749c0d04c46c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:35.697117 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 443/902] 10.222.0.66 () {56 vars in 1251 bytes} [Fri Jul 15 20:24:35 2022] GET /identity/v3/endpoints?service_id=898e72844716478090f2ba5ac550ec2e&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:35.700843 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3f0a0-83ce-4857-9003-afbd4194371a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:35.764916 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:35.802910 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7eaca-f98e-4f65-9f94-749c0d04c46c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:35.807372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3f0a0-83ce-4857-9003-afbd4194371a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:35.842844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9e66b-6d4e-45a4-ad06-d5c8cd787769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:35.843657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9e66b-6d4e-45a4-ad06-d5c8cd787769 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:35.844058 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9e66b-6d4e-45a4-ad06-d5c8cd787769 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:35.844400 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9e66b-6d4e-45a4-ad06-d5c8cd787769 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:35.845098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9e66b-6d4e-45a4-ad06-d5c8cd787769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:35.845868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bfb1e-9b13-44b6-bdd2-9065361e463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:35.846458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9e66b-6d4e-45a4-ad06-d5c8cd787769 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:35.846567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bfb1e-9b13-44b6-bdd2-9065361e463a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:35.846810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bfb1e-9b13-44b6-bdd2-9065361e463a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:35.847090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bfb1e-9b13-44b6-bdd2-9065361e463a None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:35.849258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bfb1e-9b13-44b6-bdd2-9065361e463a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:35.849578 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bfb1e-9b13-44b6-bdd2-9065361e463a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:35.851191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bfb1e-9b13-44b6-bdd2-9065361e463a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:35.860663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 444/903] 10.222.0.66 () {56 vars in 1087 bytes} [Fri Jul 15 20:24:35 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:24:35.860663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9e66b-6d4e-45a4-ad06-d5c8cd787769 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:35.866548 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 460/904] 10.222.0.66 () {56 vars in 1122 bytes} [Fri Jul 15 20:24:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:35.890594 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:35.987666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9e66b-6d4e-45a4-ad06-d5c8cd787769 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:36.029804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c53f1-ee25-42a4-a4f9-da31f8c8df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:36.030551 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c53f1-ee25-42a4-a4f9-da31f8c8df38 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:36.030835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c53f1-ee25-42a4-a4f9-da31f8c8df38 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:36.031113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c53f1-ee25-42a4-a4f9-da31f8c8df38 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:36.031778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c53f1-ee25-42a4-a4f9-da31f8c8df38 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:36.033217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c53f1-ee25-42a4-a4f9-da31f8c8df38 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-5a2c53f1-ee25-42a4-a4f9-da31f8c8df38 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:36.046968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:36.047930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:36.048809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 445/905] 10.222.0.66 () {56 vars in 1132 bytes} [Fri Jul 15 20:24:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:36.054508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bfb1e-9b13-44b6-bdd2-9065361e463a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:36.167414 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bfb1e-9b13-44b6-bdd2-9065361e463a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:36.200164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:36.206251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80203cc8-1dbe-4fba-8286-d3d807013156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:36.207547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80203cc8-1dbe-4fba-8286-d3d807013156 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:36.208425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80203cc8-1dbe-4fba-8286-d3d807013156 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:36.208732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80203cc8-1dbe-4fba-8286-d3d807013156 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:36.209456 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80203cc8-1dbe-4fba-8286-d3d807013156 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:36.209768 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80203cc8-1dbe-4fba-8286-d3d807013156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:36.211155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80203cc8-1dbe-4fba-8286-d3d807013156 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:36.216438 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 461/906] 10.222.0.66 () {56 vars in 1126 bytes} [Fri Jul 15 20:24:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:36.222038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c53f1-ee25-42a4-a4f9-da31f8c8df38 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:36.319726 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:36.332707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c53f1-ee25-42a4-a4f9-da31f8c8df38 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:36.374859 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba36013-1cad-4582-a52d-fe8967cad841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:36.375530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba36013-1cad-4582-a52d-fe8967cad841 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:36.375816 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba36013-1cad-4582-a52d-fe8967cad841 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:36.376098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba36013-1cad-4582-a52d-fe8967cad841 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:36.376865 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba36013-1cad-4582-a52d-fe8967cad841 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:36.377173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba36013-1cad-4582-a52d-fe8967cad841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:36.378550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba36013-1cad-4582-a52d-fe8967cad841 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:36.384263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 446/907] 10.222.0.66 () {56 vars in 1126 bytes} [Fri Jul 15 20:24:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:36.390042 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80203cc8-1dbe-4fba-8286-d3d807013156 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:36.497454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80203cc8-1dbe-4fba-8286-d3d807013156 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:36.532038 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b967a-de4f-4862-a034-fba210ef8876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:36.532805 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b967a-de4f-4862-a034-fba210ef8876 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:36.533087 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b967a-de4f-4862-a034-fba210ef8876 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:36.533357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b967a-de4f-4862-a034-fba210ef8876 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:36.534137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b967a-de4f-4862-a034-fba210ef8876 None admin] RBAC: Adding query filter params (interface=public, service_id=f7e676c0e54449bc8d3e8b3254155e9d, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:36.534445 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b967a-de4f-4862-a034-fba210ef8876 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:36.535851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b967a-de4f-4862-a034-fba210ef8876 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:36.545872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 462/908] 10.222.0.66 () {56 vars in 1251 bytes} [Fri Jul 15 20:24:36 2022] GET /identity/v3/endpoints?service_id=f7e676c0e54449bc8d3e8b3254155e9d&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:36.547186 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba36013-1cad-4582-a52d-fe8967cad841 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:36.652418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba36013-1cad-4582-a52d-fe8967cad841 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:36.688634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99310844-cffb-4238-b06e-0f76fd2f1821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:36.689312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99310844-cffb-4238-b06e-0f76fd2f1821 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:36.689598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99310844-cffb-4238-b06e-0f76fd2f1821 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:36.689878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99310844-cffb-4238-b06e-0f76fd2f1821 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:36.690570 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99310844-cffb-4238-b06e-0f76fd2f1821 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:36.692118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99310844-cffb-4238-b06e-0f76fd2f1821 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:36.698532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 447/909] 10.222.0.66 () {56 vars in 1087 bytes} [Fri Jul 15 20:24:36 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:24:37.277664 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c22fc-9d54-47ab-88fb-92e18ae9c8e2 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:37.278181 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c22fc-9d54-47ab-88fb-92e18ae9c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:37.278256 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c22fc-9d54-47ab-88fb-92e18ae9c8e2 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:37.280030 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 463/910] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:37.285320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee7d0b-4743-45f9-8d59-4009274cd34f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:37.285842 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee7d0b-4743-45f9-8d59-4009274cd34f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:37.286198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee7d0b-4743-45f9-8d59-4009274cd34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:37.304079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-efee7d0b-4743-45f9-8d59-4009274cd34f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:37.305293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-efee7d0b-4743-45f9-8d59-4009274cd34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:37.317182 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:37.384477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 448/911] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:37.406493 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c22fc-9d54-47ab-88fb-92e18ae9c8e2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:37.478650 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:37.522840 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c22fc-9d54-47ab-88fb-92e18ae9c8e2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:37.558458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62008121-bf42-4ec6-87bc-eed8ebd3d7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:37.559492 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62008121-bf42-4ec6-87bc-eed8ebd3d7cf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:37.559919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62008121-bf42-4ec6-87bc-eed8ebd3d7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:37.560334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62008121-bf42-4ec6-87bc-eed8ebd3d7cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:37.571630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62008121-bf42-4ec6-87bc-eed8ebd3d7cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-62008121-bf42-4ec6-87bc-eed8ebd3d7cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:37.580024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:37.581127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:37.582332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:37.582332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:37.582332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:37.582332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:37.582332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:37.582332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:37.582332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:37.582332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:37.582332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:37.582332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:37.582332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 20:24:37.582332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:37.584825 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 464/912] 10.222.0.66 () {56 vars in 1120 bytes} [Fri Jul 15 20:24:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:37.596412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee7d0b-4743-45f9-8d59-4009274cd34f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:37.690792 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee7d0b-4743-45f9-8d59-4009274cd34f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:37.726817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2d1ab-24ac-49e5-b929-edc9c23ae007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:37.727490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2d1ab-24ac-49e5-b929-edc9c23ae007 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:37.727778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2d1ab-24ac-49e5-b929-edc9c23ae007 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:37.728059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2d1ab-24ac-49e5-b929-edc9c23ae007 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:37.728849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2d1ab-24ac-49e5-b929-edc9c23ae007 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:37.729161 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2d1ab-24ac-49e5-b929-edc9c23ae007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:37.730549 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2d1ab-24ac-49e5-b929-edc9c23ae007 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:37.740518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 449/913] 10.222.0.66 () {56 vars in 1115 bytes} [Fri Jul 15 20:24:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:37.749692 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62008121-bf42-4ec6-87bc-eed8ebd3d7cf None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:37.857369 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62008121-bf42-4ec6-87bc-eed8ebd3d7cf None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:37.876120 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:37.896123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73053dc3-556d-4fe6-8f27-3a01509ef874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:37.897242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73053dc3-556d-4fe6-8f27-3a01509ef874 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:37.897667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73053dc3-556d-4fe6-8f27-3a01509ef874 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:37.898111 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73053dc3-556d-4fe6-8f27-3a01509ef874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:37.909311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73053dc3-556d-4fe6-8f27-3a01509ef874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:37.911748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73053dc3-556d-4fe6-8f27-3a01509ef874 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-73053dc3-556d-4fe6-8f27-3a01509ef874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:37.929668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:37.930784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:37.931879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:37.931879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:37.931879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:37.931879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:37.933854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 465/914] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:37.939105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2d1ab-24ac-49e5-b929-edc9c23ae007 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:37.951615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:37.984434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98222c1e-8847-43bf-8eb6-cace7e93cf16 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:37.984711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98222c1e-8847-43bf-8eb6-cace7e93cf16 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:37.984998 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98222c1e-8847-43bf-8eb6-cace7e93cf16 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:37.986631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 466/915] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:24:37.991875 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33a2df-b049-4146-ada7-3ad1aaab67af None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:37.992162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33a2df-b049-4146-ada7-3ad1aaab67af None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:37.992474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33a2df-b049-4146-ada7-3ad1aaab67af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:38.009184 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8d33a2df-b049-4146-ada7-3ad1aaab67af None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:38.010364 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8d33a2df-b049-4146-ada7-3ad1aaab67af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:38.051223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2d1ab-24ac-49e5-b929-edc9c23ae007 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:38.088486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 467/916] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:24:38.091837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677abaa-0fca-4b8d-af93-b46b155ac8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:38.092532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677abaa-0fca-4b8d-af93-b46b155ac8ed None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:38.092821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677abaa-0fca-4b8d-af93-b46b155ac8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:38.093104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677abaa-0fca-4b8d-af93-b46b155ac8ed None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:38.093829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677abaa-0fca-4b8d-af93-b46b155ac8ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:38.094140 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677abaa-0fca-4b8d-af93-b46b155ac8ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:38.095570 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677abaa-0fca-4b8d-af93-b46b155ac8ed None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:38.100788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979f3bf-7803-45de-8080-0fcc11def767 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:38.101088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979f3bf-7803-45de-8080-0fcc11def767 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:38.101437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979f3bf-7803-45de-8080-0fcc11def767 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:38.103031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 468/917] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:38.103717 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979f3bf-7803-45de-8080-0fcc11def767 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:38.110611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 450/918] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:38.111807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03e43a-3c23-45f3-a670-66e6a2a5a83e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:38.112099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03e43a-3c23-45f3-a670-66e6a2a5a83e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:38.112378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03e43a-3c23-45f3-a670-66e6a2a5a83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:38.128483 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fc03e43a-3c23-45f3-a670-66e6a2a5a83e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:38.130186 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fc03e43a-3c23-45f3-a670-66e6a2a5a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:38.195208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:38.204433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 451/919] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:38.204433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03e43a-3c23-45f3-a670-66e6a2a5a83e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:38.215267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:38.220235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979f3bf-7803-45de-8080-0fcc11def767 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:38.256618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9474784-6e41-4fd1-b1ca-acd94000e022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:38.257393 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9474784-6e41-4fd1-b1ca-acd94000e022 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:38.257682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9474784-6e41-4fd1-b1ca-acd94000e022 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:38.257963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9474784-6e41-4fd1-b1ca-acd94000e022 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:38.258689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9474784-6e41-4fd1-b1ca-acd94000e022 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:38.260055 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9474784-6e41-4fd1-b1ca-acd94000e022 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:38.276687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 469/920] 10.222.0.66 () {60 vars in 1141 bytes} [Fri Jul 15 20:24:38 2022] POST /identity/v3/services => generated 241 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:24:38.276687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9474784-6e41-4fd1-b1ca-acd94000e022 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:38.335116 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03e43a-3c23-45f3-a670-66e6a2a5a83e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:38.383712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcccf97-0105-4d7e-857e-d36564877bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:38.384573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcccf97-0105-4d7e-857e-d36564877bae None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:38.384837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcccf97-0105-4d7e-857e-d36564877bae None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:38.385126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcccf97-0105-4d7e-857e-d36564877bae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:38.393443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcccf97-0105-4d7e-857e-d36564877bae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:38.395359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcccf97-0105-4d7e-857e-d36564877bae None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7dcccf97-0105-4d7e-857e-d36564877bae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:38.412211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:38.413492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:38.414747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:38.414747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:38.414747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:38.414747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:38.414747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:38.414747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:38.414747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:38.414747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:38.414747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 20:24:38.414747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:38.414747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 452/921] 10.222.0.66 () {56 vars in 1117 bytes} [Fri Jul 15 20:24:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:38.419693 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcccf97-0105-4d7e-857e-d36564877bae None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:38.430262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9474784-6e41-4fd1-b1ca-acd94000e022 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:38.474100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11f32f-51fc-4f43-8ee6-ce96c3383750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:38.474920 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f32f-51fc-4f43-8ee6-ce96c3383750 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:38.475209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f32f-51fc-4f43-8ee6-ce96c3383750 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:38.475487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f32f-51fc-4f43-8ee6-ce96c3383750 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:38.476155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11f32f-51fc-4f43-8ee6-ce96c3383750 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:38.478945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11f32f-51fc-4f43-8ee6-ce96c3383750 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:38.498378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-aa11f32f-51fc-4f43-8ee6-ce96c3383750 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:38.500869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:38.502408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:38.503261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:38.503261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:38.503261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:38.503261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:38.503261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:38.503261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:38.503261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:38.503261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:38.503261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:38.503261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:38.503261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:38.503261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:38.503261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 20:24:38.503261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:38.508508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 470/922] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:24:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:38.510896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11f32f-51fc-4f43-8ee6-ce96c3383750 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:38.545338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:38.565220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcccf97-0105-4d7e-857e-d36564877bae None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:38.602176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf46d8-8995-4883-a2ba-f300fe40bf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:38.602592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf46d8-8995-4883-a2ba-f300fe40bf4d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:38.602870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf46d8-8995-4883-a2ba-f300fe40bf4d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:38.603143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf46d8-8995-4883-a2ba-f300fe40bf4d None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:38.603975 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf46d8-8995-4883-a2ba-f300fe40bf4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:38.604298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf46d8-8995-4883-a2ba-f300fe40bf4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:38.605767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf46d8-8995-4883-a2ba-f300fe40bf4d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:38.626948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 453/923] 10.222.0.66 () {56 vars in 1149 bytes} [Fri Jul 15 20:24:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:38.632727 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf46d8-8995-4883-a2ba-f300fe40bf4d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:38.652120 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11f32f-51fc-4f43-8ee6-ce96c3383750 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:38.689842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d58d-52ec-4225-b88b-89b225d6c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:38.690782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d58d-52ec-4225-b88b-89b225d6c5ac None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:38.691927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d58d-52ec-4225-b88b-89b225d6c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:38.692446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d58d-52ec-4225-b88b-89b225d6c5ac None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:38.693353 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59d58d-52ec-4225-b88b-89b225d6c5ac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:38.693875 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59d58d-52ec-4225-b88b-89b225d6c5ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:38.695437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59d58d-52ec-4225-b88b-89b225d6c5ac None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:38.704499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 471/924] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:24:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:38.707314 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d58d-52ec-4225-b88b-89b225d6c5ac None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:38.762728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf46d8-8995-4883-a2ba-f300fe40bf4d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:38.777621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:38.801767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965eb56d-e688-45ec-b761-767a976dcf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:38.802985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eb56d-e688-45ec-b761-767a976dcf18 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:38.803462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eb56d-e688-45ec-b761-767a976dcf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:38.803929 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eb56d-e688-45ec-b761-767a976dcf18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:38.815306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965eb56d-e688-45ec-b761-767a976dcf18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:38.817895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965eb56d-e688-45ec-b761-767a976dcf18 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:38.830040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-965eb56d-e688-45ec-b761-767a976dcf18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:38.837788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:38.838684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:38.839612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:38.839612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:38.839612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:38.839612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:38.839612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 454/925] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:38.840820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42732691-0dcd-4c24-a939-834ea2782137 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:38.841168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42732691-0dcd-4c24-a939-834ea2782137 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:38.841505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42732691-0dcd-4c24-a939-834ea2782137 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:38.842978 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 455/926] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:38.844537 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42732691-0dcd-4c24-a939-834ea2782137 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:38.849439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d58d-52ec-4225-b88b-89b225d6c5ac None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:38.886724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712f1dd-cc34-4120-869a-4271996ce259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:38.887504 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712f1dd-cc34-4120-869a-4271996ce259 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:38.887785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712f1dd-cc34-4120-869a-4271996ce259 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:38.888061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712f1dd-cc34-4120-869a-4271996ce259 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:38.888788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712f1dd-cc34-4120-869a-4271996ce259 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:38.889092 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712f1dd-cc34-4120-869a-4271996ce259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:38.890453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712f1dd-cc34-4120-869a-4271996ce259 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:38.895649 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 472/927] 10.222.0.66 () {56 vars in 1114 bytes} [Fri Jul 15 20:24:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:38.901360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fe0df-3940-4d37-923d-7f130ea06edd None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:38.901653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fe0df-3940-4d37-923d-7f130ea06edd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:38.901933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fe0df-3940-4d37-923d-7f130ea06edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:38.919302 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f70fe0df-3940-4d37-923d-7f130ea06edd None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:38.920443 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f70fe0df-3940-4d37-923d-7f130ea06edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:38.960183 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42732691-0dcd-4c24-a939-834ea2782137 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:38.992803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 473/928] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:38.996100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01496e68-9d88-4bff-b351-c3afe4cc342b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:38.996799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01496e68-9d88-4bff-b351-c3afe4cc342b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:38.997091 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01496e68-9d88-4bff-b351-c3afe4cc342b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:38.997371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01496e68-9d88-4bff-b351-c3afe4cc342b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:38.997992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fe0df-3940-4d37-923d-7f130ea06edd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:38.998098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01496e68-9d88-4bff-b351-c3afe4cc342b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:38.998395 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01496e68-9d88-4bff-b351-c3afe4cc342b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:38.999777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01496e68-9d88-4bff-b351-c3afe4cc342b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:39.017388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 456/929] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:39.017388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01496e68-9d88-4bff-b351-c3afe4cc342b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:39.043523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:39.090784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:39.111463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fe0df-3940-4d37-923d-7f130ea06edd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:39.126001 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01496e68-9d88-4bff-b351-c3afe4cc342b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:39.147902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bcd0b-3476-4fe6-895a-3a8211d82d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:39.148737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bcd0b-3476-4fe6-895a-3a8211d82d5b None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:39.149020 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bcd0b-3476-4fe6-895a-3a8211d82d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:39.149294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bcd0b-3476-4fe6-895a-3a8211d82d5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:39.150024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bcd0b-3476-4fe6-895a-3a8211d82d5b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:39.151390 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bcd0b-3476-4fe6-895a-3a8211d82d5b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:39.164878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2db34-d1e8-4da3-9a3c-8bc2cee04199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:39.165770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2db34-d1e8-4da3-9a3c-8bc2cee04199 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:39.166122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2db34-d1e8-4da3-9a3c-8bc2cee04199 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:39.166495 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2db34-d1e8-4da3-9a3c-8bc2cee04199 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:39.167407 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2db34-d1e8-4da3-9a3c-8bc2cee04199 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:39.168692 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2db34-d1e8-4da3-9a3c-8bc2cee04199 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:39.174388 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 474/930] 10.222.0.66 () {60 vars in 1144 bytes} [Fri Jul 15 20:24:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:24:39.175848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bcd0b-3476-4fe6-895a-3a8211d82d5b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-dce2db34-d1e8-4da3-9a3c-8bc2cee04199 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:39.182878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:39.183936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:39.184836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 457/931] 10.222.0.66 () {56 vars in 1132 bytes} [Fri Jul 15 20:24:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:39.198310 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2db34-d1e8-4da3-9a3c-8bc2cee04199 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:39.307233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bcd0b-3476-4fe6-895a-3a8211d82d5b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:39.311049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:39.326061 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2db34-d1e8-4da3-9a3c-8bc2cee04199 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:39.348166 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8d768-deb4-4742-bace-9f0aeb23b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:39.349282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d768-deb4-4742-bace-9f0aeb23b703 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:39.349573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d768-deb4-4742-bace-9f0aeb23b703 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:39.349849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d768-deb4-4742-bace-9f0aeb23b703 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:39.351902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:39.357543 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8d768-deb4-4742-bace-9f0aeb23b703 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:39.359258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8d768-deb4-4742-bace-9f0aeb23b703 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:39.368496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487666a8-cc65-414f-b54b-a7a1a860e888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:39.369120 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487666a8-cc65-414f-b54b-a7a1a860e888 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:39.369402 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487666a8-cc65-414f-b54b-a7a1a860e888 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:39.369676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487666a8-cc65-414f-b54b-a7a1a860e888 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:39.370384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487666a8-cc65-414f-b54b-a7a1a860e888 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:39.370694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487666a8-cc65-414f-b54b-a7a1a860e888 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:39.372050 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487666a8-cc65-414f-b54b-a7a1a860e888 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-37c8d768-deb4-4742-bace-9f0aeb23b703 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:39.375513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:39.376360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:39.377839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:39.377839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:39.377839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:39.377839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:39.377839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:39.377839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:39.377839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:39.377839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:39.377839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 475/932] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:39.382239 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 458/933] 10.222.0.66 () {56 vars in 1126 bytes} [Fri Jul 15 20:24:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:39.383389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8d768-deb4-4742-bace-9f0aeb23b703 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:39.388184 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487666a8-cc65-414f-b54b-a7a1a860e888 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:39.509249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487666a8-cc65-414f-b54b-a7a1a860e888 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:39.527946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8d768-deb4-4742-bace-9f0aeb23b703 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:39.557806 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246a444-b35a-4d23-a77f-5c12de3d398d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:39.559078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a444-b35a-4d23-a77f-5c12de3d398d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:39.559572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a444-b35a-4d23-a77f-5c12de3d398d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:39.560225 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a444-b35a-4d23-a77f-5c12de3d398d None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:39.561702 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246a444-b35a-4d23-a77f-5c12de3d398d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:39.562285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246a444-b35a-4d23-a77f-5c12de3d398d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:39.564123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246a444-b35a-4d23-a77f-5c12de3d398d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:39.566027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041a502-df1a-4eff-852d-156d576a93d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:39.567517 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041a502-df1a-4eff-852d-156d576a93d5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:39.567810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041a502-df1a-4eff-852d-156d576a93d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:39.568184 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041a502-df1a-4eff-852d-156d576a93d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:39.569128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041a502-df1a-4eff-852d-156d576a93d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:39.569546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041a502-df1a-4eff-852d-156d576a93d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:39.571069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041a502-df1a-4eff-852d-156d576a93d5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:39.576951 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 459/934] 10.222.0.66 () {56 vars in 1126 bytes} [Fri Jul 15 20:24:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:39.578928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246a444-b35a-4d23-a77f-5c12de3d398d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:39.593544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 476/935] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:39.595150 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041a502-df1a-4eff-852d-156d576a93d5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:39.605997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:39.666385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:39.694349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246a444-b35a-4d23-a77f-5c12de3d398d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:39.717919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041a502-df1a-4eff-852d-156d576a93d5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:39.731417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629ca3b-011c-40d2-891d-c714c6edab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:39.732138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629ca3b-011c-40d2-891d-c714c6edab10 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:39.732443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629ca3b-011c-40d2-891d-c714c6edab10 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:39.732732 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629ca3b-011c-40d2-891d-c714c6edab10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:39.733554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629ca3b-011c-40d2-891d-c714c6edab10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:39.734917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629ca3b-011c-40d2-891d-c714c6edab10 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:39.760424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 460/936] 10.222.0.66 () {60 vars in 1144 bytes} [Fri Jul 15 20:24:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:24:39.780227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4f35d-8ae9-4efb-8a55-8b349f5aa7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:39.781596 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4f35d-8ae9-4efb-8a55-8b349f5aa7b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:39.782102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4f35d-8ae9-4efb-8a55-8b349f5aa7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:39.782592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4f35d-8ae9-4efb-8a55-8b349f5aa7b5 None admin] PATH_INFO: `/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/c02568cd42484dfc9c39c2088f024060/roles/8ba1a71f64804ac08b302f269ea99a20` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:39.785976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4f35d-8ae9-4efb-8a55-8b349f5aa7b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=52dd45fcba114e3f8ff40d8b954ee5cc, user_id=c02568cd42484dfc9c39c2088f024060, role_id=8ba1a71f64804ac08b302f269ea99a20)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:39.787846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4f35d-8ae9-4efb-8a55-8b349f5aa7b5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:39.806040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 477/937] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:24:39 2022] PUT /identity/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/c02568cd42484dfc9c39c2088f024060/roles/8ba1a71f64804ac08b302f269ea99a20 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:24:40.411119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7b5cf-142d-44a2-80c5-d10ac89b001e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:40.411641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7b5cf-142d-44a2-80c5-d10ac89b001e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:40.411759 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7b5cf-142d-44a2-80c5-d10ac89b001e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:40.413304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 461/938] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:40.419024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d57139-d446-46e7-819f-bf3167e3bbd9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:40.419316 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d57139-d446-46e7-819f-bf3167e3bbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:40.419597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d57139-d446-46e7-819f-bf3167e3bbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:40.436722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-59d57139-d446-46e7-819f-bf3167e3bbd9 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:40.437916 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-59d57139-d446-46e7-819f-bf3167e3bbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:40.512438 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 478/939] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:40.539152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7b5cf-142d-44a2-80c5-d10ac89b001e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:40.614971 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:40.647512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7b5cf-142d-44a2-80c5-d10ac89b001e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:40.681400 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5b709-32a7-47bd-8620-a83f077a7373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:40.682469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5b709-32a7-47bd-8620-a83f077a7373 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:40.682965 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5b709-32a7-47bd-8620-a83f077a7373 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:40.683458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5b709-32a7-47bd-8620-a83f077a7373 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:40.684316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5b709-32a7-47bd-8620-a83f077a7373 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:40.685923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5b709-32a7-47bd-8620-a83f077a7373 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-fdb5b709-32a7-47bd-8620-a83f077a7373 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:40.698706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:40.699784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:40.700749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:40.700749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:40.700749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:40.700749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:40.700749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:40.700749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:40.700749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:40.700749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:40.700749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:40.700749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:40.700749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:40.700749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:40.700749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:40.700749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:40.703681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 462/940] 10.222.0.66 () {56 vars in 1126 bytes} [Fri Jul 15 20:24:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:40.709911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d57139-d446-46e7-819f-bf3167e3bbd9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:40.752468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:40.814101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d57139-d446-46e7-819f-bf3167e3bbd9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:40.849172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602fbbc-af98-45eb-ba09-a893e22a6936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:40.849907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602fbbc-af98-45eb-ba09-a893e22a6936 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:40.850194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602fbbc-af98-45eb-ba09-a893e22a6936 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:40.850517 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602fbbc-af98-45eb-ba09-a893e22a6936 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:40.851232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602fbbc-af98-45eb-ba09-a893e22a6936 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:40.851541 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602fbbc-af98-45eb-ba09-a893e22a6936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:40.852951 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602fbbc-af98-45eb-ba09-a893e22a6936 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:40.858238 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 479/941] 10.222.0.66 () {56 vars in 1122 bytes} [Fri Jul 15 20:24:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:40.864851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5b709-32a7-47bd-8620-a83f077a7373 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:40.971679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5b709-32a7-47bd-8620-a83f077a7373 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:41.011266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec304f22-fcd1-409c-a846-9a31743658b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:41.011931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec304f22-fcd1-409c-a846-9a31743658b3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:41.012213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec304f22-fcd1-409c-a846-9a31743658b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:41.012520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec304f22-fcd1-409c-a846-9a31743658b3 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:41.013228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec304f22-fcd1-409c-a846-9a31743658b3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:41.013534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec304f22-fcd1-409c-a846-9a31743658b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:41.014904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec304f22-fcd1-409c-a846-9a31743658b3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:41.021106 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 463/942] 10.222.0.66 () {56 vars in 1122 bytes} [Fri Jul 15 20:24:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:41.021385 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:41.032425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602fbbc-af98-45eb-ba09-a893e22a6936 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:41.131096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602fbbc-af98-45eb-ba09-a893e22a6936 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:41.133498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:41.166978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a49171-03f9-4136-be9b-3809cae2ac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:41.167641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a49171-03f9-4136-be9b-3809cae2ac10 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:41.167972 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a49171-03f9-4136-be9b-3809cae2ac10 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:41.168199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a49171-03f9-4136-be9b-3809cae2ac10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:41.169043 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a49171-03f9-4136-be9b-3809cae2ac10 None admin] RBAC: Adding query filter params (interface=public, service_id=653be9378a2d4051baa7a65c461892ce, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:41.169867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a49171-03f9-4136-be9b-3809cae2ac10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:41.170696 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a49171-03f9-4136-be9b-3809cae2ac10 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:41.176909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 480/943] 10.222.0.66 () {56 vars in 1251 bytes} [Fri Jul 15 20:24:41 2022] GET /identity/v3/endpoints?service_id=653be9378a2d4051baa7a65c461892ce&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:41.182434 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec304f22-fcd1-409c-a846-9a31743658b3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:41.291598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec304f22-fcd1-409c-a846-9a31743658b3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:41.327077 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e6d74-4189-4046-ac52-45bbb1678eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:41.328073 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e6d74-4189-4046-ac52-45bbb1678eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:41.328580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e6d74-4189-4046-ac52-45bbb1678eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:41.329042 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e6d74-4189-4046-ac52-45bbb1678eb2 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:41.329899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e6d74-4189-4046-ac52-45bbb1678eb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:41.331446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e6d74-4189-4046-ac52-45bbb1678eb2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:41.338696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 464/944] 10.222.0.66 () {56 vars in 1087 bytes} [Fri Jul 15 20:24:41 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:24:41.390860 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4c19a-c064-403b-88b1-ddd4018f6ca4 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:41.391472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4c19a-c064-403b-88b1-ddd4018f6ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:41.391929 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4c19a-c064-403b-88b1-ddd4018f6ca4 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:41.393596 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 481/945] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:41.399983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06842877-7ea9-4bd3-86c1-7f66b33b3c45 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:41.400649 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06842877-7ea9-4bd3-86c1-7f66b33b3c45 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:41.401124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06842877-7ea9-4bd3-86c1-7f66b33b3c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:41.421341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-06842877-7ea9-4bd3-86c1-7f66b33b3c45 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:41.423382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-06842877-7ea9-4bd3-86c1-7f66b33b3c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:41.491385 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:41.501322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 465/946] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:41.524573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4c19a-c064-403b-88b1-ddd4018f6ca4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:41.629687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4c19a-c064-403b-88b1-ddd4018f6ca4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:41.666678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39e7e7-6c26-4205-9332-2d881939c741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:41.667352 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39e7e7-6c26-4205-9332-2d881939c741 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:41.667635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39e7e7-6c26-4205-9332-2d881939c741 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:41.667910 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39e7e7-6c26-4205-9332-2d881939c741 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:41.668662 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39e7e7-6c26-4205-9332-2d881939c741 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:41.670089 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39e7e7-6c26-4205-9332-2d881939c741 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:41.671461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: WARNING keystone.server.flask.common [None req-4e39e7e7-6c26-4205-9332-2d881939c741 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 15 20:24:41.689312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.sql.core [None req-4e39e7e7-6c26-4205-9332-2d881939c741 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 20:24:41.689312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 20:24:41.689312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [parameters: {'id': '2c187eb467d14963acdc92bb14f448bc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 20:24:41.689312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80252) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 20:24:41.697077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-4e39e7e7-6c26-4205-9332-2d881939c741 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c187eb467d14963acdc92bb14f448bc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c187eb467d14963acdc92bb14f448bc. Jul 15 20:24:41.697077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:41.697077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 20:24:41.697077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 20:24:41.697077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 20:24:41.697077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 20:24:41.697077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 20:24:41.697077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 20:24:41.697077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 20:24:41.697077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application conn.query(q) Jul 15 20:24:41.697077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 20:24:41.697077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 20:24:41.697077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application result.read() Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 15 20:24:41.697905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application next(self.gen) Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application yield resource Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application next(self.gen) Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise self.value Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application session.commit() Jul 15 20:24:41.699432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.session.flush() Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application compat.raise_( Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 20:24:41.700651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 20:24:41.701567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application conn.query(q) Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application result.read() Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 20:24:41.702368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [parameters: {'id': '2c187eb467d14963acdc92bb14f448bc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:41.705524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:41.707594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:41.708772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:41.708772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 15 20:24:41.708772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 15 20:24:41.708772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:41.708772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:41.708772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 15 20:24:41.708772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 15 20:24:41.708772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c187eb467d14963acdc92bb14f448bc. Jul 15 20:24:41.708772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:41.708772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 482/947] 10.222.0.66 () {60 vars in 1140 bytes} [Fri Jul 15 20:24:41 2022] POST /identity/v3/projects => generated 262 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:41.709465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06842877-7ea9-4bd3-86c1-7f66b33b3c45 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:41.819646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06842877-7ea9-4bd3-86c1-7f66b33b3c45 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:41.856528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188109a6-854a-4be1-ad92-42522aa96807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:41.857395 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188109a6-854a-4be1-ad92-42522aa96807 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:41.857684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188109a6-854a-4be1-ad92-42522aa96807 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:41.857967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188109a6-854a-4be1-ad92-42522aa96807 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:41.865317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188109a6-854a-4be1-ad92-42522aa96807 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:41.866771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188109a6-854a-4be1-ad92-42522aa96807 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-188109a6-854a-4be1-ad92-42522aa96807 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:41.882834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:41.883769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:41.884701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:41.884701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:41.884701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:41.884701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:41.884701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:41.884701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:41.884701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:41.884701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:41.887385 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 466/948] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:41.893307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39e7e7-6c26-4205-9332-2d881939c741 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:41.921627 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:41.938314 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4c754-cb60-441d-ad44-1933c1c68a67 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:41.938639 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4c754-cb60-441d-ad44-1933c1c68a67 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:41.938892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4c754-cb60-441d-ad44-1933c1c68a67 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:41.941669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 467/949] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:24:41.943948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975edc5-6155-4171-a32b-8590b215893d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:41.944624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975edc5-6155-4171-a32b-8590b215893d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:41.944877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975edc5-6155-4171-a32b-8590b215893d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:41.946964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 468/950] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:24:41.948183 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b312f2-3b76-4e19-baf8-79e768e70a58 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:41.948587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b312f2-3b76-4e19-baf8-79e768e70a58 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:41.948965 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b312f2-3b76-4e19-baf8-79e768e70a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:41.966690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-39b312f2-3b76-4e19-baf8-79e768e70a58 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:41.967874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-39b312f2-3b76-4e19-baf8-79e768e70a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:42.005153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39e7e7-6c26-4205-9332-2d881939c741 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:42.020835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:42.039453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 469/951] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:42.040866 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254442d9-38dc-4522-9aa3-ec3b07681998 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:42.041159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254442d9-38dc-4522-9aa3-ec3b07681998 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:42.041435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254442d9-38dc-4522-9aa3-ec3b07681998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:42.049894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece7b95-22d5-4f43-a688-b8e4d78a797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:42.050890 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece7b95-22d5-4f43-a688-b8e4d78a797f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:42.051391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece7b95-22d5-4f43-a688-b8e4d78a797f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:42.052450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece7b95-22d5-4f43-a688-b8e4d78a797f None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:42.053473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece7b95-22d5-4f43-a688-b8e4d78a797f None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:42.054264 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece7b95-22d5-4f43-a688-b8e4d78a797f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:42.056242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece7b95-22d5-4f43-a688-b8e4d78a797f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:42.057737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-254442d9-38dc-4522-9aa3-ec3b07681998 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:42.058910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-254442d9-38dc-4522-9aa3-ec3b07681998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:42.080746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 483/952] 10.222.0.66 () {56 vars in 1112 bytes} [Fri Jul 15 20:24:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:42.081686 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece7b95-22d5-4f43-a688-b8e4d78a797f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:42.152918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 470/953] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:42.171985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254442d9-38dc-4522-9aa3-ec3b07681998 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:42.197454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:42.219945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece7b95-22d5-4f43-a688-b8e4d78a797f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:42.263728 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbee715-0b4f-4b8c-8cdd-4dbd501141b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:42.264581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee715-0b4f-4b8c-8cdd-4dbd501141b4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:42.264901 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee715-0b4f-4b8c-8cdd-4dbd501141b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:42.265245 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee715-0b4f-4b8c-8cdd-4dbd501141b4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:42.276804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbee715-0b4f-4b8c-8cdd-4dbd501141b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-3cbee715-0b4f-4b8c-8cdd-4dbd501141b4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:42.285292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:42.286257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:42.292738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:42.292738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:42.292738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:42.292738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:42.292738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:42.292738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:42.292738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:42.292738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:42.292738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:42.292738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:42.292738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 20:24:42.292738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:42.292738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 484/954] 10.222.0.66 () {56 vars in 1120 bytes} [Fri Jul 15 20:24:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:42.293864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbee715-0b4f-4b8c-8cdd-4dbd501141b4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:42.304078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254442d9-38dc-4522-9aa3-ec3b07681998 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:42.323160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:42.351052 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff1979-6819-452e-b188-28b1854dbd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:42.352103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff1979-6819-452e-b188-28b1854dbd94 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:42.352103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff1979-6819-452e-b188-28b1854dbd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:42.352421 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff1979-6819-452e-b188-28b1854dbd94 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:42.353122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff1979-6819-452e-b188-28b1854dbd94 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:42.354500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff1979-6819-452e-b188-28b1854dbd94 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-bfff1979-6819-452e-b188-28b1854dbd94 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:42.367347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:42.368536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:42.369427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:42.369427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:42.369427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:42.369427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:42.369427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:42.369427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:42.369427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:42.369427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:42.369427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:42.369427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:42.369427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:42.369427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:42.369427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:24:42.369427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:42.372468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 471/955] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:42.374891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff1979-6819-452e-b188-28b1854dbd94 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:42.437174 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbee715-0b4f-4b8c-8cdd-4dbd501141b4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:42.492461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae99d7a-4d9a-4a70-ab83-40594f0d2412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:42.492461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae99d7a-4d9a-4a70-ab83-40594f0d2412 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:42.492461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae99d7a-4d9a-4a70-ab83-40594f0d2412 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:42.492461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae99d7a-4d9a-4a70-ab83-40594f0d2412 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:42.492900 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae99d7a-4d9a-4a70-ab83-40594f0d2412 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:42.492900 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae99d7a-4d9a-4a70-ab83-40594f0d2412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:42.493513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae99d7a-4d9a-4a70-ab83-40594f0d2412 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:42.509490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff1979-6819-452e-b188-28b1854dbd94 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:42.510063 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 485/956] 10.222.0.66 () {56 vars in 1115 bytes} [Fri Jul 15 20:24:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:42.511125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae99d7a-4d9a-4a70-ab83-40594f0d2412 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:42.522143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:42.589167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6f293-2631-467a-aabc-eca46a6780dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:42.590113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6f293-2631-467a-aabc-eca46a6780dd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:42.590538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6f293-2631-467a-aabc-eca46a6780dd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:42.590976 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6f293-2631-467a-aabc-eca46a6780dd None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:42.591890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6f293-2631-467a-aabc-eca46a6780dd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:42.592328 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6f293-2631-467a-aabc-eca46a6780dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:42.593900 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6f293-2631-467a-aabc-eca46a6780dd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:42.601006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 472/957] 10.222.0.66 () {56 vars in 1112 bytes} [Fri Jul 15 20:24:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:42.606663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6f293-2631-467a-aabc-eca46a6780dd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:42.681453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:42.701965 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae99d7a-4d9a-4a70-ab83-40594f0d2412 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:42.760575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd67d7-ee79-4e75-a6e4-d9bcb03805ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:42.761391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd67d7-ee79-4e75-a6e4-d9bcb03805ed None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:42.761676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd67d7-ee79-4e75-a6e4-d9bcb03805ed None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:42.761952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd67d7-ee79-4e75-a6e4-d9bcb03805ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:42.776158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6f293-2631-467a-aabc-eca46a6780dd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:42.787167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd67d7-ee79-4e75-a6e4-d9bcb03805ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:42.788662 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd67d7-ee79-4e75-a6e4-d9bcb03805ed None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-cdfd67d7-ee79-4e75-a6e4-d9bcb03805ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:42.819250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:42.820236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:42.821241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:42.821241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:42.821241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:42.821241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:42.835011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 486/958] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:42.835931 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd67d7-ee79-4e75-a6e4-d9bcb03805ed None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:42.851322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26299f76-344d-4b43-a2f1-f211d381b9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:42.852009 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26299f76-344d-4b43-a2f1-f211d381b9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:42.852296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26299f76-344d-4b43-a2f1-f211d381b9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:42.852603 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26299f76-344d-4b43-a2f1-f211d381b9d7 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:42.853323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26299f76-344d-4b43-a2f1-f211d381b9d7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:42.853639 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26299f76-344d-4b43-a2f1-f211d381b9d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:42.855023 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26299f76-344d-4b43-a2f1-f211d381b9d7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:42.868854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 473/959] 10.222.0.66 () {56 vars in 1112 bytes} [Fri Jul 15 20:24:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:42.952842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:43.060042 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd67d7-ee79-4e75-a6e4-d9bcb03805ed None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:43.098047 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd109ac7-e214-4fd8-adbd-3ea9abdda33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:43.099225 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd109ac7-e214-4fd8-adbd-3ea9abdda33a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:43.099714 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd109ac7-e214-4fd8-adbd-3ea9abdda33a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:43.100191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd109ac7-e214-4fd8-adbd-3ea9abdda33a None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:43.101160 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd109ac7-e214-4fd8-adbd-3ea9abdda33a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:43.101670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd109ac7-e214-4fd8-adbd-3ea9abdda33a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:43.103254 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd109ac7-e214-4fd8-adbd-3ea9abdda33a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:43.120574 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 487/960] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:43.123144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26299f76-344d-4b43-a2f1-f211d381b9d7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:43.238417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26299f76-344d-4b43-a2f1-f211d381b9d7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:43.250068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:43.281523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163fd8e-bd1c-4c9e-afc7-5cb9ff2e85fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:43.282343 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163fd8e-bd1c-4c9e-afc7-5cb9ff2e85fc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:43.282627 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163fd8e-bd1c-4c9e-afc7-5cb9ff2e85fc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:43.282901 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163fd8e-bd1c-4c9e-afc7-5cb9ff2e85fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:43.292028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163fd8e-bd1c-4c9e-afc7-5cb9ff2e85fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:43.293513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163fd8e-bd1c-4c9e-afc7-5cb9ff2e85fc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4163fd8e-bd1c-4c9e-afc7-5cb9ff2e85fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:43.311645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:43.312760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:43.313736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:43.313736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:43.313736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:43.313736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:43.313736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:43.313736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:43.313736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:43.313736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:43.313736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 20:24:43.313736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:43.313736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 474/961] 10.222.0.66 () {56 vars in 1117 bytes} [Fri Jul 15 20:24:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:43.321415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd109ac7-e214-4fd8-adbd-3ea9abdda33a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:43.442495 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd109ac7-e214-4fd8-adbd-3ea9abdda33a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:43.472936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:43.483794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c2b12-39d9-48df-a746-8c712bd1c225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:43.484919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c2b12-39d9-48df-a746-8c712bd1c225 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:43.485283 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c2b12-39d9-48df-a746-8c712bd1c225 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:43.485573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c2b12-39d9-48df-a746-8c712bd1c225 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:43.486432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c2b12-39d9-48df-a746-8c712bd1c225 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:43.486742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c2b12-39d9-48df-a746-8c712bd1c225 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:43.488684 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c2b12-39d9-48df-a746-8c712bd1c225 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:43.513088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 488/962] 10.222.0.66 () {56 vars in 1149 bytes} [Fri Jul 15 20:24:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:43.519138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163fd8e-bd1c-4c9e-afc7-5cb9ff2e85fc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:43.622979 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f8ea3-9560-4fde-9fa8-434c41240a5f None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:43.623643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f8ea3-9560-4fde-9fa8-434c41240a5f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:43.624151 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f8ea3-9560-4fde-9fa8-434c41240a5f None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:43.626040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 489/963] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:43.633357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272313a-d4b5-4795-97d6-ead77dd4d95d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:43.633938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272313a-d4b5-4795-97d6-ead77dd4d95d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:43.634429 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272313a-d4b5-4795-97d6-ead77dd4d95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:43.642494 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163fd8e-bd1c-4c9e-afc7-5cb9ff2e85fc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:43.653908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6272313a-d4b5-4795-97d6-ead77dd4d95d None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:43.655833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6272313a-d4b5-4795-97d6-ead77dd4d95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:43.685678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2e64d-1fbb-42c0-9f45-44a51d552f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:43.686602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2e64d-1fbb-42c0-9f45-44a51d552f17 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:43.686738 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2e64d-1fbb-42c0-9f45-44a51d552f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:43.686962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2e64d-1fbb-42c0-9f45-44a51d552f17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:43.735118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 490/964] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:24:43.741170 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:43.765883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272313a-d4b5-4795-97d6-ead77dd4d95d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:43.773301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2e64d-1fbb-42c0-9f45-44a51d552f17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:43.775195 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2e64d-1fbb-42c0-9f45-44a51d552f17 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:43.903851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 475/965] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:43 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:24:43.912881 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2e64d-1fbb-42c0-9f45-44a51d552f17 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:43.920335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272313a-d4b5-4795-97d6-ead77dd4d95d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:43.930238 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:43.965734 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bca60-68a0-4e9c-abbf-9f52db394989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:43.966683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bca60-68a0-4e9c-abbf-9f52db394989 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:43.966948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bca60-68a0-4e9c-abbf-9f52db394989 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:43.967114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bca60-68a0-4e9c-abbf-9f52db394989 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:43.968144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bca60-68a0-4e9c-abbf-9f52db394989 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:43.970221 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bca60-68a0-4e9c-abbf-9f52db394989 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c57bca60-68a0-4e9c-abbf-9f52db394989 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:43.983778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:43.985458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:43.987203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:43.987203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:43.987203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:43.987203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:43.987203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:43.987203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:43.987203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:43.987203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:43.987203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:43.987203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:43.987203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:43.987203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:43.987203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:43.987203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:43.990349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 491/966] 10.222.0.66 () {56 vars in 1126 bytes} [Fri Jul 15 20:24:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:43.991324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bca60-68a0-4e9c-abbf-9f52db394989 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:44.005493 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:44.053639 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2e64d-1fbb-42c0-9f45-44a51d552f17 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:44.098601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb82158-7e10-4d2b-adc4-03ac6cd3d287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:44.099626 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb82158-7e10-4d2b-adc4-03ac6cd3d287 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:44.099962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb82158-7e10-4d2b-adc4-03ac6cd3d287 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:44.100247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb82158-7e10-4d2b-adc4-03ac6cd3d287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:44.113893 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb82158-7e10-4d2b-adc4-03ac6cd3d287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:44.115588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb82158-7e10-4d2b-adc4-03ac6cd3d287 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:44.118800 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bca60-68a0-4e9c-abbf-9f52db394989 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-bbb82158-7e10-4d2b-adc4-03ac6cd3d287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:44.135725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:44.137303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:44.139672 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:44.139672 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:44.139672 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:44.139672 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:44.141537 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 476/967] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:44.142733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb82158-7e10-4d2b-adc4-03ac6cd3d287 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:44.173216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bb323-39d2-4b9d-9bea-bb8b9665cac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:44.174485 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bb323-39d2-4b9d-9bea-bb8b9665cac9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:44.174953 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bb323-39d2-4b9d-9bea-bb8b9665cac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:44.175469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bb323-39d2-4b9d-9bea-bb8b9665cac9 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:44.176870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bb323-39d2-4b9d-9bea-bb8b9665cac9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:44.177374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bb323-39d2-4b9d-9bea-bb8b9665cac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:44.179789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bb323-39d2-4b9d-9bea-bb8b9665cac9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:44.187719 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 492/968] 10.222.0.66 () {56 vars in 1122 bytes} [Fri Jul 15 20:24:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:44.197408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bb323-39d2-4b9d-9bea-bb8b9665cac9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:44.232696 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:44.268631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb82158-7e10-4d2b-adc4-03ac6cd3d287 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:44.289609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:44.303068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bb323-39d2-4b9d-9bea-bb8b9665cac9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:44.312513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38e62c-2bf1-432a-aa00-315bc37170c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:44.313452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e62c-2bf1-432a-aa00-315bc37170c8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:44.314021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e62c-2bf1-432a-aa00-315bc37170c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:44.314483 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e62c-2bf1-432a-aa00-315bc37170c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:44.315366 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38e62c-2bf1-432a-aa00-315bc37170c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:44.315834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38e62c-2bf1-432a-aa00-315bc37170c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:44.318114 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38e62c-2bf1-432a-aa00-315bc37170c8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:44.332240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 477/969] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:44.337350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38e62c-2bf1-432a-aa00-315bc37170c8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:44.345346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc6675-39ac-40ee-88d7-1450c8d30f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:44.346163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc6675-39ac-40ee-88d7-1450c8d30f19 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:44.346547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc6675-39ac-40ee-88d7-1450c8d30f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:44.346928 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc6675-39ac-40ee-88d7-1450c8d30f19 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:44.347772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc6675-39ac-40ee-88d7-1450c8d30f19 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:44.348176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc6675-39ac-40ee-88d7-1450c8d30f19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:44.349699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc6675-39ac-40ee-88d7-1450c8d30f19 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:44.359838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 493/970] 10.222.0.66 () {56 vars in 1122 bytes} [Fri Jul 15 20:24:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:44.360823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc6675-39ac-40ee-88d7-1450c8d30f19 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:44.459083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38e62c-2bf1-432a-aa00-315bc37170c8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:44.467892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:44.471974 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc6675-39ac-40ee-88d7-1450c8d30f19 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:44.495466 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ff260-6a3c-4bf5-b2d0-43bcf6862cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:44.496265 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ff260-6a3c-4bf5-b2d0-43bcf6862cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:44.496600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ff260-6a3c-4bf5-b2d0-43bcf6862cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:44.496878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ff260-6a3c-4bf5-b2d0-43bcf6862cb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:44.505122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ff260-6a3c-4bf5-b2d0-43bcf6862cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:44.506561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ff260-6a3c-4bf5-b2d0-43bcf6862cb0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:44.509485 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d602209-84f7-4c54-9c98-5aacaeb38671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:44.510163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602209-84f7-4c54-9c98-5aacaeb38671 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:44.510675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602209-84f7-4c54-9c98-5aacaeb38671 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:44.511170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602209-84f7-4c54-9c98-5aacaeb38671 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:44.511930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d602209-84f7-4c54-9c98-5aacaeb38671 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:44.513316 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d602209-84f7-4c54-9c98-5aacaeb38671 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-532ff260-6a3c-4bf5-b2d0-43bcf6862cb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:44.522396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:44.523851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:44.524811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:44.524811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:44.524811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:44.524811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:44.524811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:44.524811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:44.524811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:44.524811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:44.524811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 478/971] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:44.525865 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4077984-1a3b-4178-bb92-231180e2b185 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:44.526123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4077984-1a3b-4178-bb92-231180e2b185 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:44.526405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4077984-1a3b-4178-bb92-231180e2b185 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:44.531775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 479/972] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:44.531775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4077984-1a3b-4178-bb92-231180e2b185 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:44.549349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 494/973] 10.222.0.66 () {60 vars in 1144 bytes} [Fri Jul 15 20:24:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:24:44.549349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2927fa1-3242-4501-8924-614ba597ccc7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:44.549349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2927fa1-3242-4501-8924-614ba597ccc7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:44.549349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2927fa1-3242-4501-8924-614ba597ccc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:44.563321 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b2927fa1-3242-4501-8924-614ba597ccc7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:44.564666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b2927fa1-3242-4501-8924-614ba597ccc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:44.591288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:44.670794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 495/974] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:44.672012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4077984-1a3b-4178-bb92-231180e2b185 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:44.695675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2927fa1-3242-4501-8924-614ba597ccc7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:44.717164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3860a-b4f6-4542-9139-0846ebadffd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:44.717835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3860a-b4f6-4542-9139-0846ebadffd9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:44.718938 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3860a-b4f6-4542-9139-0846ebadffd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:44.718938 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3860a-b4f6-4542-9139-0846ebadffd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:44.719749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3860a-b4f6-4542-9139-0846ebadffd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:44.720540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3860a-b4f6-4542-9139-0846ebadffd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:44.722045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3860a-b4f6-4542-9139-0846ebadffd9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:44.735307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 480/975] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:44.742252 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3860a-b4f6-4542-9139-0846ebadffd9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:44.796641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:44.822291 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2927fa1-3242-4501-8924-614ba597ccc7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:44.866850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b70f6b-4052-4a62-beee-6fce61862fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:44.868653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b70f6b-4052-4a62-beee-6fce61862fc2 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:44.869456 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b70f6b-4052-4a62-beee-6fce61862fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:44.869979 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b70f6b-4052-4a62-beee-6fce61862fc2 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:44.870854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:44.872590 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b70f6b-4052-4a62-beee-6fce61862fc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:44.874486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b70f6b-4052-4a62-beee-6fce61862fc2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:44.874973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3860a-b4f6-4542-9139-0846ebadffd9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:44.896172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.sql.core [None req-21b70f6b-4052-4a62-beee-6fce61862fc2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 20:24:44.896172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 20:24:44.896172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [parameters: {'user_id': '9509190a8d534701953a591bb5342daa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 20:24:44.896172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80252) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-21b70f6b-4052-4a62-beee-6fce61862fc2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application conn.query(q) Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application result.read() Jul 15 20:24:44.907794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 20:24:44.908911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application next(self.gen) Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application yield resource Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application next(self.gen) Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise self.value Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application session.commit() Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 20:24:44.910461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.session.flush() Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application compat.raise_( Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 20:24:44.911667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 20:24:44.912605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application conn.query(q) Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application result.read() Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 20:24:44.913455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [parameters: {'user_id': '9509190a8d534701953a591bb5342daa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:44.916102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 15 20:24:44.918895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 15 20:24:44.921088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 15 20:24:44.921088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 15 20:24:44.921088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 20:24:44.921088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 20:24:44.921088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 20:24:44.921088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:44.921088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 496/976] 10.222.0.66 () {60 vars in 1131 bytes} [Fri Jul 15 20:24:44 2022] POST /identity/v3/users => generated 160 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:44.921088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b70f6b-4052-4a62-beee-6fce61862fc2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:44.922771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da29bb-e2a6-460e-a981-50ea3ef99eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:44.923492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da29bb-e2a6-460e-a981-50ea3ef99eca None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:44.923782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da29bb-e2a6-460e-a981-50ea3ef99eca None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:44.924058 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da29bb-e2a6-460e-a981-50ea3ef99eca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:44.924914 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da29bb-e2a6-460e-a981-50ea3ef99eca None admin] RBAC: Adding query filter params (role.id=8ba1a71f64804ac08b302f269ea99a20, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=c02568cd42484dfc9c39c2088f024060) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:44.925272 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da29bb-e2a6-460e-a981-50ea3ef99eca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:44.926857 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da29bb-e2a6-460e-a981-50ea3ef99eca None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:44.939717 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 481/977] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:44 2022] GET /identity/v3/role_assignments?user.id=c02568cd42484dfc9c39c2088f024060&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=8ba1a71f64804ac08b302f269ea99a20 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:45.053301 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b70f6b-4052-4a62-beee-6fce61862fc2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:45.093782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846a347-5d6f-4878-b6ca-11edfcb43c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:45.094961 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846a347-5d6f-4878-b6ca-11edfcb43c37 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:45.095248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846a347-5d6f-4878-b6ca-11edfcb43c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:45.095525 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846a347-5d6f-4878-b6ca-11edfcb43c37 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:45.104493 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846a347-5d6f-4878-b6ca-11edfcb43c37 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:45.106216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846a347-5d6f-4878-b6ca-11edfcb43c37 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-6846a347-5d6f-4878-b6ca-11edfcb43c37 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:45.121948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:45.122927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:45.123947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:45.123947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:45.123947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:45.123947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:45.123947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:45.123947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:45.123947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:45.123947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:45.123947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 20:24:45.123947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:45.123947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 497/978] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:24:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:45.131435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da29bb-e2a6-460e-a981-50ea3ef99eca None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:45.155101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340871de-a5de-4e0f-b1f2-0620296853cf None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:45.155438 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340871de-a5de-4e0f-b1f2-0620296853cf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:45.155665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340871de-a5de-4e0f-b1f2-0620296853cf None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:45.160803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 498/979] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:45.166049 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7725d5f-756b-47c5-923f-2a85ec5b04ac None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:45.166340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7725d5f-756b-47c5-923f-2a85ec5b04ac None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:45.166622 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7725d5f-756b-47c5-923f-2a85ec5b04ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:45.172288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:45.188597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c7725d5f-756b-47c5-923f-2a85ec5b04ac None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:45.190141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c7725d5f-756b-47c5-923f-2a85ec5b04ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:45.260030 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da29bb-e2a6-460e-a981-50ea3ef99eca None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:45.263922 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 499/980] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:24:45.287707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7725d5f-756b-47c5-923f-2a85ec5b04ac None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:45.299737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec94e80-9288-48a8-8fdd-56ba91be9426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:45.301780 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94e80-9288-48a8-8fdd-56ba91be9426 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:45.302075 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94e80-9288-48a8-8fdd-56ba91be9426 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:45.302356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94e80-9288-48a8-8fdd-56ba91be9426 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:45.303171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec94e80-9288-48a8-8fdd-56ba91be9426 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:45.303535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec94e80-9288-48a8-8fdd-56ba91be9426 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:45.305019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec94e80-9288-48a8-8fdd-56ba91be9426 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:45.348423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 482/981] 10.222.0.66 () {56 vars in 1101 bytes} [Fri Jul 15 20:24:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:45.415135 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7725d5f-756b-47c5-923f-2a85ec5b04ac None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:45.450361 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:45.457264 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc73feb-e813-4646-aaed-081cea57ffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:45.458413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73feb-e813-4646-aaed-081cea57ffaf None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:45.458885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73feb-e813-4646-aaed-081cea57ffaf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:45.459177 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73feb-e813-4646-aaed-081cea57ffaf None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:45.460064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc73feb-e813-4646-aaed-081cea57ffaf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:45.461379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc73feb-e813-4646-aaed-081cea57ffaf None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:45.485075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 500/982] 10.222.0.66 () {60 vars in 1141 bytes} [Fri Jul 15 20:24:45 2022] POST /identity/v3/services => generated 242 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:24:46.653557 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14b3e-4c53-4028-acaa-543334b02117 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:46.654090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14b3e-4c53-4028-acaa-543334b02117 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:46.654090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14b3e-4c53-4028-acaa-543334b02117 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:46.655623 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 483/983] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:46.660759 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faf782-a93f-4933-ac46-9c32e5fb88f8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:46.661182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faf782-a93f-4933-ac46-9c32e5fb88f8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:46.661372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faf782-a93f-4933-ac46-9c32e5fb88f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:46.678718 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-35faf782-a93f-4933-ac46-9c32e5fb88f8 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:46.679904 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-35faf782-a93f-4933-ac46-9c32e5fb88f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:46.754910 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 501/984] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:46.777151 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14b3e-4c53-4028-acaa-543334b02117 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:46.799973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:46.882656 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14b3e-4c53-4028-acaa-543334b02117 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:46.916509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386aa49-ad25-4885-ab23-c855b927b376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:46.917315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386aa49-ad25-4885-ab23-c855b927b376 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:46.917600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386aa49-ad25-4885-ab23-c855b927b376 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:46.917879 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386aa49-ad25-4885-ab23-c855b927b376 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:46.918530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386aa49-ad25-4885-ab23-c855b927b376 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:46.919906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386aa49-ad25-4885-ab23-c855b927b376 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1386aa49-ad25-4885-ab23-c855b927b376 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:46.932553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:46.933530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:46.934378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:46.934378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:46.934378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:46.934378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:46.934378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:46.934378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:46.934378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:46.934378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:46.934378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:46.934378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:46.934378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:46.934378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:46.934378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:46.934378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:46.936459 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 484/985] 10.222.0.66 () {56 vars in 1126 bytes} [Fri Jul 15 20:24:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:46.939929 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faf782-a93f-4933-ac46-9c32e5fb88f8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:47.043094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faf782-a93f-4933-ac46-9c32e5fb88f8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:47.045914 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ef5b8-2f55-48d0-a097-16e52b7716fc None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:47.046199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ef5b8-2f55-48d0-a097-16e52b7716fc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:47.046477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ef5b8-2f55-48d0-a097-16e52b7716fc None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:47.047965 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 485/986] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:24:47.053209 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df696c41-365d-4634-8bdf-3dfcfe082b63 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:47.053347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df696c41-365d-4634-8bdf-3dfcfe082b63 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:47.053598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df696c41-365d-4634-8bdf-3dfcfe082b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:47.066368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:47.071117 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-df696c41-365d-4634-8bdf-3dfcfe082b63 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:47.072348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-df696c41-365d-4634-8bdf-3dfcfe082b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:47.085362 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb56f55-4d7e-4f02-a342-eda8a13fc663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:47.086040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56f55-4d7e-4f02-a342-eda8a13fc663 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:47.086326 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56f55-4d7e-4f02-a342-eda8a13fc663 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:47.086609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56f55-4d7e-4f02-a342-eda8a13fc663 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:47.087319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb56f55-4d7e-4f02-a342-eda8a13fc663 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:47.087633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb56f55-4d7e-4f02-a342-eda8a13fc663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:47.089032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb56f55-4d7e-4f02-a342-eda8a13fc663 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:47.094222 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 502/987] 10.222.0.66 () {56 vars in 1122 bytes} [Fri Jul 15 20:24:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:47.100310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb56f55-4d7e-4f02-a342-eda8a13fc663 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:47.156444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 486/988] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:24:47.174233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df696c41-365d-4634-8bdf-3dfcfe082b63 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:47.191316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:47.208766 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb56f55-4d7e-4f02-a342-eda8a13fc663 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:47.244262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd0a9a-6f89-433b-9d10-6ae84ce88ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:47.245227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd0a9a-6f89-433b-9d10-6ae84ce88ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:47.245661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd0a9a-6f89-433b-9d10-6ae84ce88ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:47.246084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd0a9a-6f89-433b-9d10-6ae84ce88ac2 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:47.246939 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd0a9a-6f89-433b-9d10-6ae84ce88ac2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:47.247408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd0a9a-6f89-433b-9d10-6ae84ce88ac2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:47.248959 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd0a9a-6f89-433b-9d10-6ae84ce88ac2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:47.256260 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 503/989] 10.222.0.66 () {56 vars in 1122 bytes} [Fri Jul 15 20:24:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:47.261666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd0a9a-6f89-433b-9d10-6ae84ce88ac2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:47.287428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df696c41-365d-4634-8bdf-3dfcfe082b63 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:47.311438 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:47.326861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3c7a5-92dc-4332-b409-2d8b006984e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:47.327661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3c7a5-92dc-4332-b409-2d8b006984e9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:47.327962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3c7a5-92dc-4332-b409-2d8b006984e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:47.328223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3c7a5-92dc-4332-b409-2d8b006984e9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:47.328929 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3c7a5-92dc-4332-b409-2d8b006984e9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:47.330314 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3c7a5-92dc-4332-b409-2d8b006984e9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8be3c7a5-92dc-4332-b409-2d8b006984e9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:47.342424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:47.343456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:47.344300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 487/990] 10.222.0.66 () {56 vars in 1105 bytes} [Fri Jul 15 20:24:47 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:47.350275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3c7a5-92dc-4332-b409-2d8b006984e9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:47.371293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd0a9a-6f89-433b-9d10-6ae84ce88ac2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:47.406133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e32a4a-9710-42f0-9122-277d2ad083b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:47.406871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e32a4a-9710-42f0-9122-277d2ad083b8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:47.407165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e32a4a-9710-42f0-9122-277d2ad083b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:47.408122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e32a4a-9710-42f0-9122-277d2ad083b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:47.409039 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e32a4a-9710-42f0-9122-277d2ad083b8 None admin] RBAC: Adding query filter params (interface=admin, service_id=653be9378a2d4051baa7a65c461892ce, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:47.409359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e32a4a-9710-42f0-9122-277d2ad083b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:47.411344 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e32a4a-9710-42f0-9122-277d2ad083b8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:47.417880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 504/991] 10.222.0.66 () {56 vars in 1249 bytes} [Fri Jul 15 20:24:47 2022] GET /identity/v3/endpoints?service_id=653be9378a2d4051baa7a65c461892ce&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:47.423688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e32a4a-9710-42f0-9122-277d2ad083b8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:47.435556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:47.463757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3c7a5-92dc-4332-b409-2d8b006984e9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:47.502400 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2d4e7-07e9-47f0-8cad-06fa3adb510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:47.503085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2d4e7-07e9-47f0-8cad-06fa3adb510a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:47.503435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2d4e7-07e9-47f0-8cad-06fa3adb510a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:47.503697 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2d4e7-07e9-47f0-8cad-06fa3adb510a None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:47.504412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2d4e7-07e9-47f0-8cad-06fa3adb510a None admin] RBAC: Adding query filter params (name=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:47.504742 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2d4e7-07e9-47f0-8cad-06fa3adb510a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:47.506104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2d4e7-07e9-47f0-8cad-06fa3adb510a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:47.511114 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 488/992] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:47.516782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2d4e7-07e9-47f0-8cad-06fa3adb510a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:47.543834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e32a4a-9710-42f0-9122-277d2ad083b8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:47.558655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:47.585830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4caf2-c4d0-4cae-bcd1-6ef14f8bf6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:47.586421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4caf2-c4d0-4cae-bcd1-6ef14f8bf6ad None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:47.586706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4caf2-c4d0-4cae-bcd1-6ef14f8bf6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:47.586984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4caf2-c4d0-4cae-bcd1-6ef14f8bf6ad None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:47.587666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4caf2-c4d0-4cae-bcd1-6ef14f8bf6ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:47.589068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4caf2-c4d0-4cae-bcd1-6ef14f8bf6ad None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:47.595312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 505/993] 10.222.0.66 () {56 vars in 1087 bytes} [Fri Jul 15 20:24:47 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:24:47.596530 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b6cf-e323-415c-8e60-99f0e58d4af6 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:47.596820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b6cf-e323-415c-8e60-99f0e58d4af6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:47.597694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b6cf-e323-415c-8e60-99f0e58d4af6 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:47.598941 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 506/994] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:47.605470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db342c37-09ac-49ae-b06c-91b23aa2d334 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:47.605757 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db342c37-09ac-49ae-b06c-91b23aa2d334 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:47.606035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db342c37-09ac-49ae-b06c-91b23aa2d334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:47.625122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-db342c37-09ac-49ae-b06c-91b23aa2d334 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:47.626355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-db342c37-09ac-49ae-b06c-91b23aa2d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:47.634662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2d4e7-07e9-47f0-8cad-06fa3adb510a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:47.676734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40b08e-a3c3-4024-b13d-37992c7a3860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:47.677853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40b08e-a3c3-4024-b13d-37992c7a3860 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:47.678142 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40b08e-a3c3-4024-b13d-37992c7a3860 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:47.678731 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40b08e-a3c3-4024-b13d-37992c7a3860 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:47.679487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40b08e-a3c3-4024-b13d-37992c7a3860 None admin] RBAC: Adding query filter params (type=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:47.679805 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40b08e-a3c3-4024-b13d-37992c7a3860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:47.681330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40b08e-a3c3-4024-b13d-37992c7a3860 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:47.696430 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 489/995] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:47.716604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 507/996] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:24:47.738864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40b08e-a3c3-4024-b13d-37992c7a3860 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:47.748479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:47.852414 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40b08e-a3c3-4024-b13d-37992c7a3860 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:47.888179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f72eb-e821-4dd5-bd8b-e1636fe41925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:47.889288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f72eb-e821-4dd5-bd8b-e1636fe41925 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:47.889727 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f72eb-e821-4dd5-bd8b-e1636fe41925 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:47.890176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f72eb-e821-4dd5-bd8b-e1636fe41925 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:47.890973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f72eb-e821-4dd5-bd8b-e1636fe41925 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:47.892520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f72eb-e821-4dd5-bd8b-e1636fe41925 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-995f72eb-e821-4dd5-bd8b-e1636fe41925 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:47.904707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:47.905941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:47.906987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:47.906987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:47.906987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:47.906987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:47.906987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:47.906987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:47.906987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:47.906987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:47.906987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:47.906987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:47.906987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:47.906987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:47.906987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:24:47.906987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:47.910095 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 490/997] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:47.915835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db342c37-09ac-49ae-b06c-91b23aa2d334 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:48.021076 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db342c37-09ac-49ae-b06c-91b23aa2d334 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:48.023751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:48.060126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d69649-0346-4b49-a1a5-432f111aaaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:48.060827 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d69649-0346-4b49-a1a5-432f111aaaed None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:48.061118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d69649-0346-4b49-a1a5-432f111aaaed None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:48.061399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d69649-0346-4b49-a1a5-432f111aaaed None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:48.062112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d69649-0346-4b49-a1a5-432f111aaaed None admin] RBAC: Adding query filter params (name=compute) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:48.062424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d69649-0346-4b49-a1a5-432f111aaaed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:48.063797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d69649-0346-4b49-a1a5-432f111aaaed None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:48.074128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 508/998] 10.222.0.66 () {56 vars in 1112 bytes} [Fri Jul 15 20:24:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:48.075338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f72eb-e821-4dd5-bd8b-e1636fe41925 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:48.146308 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:48.179989 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f72eb-e821-4dd5-bd8b-e1636fe41925 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:48.213985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d4950-15e0-49bd-831f-0f45f98d6bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:48.214649 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d4950-15e0-49bd-831f-0f45f98d6bed None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:48.214935 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d4950-15e0-49bd-831f-0f45f98d6bed None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:48.215210 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d4950-15e0-49bd-831f-0f45f98d6bed None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:48.215917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d4950-15e0-49bd-831f-0f45f98d6bed None admin] RBAC: Adding query filter params (type=compute) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:48.216227 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d4950-15e0-49bd-831f-0f45f98d6bed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:48.217603 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d4950-15e0-49bd-831f-0f45f98d6bed None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:48.227298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 491/999] 10.222.0.66 () {56 vars in 1112 bytes} [Fri Jul 15 20:24:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:48.228751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d69649-0346-4b49-a1a5-432f111aaaed None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:48.328765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d69649-0346-4b49-a1a5-432f111aaaed None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:48.362334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb92570-1238-461f-8870-31a6e14457df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:48.363524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb92570-1238-461f-8870-31a6e14457df None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:48.363848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb92570-1238-461f-8870-31a6e14457df None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:48.364129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb92570-1238-461f-8870-31a6e14457df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:48.364895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb92570-1238-461f-8870-31a6e14457df None admin] RBAC: Adding query filter params (interface=public, service_id=ab6f5d50721949bbba96962e91b18b5f, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:48.365211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb92570-1238-461f-8870-31a6e14457df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:48.366577 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb92570-1238-461f-8870-31a6e14457df None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:48.376366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 509/1000] 10.222.0.66 () {56 vars in 1251 bytes} [Fri Jul 15 20:24:48 2022] GET /identity/v3/endpoints?service_id=ab6f5d50721949bbba96962e91b18b5f&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:48.377340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d4950-15e0-49bd-831f-0f45f98d6bed None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:48.485007 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d4950-15e0-49bd-831f-0f45f98d6bed None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:48.519551 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b856cec-c922-4494-8443-7ad2daac7b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:48.520197 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b856cec-c922-4494-8443-7ad2daac7b69 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:48.520505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b856cec-c922-4494-8443-7ad2daac7b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:48.520781 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b856cec-c922-4494-8443-7ad2daac7b69 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:48.521446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b856cec-c922-4494-8443-7ad2daac7b69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:48.522806 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b856cec-c922-4494-8443-7ad2daac7b69 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:48.523956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:48.531606 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 492/1001] 10.222.0.66 () {56 vars in 1087 bytes} [Fri Jul 15 20:24:48 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:24:49.673416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019985e-84cc-4392-a4aa-f12dc6af91b4 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:49.673976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019985e-84cc-4392-a4aa-f12dc6af91b4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:49.673976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019985e-84cc-4392-a4aa-f12dc6af91b4 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:49.676012 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 510/1002] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:49.681336 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc18b8-0481-43cf-85f5-c707bd5bf3d6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:49.681739 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc18b8-0481-43cf-85f5-c707bd5bf3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:49.681926 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc18b8-0481-43cf-85f5-c707bd5bf3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:49.699400 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-70fc18b8-0481-43cf-85f5-c707bd5bf3d6 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:49.700613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-70fc18b8-0481-43cf-85f5-c707bd5bf3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:49.717754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1047-8c17-4553-a186-fcd1ef2218d0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:49.718020 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1047-8c17-4553-a186-fcd1ef2218d0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:49.718260 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1047-8c17-4553-a186-fcd1ef2218d0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:49.719883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 511/1003] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:24:49.725068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aedf60-0609-425c-8c28-08531549a29b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:49.725355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aedf60-0609-425c-8c28-08531549a29b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:49.725630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aedf60-0609-425c-8c28-08531549a29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:49.742870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f7aedf60-0609-425c-8c28-08531549a29b None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:49.744049 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f7aedf60-0609-425c-8c28-08531549a29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:49.770252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:49.775120 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 493/1004] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:49.797649 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc18b8-0481-43cf-85f5-c707bd5bf3d6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:49.818771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 512/1005] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:24:49.842072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aedf60-0609-425c-8c28-08531549a29b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:49.901559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc18b8-0481-43cf-85f5-c707bd5bf3d6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:49.928666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:49.938659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2c658-6b95-404a-a680-21983a0f2d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:49.939471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2c658-6b95-404a-a680-21983a0f2d5a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:49.939753 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2c658-6b95-404a-a680-21983a0f2d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:49.940031 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2c658-6b95-404a-a680-21983a0f2d5a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:49.941329 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2c658-6b95-404a-a680-21983a0f2d5a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:49.942815 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2c658-6b95-404a-a680-21983a0f2d5a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:49.955501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aedf60-0609-425c-8c28-08531549a29b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4ec2c658-6b95-404a-a680-21983a0f2d5a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:49.955668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:49.956812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:49.957650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 494/1006] 10.222.0.66 () {56 vars in 1126 bytes} [Fri Jul 15 20:24:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:49.964651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2c658-6b95-404a-a680-21983a0f2d5a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:49.999010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2a637-c71c-46c4-8f4e-4ba9adc58a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:49.999625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2a637-c71c-46c4-8f4e-4ba9adc58a52 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:49.999889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2a637-c71c-46c4-8f4e-4ba9adc58a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:50.000166 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2a637-c71c-46c4-8f4e-4ba9adc58a52 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:50.000967 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2a637-c71c-46c4-8f4e-4ba9adc58a52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:50.002338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2a637-c71c-46c4-8f4e-4ba9adc58a52 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:50.018366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 513/1007] 10.222.0.66 () {60 vars in 1141 bytes} [Fri Jul 15 20:24:49 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:24:50.078341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2c658-6b95-404a-a680-21983a0f2d5a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:50.123052 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc447c25-3af3-42ce-af48-7842d91da083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:50.123728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc447c25-3af3-42ce-af48-7842d91da083 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:50.124016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc447c25-3af3-42ce-af48-7842d91da083 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:50.124294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc447c25-3af3-42ce-af48-7842d91da083 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:50.125039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc447c25-3af3-42ce-af48-7842d91da083 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:50.125349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc447c25-3af3-42ce-af48-7842d91da083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:50.126734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc447c25-3af3-42ce-af48-7842d91da083 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:50.137802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 495/1008] 10.222.0.66 () {56 vars in 1122 bytes} [Fri Jul 15 20:24:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:50.139129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2a637-c71c-46c4-8f4e-4ba9adc58a52 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:50.166642 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:50.254055 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2a637-c71c-46c4-8f4e-4ba9adc58a52 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:50.289857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94aa57b-99e8-4627-8943-3d413d1896b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:50.290530 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94aa57b-99e8-4627-8943-3d413d1896b7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:50.290814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94aa57b-99e8-4627-8943-3d413d1896b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:50.291092 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94aa57b-99e8-4627-8943-3d413d1896b7 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:50.291797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94aa57b-99e8-4627-8943-3d413d1896b7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:50.292104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94aa57b-99e8-4627-8943-3d413d1896b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:50.293502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94aa57b-99e8-4627-8943-3d413d1896b7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:50.298591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 514/1009] 10.222.0.66 () {56 vars in 1122 bytes} [Fri Jul 15 20:24:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:50.305152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc447c25-3af3-42ce-af48-7842d91da083 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:50.357861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:50.407244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc447c25-3af3-42ce-af48-7842d91da083 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:50.443595 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2e28e-4f8a-4b91-a550-a2df22568dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:50.444708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2e28e-4f8a-4b91-a550-a2df22568dd9 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:50.444996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2e28e-4f8a-4b91-a550-a2df22568dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:50.445275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2e28e-4f8a-4b91-a550-a2df22568dd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:50.446041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2e28e-4f8a-4b91-a550-a2df22568dd9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:50.447413 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2e28e-4f8a-4b91-a550-a2df22568dd9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:50.476038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 496/1010] 10.222.0.66 () {60 vars in 1144 bytes} [Fri Jul 15 20:24:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:24:50.534216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26294b-2538-45e2-96a4-35ffbcbe8301 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:50.534452 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26294b-2538-45e2-96a4-35ffbcbe8301 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:50.534800 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26294b-2538-45e2-96a4-35ffbcbe8301 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:50.536479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 515/1011] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:50.542631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6ceb-c76a-4ff4-9acc-f7dd62f09a8e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:50.543001 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6ceb-c76a-4ff4-9acc-f7dd62f09a8e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:50.543181 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6ceb-c76a-4ff4-9acc-f7dd62f09a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:50.562089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d7bd6ceb-c76a-4ff4-9acc-f7dd62f09a8e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:50.563320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d7bd6ceb-c76a-4ff4-9acc-f7dd62f09a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:50.643713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 497/1012] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:50 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:50.665991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26294b-2538-45e2-96a4-35ffbcbe8301 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:50.756523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:50.773093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26294b-2538-45e2-96a4-35ffbcbe8301 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:50.808464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5f4b9-738f-436a-aa3a-a23b1fd57de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:50.809191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5f4b9-738f-436a-aa3a-a23b1fd57de1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:50.809473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5f4b9-738f-436a-aa3a-a23b1fd57de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:50.809747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5f4b9-738f-436a-aa3a-a23b1fd57de1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:50.810393 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5f4b9-738f-436a-aa3a-a23b1fd57de1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:50.811743 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5f4b9-738f-436a-aa3a-a23b1fd57de1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-5ec5f4b9-738f-436a-aa3a-a23b1fd57de1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:50.824290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:50.825324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:50.826167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 516/1013] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:50.833474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd6ceb-c76a-4ff4-9acc-f7dd62f09a8e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:50.874802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:50.937379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd6ceb-c76a-4ff4-9acc-f7dd62f09a8e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:50.971706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04a07e-d291-4914-a43b-d92fa4fd4009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:50.972424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04a07e-d291-4914-a43b-d92fa4fd4009 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:50.972713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04a07e-d291-4914-a43b-d92fa4fd4009 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:50.972990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04a07e-d291-4914-a43b-d92fa4fd4009 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:50.973695 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04a07e-d291-4914-a43b-d92fa4fd4009 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:50.974003 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04a07e-d291-4914-a43b-d92fa4fd4009 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:50.975373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04a07e-d291-4914-a43b-d92fa4fd4009 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:50.980447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 498/1014] 10.222.0.66 () {56 vars in 1112 bytes} [Fri Jul 15 20:24:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:50.986212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5f4b9-738f-436a-aa3a-a23b1fd57de1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:51.087566 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5f4b9-738f-436a-aa3a-a23b1fd57de1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:51.119986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f13265-4cac-408f-bbac-f209c4c189c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:51.120680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f13265-4cac-408f-bbac-f209c4c189c5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:51.120968 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f13265-4cac-408f-bbac-f209c4c189c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:51.121245 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f13265-4cac-408f-bbac-f209c4c189c5 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:51.121952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f13265-4cac-408f-bbac-f209c4c189c5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:51.122255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f13265-4cac-408f-bbac-f209c4c189c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:51.123608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f13265-4cac-408f-bbac-f209c4c189c5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:51.134103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 517/1015] 10.222.0.66 () {56 vars in 1112 bytes} [Fri Jul 15 20:24:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:51.135384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04a07e-d291-4914-a43b-d92fa4fd4009 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:51.241979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04a07e-d291-4914-a43b-d92fa4fd4009 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:51.243548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:51.278481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039ebc3-4f93-4bbe-86cf-4e597d2087dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:51.279136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039ebc3-4f93-4bbe-86cf-4e597d2087dd None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:51.279423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039ebc3-4f93-4bbe-86cf-4e597d2087dd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:51.279701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039ebc3-4f93-4bbe-86cf-4e597d2087dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:51.280465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039ebc3-4f93-4bbe-86cf-4e597d2087dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:51.281834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039ebc3-4f93-4bbe-86cf-4e597d2087dd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:51.300910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 499/1016] 10.222.0.66 () {60 vars in 1144 bytes} [Fri Jul 15 20:24:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:24:52.152293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97725c-0bf4-433f-ba75-3af00c1fe90b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:52.152859 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97725c-0bf4-433f-ba75-3af00c1fe90b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:52.152938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97725c-0bf4-433f-ba75-3af00c1fe90b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:52.154303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 518/1017] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:52.159668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1b568-a7f5-4411-8993-069e69e0a754 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:52.160433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1b568-a7f5-4411-8993-069e69e0a754 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:52.160433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1b568-a7f5-4411-8993-069e69e0a754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:52.179499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e7d1b568-a7f5-4411-8993-069e69e0a754 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:52.180706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e7d1b568-a7f5-4411-8993-069e69e0a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:52.260425 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 500/1018] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:52.280907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97725c-0bf4-433f-ba75-3af00c1fe90b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:52.298977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:52.391524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97725c-0bf4-433f-ba75-3af00c1fe90b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:52.428051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a67cd9-8724-499a-9a12-0f5371d1b447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:52.428790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a67cd9-8724-499a-9a12-0f5371d1b447 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:52.429078 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a67cd9-8724-499a-9a12-0f5371d1b447 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:52.429355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a67cd9-8724-499a-9a12-0f5371d1b447 None admin] PATH_INFO: `/v3/services/image` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:52.430011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a67cd9-8724-499a-9a12-0f5371d1b447 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:52.431387 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a67cd9-8724-499a-9a12-0f5371d1b447 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-81a67cd9-8724-499a-9a12-0f5371d1b447 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:52.444241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:52.445439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:52.446262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 519/1019] 10.222.0.66 () {56 vars in 1105 bytes} [Fri Jul 15 20:24:52 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:52.451800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1b568-a7f5-4411-8993-069e69e0a754 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:52.539512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924fe4a-99d4-44ec-ba9b-054523795a1a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:52.539847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924fe4a-99d4-44ec-ba9b-054523795a1a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:52.540084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924fe4a-99d4-44ec-ba9b-054523795a1a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:52.541501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 520/1020] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:52.542239 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:52.546463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae753fd6-58b1-4fb2-9f69-ba5989f38d9e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:52.546761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae753fd6-58b1-4fb2-9f69-ba5989f38d9e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:52.547045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae753fd6-58b1-4fb2-9f69-ba5989f38d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:52.560691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1b568-a7f5-4411-8993-069e69e0a754 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:52.564103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ae753fd6-58b1-4fb2-9f69-ba5989f38d9e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:52.565336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ae753fd6-58b1-4fb2-9f69-ba5989f38d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:52.600157 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256b636-7dcd-4b61-a584-5b17e329c836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:52.600863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b636-7dcd-4b61-a584-5b17e329c836 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:52.601150 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b636-7dcd-4b61-a584-5b17e329c836 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:52.601428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b636-7dcd-4b61-a584-5b17e329c836 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:52.602136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256b636-7dcd-4b61-a584-5b17e329c836 None admin] RBAC: Adding query filter params (name=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:52.602444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256b636-7dcd-4b61-a584-5b17e329c836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:52.604068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256b636-7dcd-4b61-a584-5b17e329c836 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:52.610880 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 501/1021] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:52.614956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256b636-7dcd-4b61-a584-5b17e329c836 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:52.635599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 521/1022] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:52.658382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae753fd6-58b1-4fb2-9f69-ba5989f38d9e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:52.670030 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:52.722549 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256b636-7dcd-4b61-a584-5b17e329c836 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:52.758293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678c102-3ac9-4180-95dd-1f3da16505b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:52.759033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678c102-3ac9-4180-95dd-1f3da16505b2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:52.759339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678c102-3ac9-4180-95dd-1f3da16505b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:52.759610 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678c102-3ac9-4180-95dd-1f3da16505b2 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:52.760293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678c102-3ac9-4180-95dd-1f3da16505b2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:52.760891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678c102-3ac9-4180-95dd-1f3da16505b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:52.762245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678c102-3ac9-4180-95dd-1f3da16505b2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:52.764512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae753fd6-58b1-4fb2-9f69-ba5989f38d9e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:52.767099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 502/1023] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:52.773309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678c102-3ac9-4180-95dd-1f3da16505b2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:52.789707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:52.808195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76945c61-0e3a-4ae1-a027-7bf659c016b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:52.809027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76945c61-0e3a-4ae1-a027-7bf659c016b4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:52.809316 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76945c61-0e3a-4ae1-a027-7bf659c016b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:52.809596 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76945c61-0e3a-4ae1-a027-7bf659c016b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:52.810885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76945c61-0e3a-4ae1-a027-7bf659c016b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:52.812470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76945c61-0e3a-4ae1-a027-7bf659c016b4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:52.819300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 522/1024] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:52.820259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76945c61-0e3a-4ae1-a027-7bf659c016b4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:52.876635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678c102-3ac9-4180-95dd-1f3da16505b2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:52.902784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:52.912675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63b932-6de4-40c0-b30d-429f40525b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:52.913617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63b932-6de4-40c0-b30d-429f40525b83 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:52.914425 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63b932-6de4-40c0-b30d-429f40525b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:52.915341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63b932-6de4-40c0-b30d-429f40525b83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:52.916364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63b932-6de4-40c0-b30d-429f40525b83 None admin] RBAC: Adding query filter params (interface=public, service_id=dc9338f5cb154627b9f6ceca6a3d141e, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:52.916808 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63b932-6de4-40c0-b30d-429f40525b83 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:52.918190 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63b932-6de4-40c0-b30d-429f40525b83 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:52.927641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76945c61-0e3a-4ae1-a027-7bf659c016b4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:52.930052 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 503/1025] 10.222.0.66 () {56 vars in 1251 bytes} [Fri Jul 15 20:24:52 2022] GET /identity/v3/endpoints?service_id=dc9338f5cb154627b9f6ceca6a3d141e&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:52.930052 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63b932-6de4-40c0-b30d-429f40525b83 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:52.967478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064509d-09e2-40cb-9252-431b6bbca732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:52.968141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064509d-09e2-40cb-9252-431b6bbca732 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:52.968441 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064509d-09e2-40cb-9252-431b6bbca732 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:52.968723 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064509d-09e2-40cb-9252-431b6bbca732 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:52.969428 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064509d-09e2-40cb-9252-431b6bbca732 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:52.970859 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064509d-09e2-40cb-9252-431b6bbca732 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:53.008511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 523/1026] 10.222.0.66 () {60 vars in 1141 bytes} [Fri Jul 15 20:24:52 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:24:53.022775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:53.050281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63b932-6de4-40c0-b30d-429f40525b83 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:53.089634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6711f-cfe3-4102-b499-d1aea4df712f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:53.090311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6711f-cfe3-4102-b499-d1aea4df712f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:53.090591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6711f-cfe3-4102-b499-d1aea4df712f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:53.090863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6711f-cfe3-4102-b499-d1aea4df712f None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:53.091546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6711f-cfe3-4102-b499-d1aea4df712f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:53.092982 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6711f-cfe3-4102-b499-d1aea4df712f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:53.108443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 504/1027] 10.222.0.66 () {56 vars in 1087 bytes} [Fri Jul 15 20:24:52 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:24:53.464011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d2a9d-1444-4458-87d3-7fb59510dbe0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:53.464475 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d2a9d-1444-4458-87d3-7fb59510dbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:53.464684 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d2a9d-1444-4458-87d3-7fb59510dbe0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:53.466144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 524/1028] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:53.471214 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe73e-03b0-4b42-af46-a121ddc1c53a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:53.471598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe73e-03b0-4b42-af46-a121ddc1c53a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:53.472366 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe73e-03b0-4b42-af46-a121ddc1c53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:53.490094 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c1abe73e-03b0-4b42-af46-a121ddc1c53a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:53.491283 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c1abe73e-03b0-4b42-af46-a121ddc1c53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:53.562146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 505/1029] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:53.586239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d2a9d-1444-4458-87d3-7fb59510dbe0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:53.693717 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d2a9d-1444-4458-87d3-7fb59510dbe0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:53.721429 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:53.730076 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fd401-5b09-4dda-b563-897ee0dec2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:53.730899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fd401-5b09-4dda-b563-897ee0dec2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:53.731186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fd401-5b09-4dda-b563-897ee0dec2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:53.731466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fd401-5b09-4dda-b563-897ee0dec2a3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:53.742597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fd401-5b09-4dda-b563-897ee0dec2a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-888fd401-5b09-4dda-b563-897ee0dec2a3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:53.750829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:53.751749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:53.753097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:53.753097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:53.753097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:53.753097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:53.753097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:53.753097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:53.753097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:53.753097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:53.753097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:53.753097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:53.753097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 20:24:53.753097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:53.754063 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 525/1030] 10.222.0.66 () {56 vars in 1120 bytes} [Fri Jul 15 20:24:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:53.758173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe73e-03b0-4b42-af46-a121ddc1c53a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:53.830480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:53.862973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe73e-03b0-4b42-af46-a121ddc1c53a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:53.896978 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dce38c-d65c-45a6-8989-73b936a5988c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:53.898034 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce38c-d65c-45a6-8989-73b936a5988c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:53.898410 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce38c-d65c-45a6-8989-73b936a5988c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:53.898781 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce38c-d65c-45a6-8989-73b936a5988c None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:53.899615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dce38c-d65c-45a6-8989-73b936a5988c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:53.900016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dce38c-d65c-45a6-8989-73b936a5988c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:53.901502 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dce38c-d65c-45a6-8989-73b936a5988c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:53.910160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 506/1031] 10.222.0.66 () {56 vars in 1115 bytes} [Fri Jul 15 20:24:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:53.916032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fd401-5b09-4dda-b563-897ee0dec2a3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:54.017783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fd401-5b09-4dda-b563-897ee0dec2a3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:54.051487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdce8e-6194-4a37-8614-d855e16310e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:54.052271 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdce8e-6194-4a37-8614-d855e16310e1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:54.052580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdce8e-6194-4a37-8614-d855e16310e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:54.052853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdce8e-6194-4a37-8614-d855e16310e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:54.063252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdce8e-6194-4a37-8614-d855e16310e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:54.064720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdce8e-6194-4a37-8614-d855e16310e1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ddcdce8e-6194-4a37-8614-d855e16310e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:54.082973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:54.083873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:54.085146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:54.085146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:54.085146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:54.085146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:54.088693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 526/1032] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:54.089983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dce38c-d65c-45a6-8989-73b936a5988c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:54.196976 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dce38c-d65c-45a6-8989-73b936a5988c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:54.230614 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:54.235909 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bd96f-aabf-4dde-921b-311871dcf28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:54.237015 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd96f-aabf-4dde-921b-311871dcf28e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:54.237562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd96f-aabf-4dde-921b-311871dcf28e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:54.238142 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd96f-aabf-4dde-921b-311871dcf28e None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:54.239212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bd96f-aabf-4dde-921b-311871dcf28e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:54.239586 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bd96f-aabf-4dde-921b-311871dcf28e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:54.241049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bd96f-aabf-4dde-921b-311871dcf28e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:54.257760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 507/1033] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:54.258964 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdce8e-6194-4a37-8614-d855e16310e1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:54.303812 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:54.363320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdce8e-6194-4a37-8614-d855e16310e1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:54.396131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abde57-0a4a-4d38-9d81-66e809388632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:54.396941 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abde57-0a4a-4d38-9d81-66e809388632 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:54.397226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abde57-0a4a-4d38-9d81-66e809388632 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:54.397498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abde57-0a4a-4d38-9d81-66e809388632 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:54.404689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abde57-0a4a-4d38-9d81-66e809388632 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:54.406114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abde57-0a4a-4d38-9d81-66e809388632 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-45abde57-0a4a-4d38-9d81-66e809388632 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:54.420488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:54.421449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:54.422435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:54.422435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:54.422435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:54.422435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:54.422435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:54.422435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:54.422435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:54.422435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:54.422435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:24:54.422435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:54.422435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 527/1034] 10.222.0.66 () {56 vars in 1093 bytes} [Fri Jul 15 20:24:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:54.427380 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bd96f-aabf-4dde-921b-311871dcf28e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:54.532590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bd96f-aabf-4dde-921b-311871dcf28e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:54.567889 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ed9a-6e1e-4a30-80a8-c62f771f08ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:54.568510 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ed9a-6e1e-4a30-80a8-c62f771f08ea None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:54.568798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ed9a-6e1e-4a30-80a8-c62f771f08ea None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:54.569074 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ed9a-6e1e-4a30-80a8-c62f771f08ea None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:54.569910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489ed9a-6e1e-4a30-80a8-c62f771f08ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:54.570218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489ed9a-6e1e-4a30-80a8-c62f771f08ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:54.571653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489ed9a-6e1e-4a30-80a8-c62f771f08ea None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:54.589481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 508/1035] 10.222.0.66 () {56 vars in 1133 bytes} [Fri Jul 15 20:24:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:54.594958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abde57-0a4a-4d38-9d81-66e809388632 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:54.694468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:54.698383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abde57-0a4a-4d38-9d81-66e809388632 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:54.732631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e22f92-6a67-49d4-8192-2c2bb1ceb45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:54.733285 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e22f92-6a67-49d4-8192-2c2bb1ceb45e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:54.733617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e22f92-6a67-49d4-8192-2c2bb1ceb45e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:54.733903 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e22f92-6a67-49d4-8192-2c2bb1ceb45e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:54.802875 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e22f92-6a67-49d4-8192-2c2bb1ceb45e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:54.804492 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e22f92-6a67-49d4-8192-2c2bb1ceb45e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:54.899818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:54.909061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 528/1036] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:54 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:24:54.910931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ed9a-6e1e-4a30-80a8-c62f771f08ea None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:54.962518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:55.013525 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ed9a-6e1e-4a30-80a8-c62f771f08ea None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:55.047808 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36abe6-2188-472c-9d49-1f7d3b071173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:55.048632 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36abe6-2188-472c-9d49-1f7d3b071173 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:55.048915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36abe6-2188-472c-9d49-1f7d3b071173 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:55.049190 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36abe6-2188-472c-9d49-1f7d3b071173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:55.059444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36abe6-2188-472c-9d49-1f7d3b071173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:55.060921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36abe6-2188-472c-9d49-1f7d3b071173 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ae36abe6-2188-472c-9d49-1f7d3b071173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:55.078344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:55.079246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:55.085552 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:55.085552 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:55.085552 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:55.085552 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:55.085552 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 509/1037] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:55.087637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e22f92-6a67-49d4-8192-2c2bb1ceb45e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:55.144630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4fec-8cb8-4a2f-85eb-3c6cee4965de None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:55.144998 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4fec-8cb8-4a2f-85eb-3c6cee4965de None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:55.145302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4fec-8cb8-4a2f-85eb-3c6cee4965de None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:55.146672 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 510/1038] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:55.147742 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04385a94-f992-4243-8cf1-0048c77bb853 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:55.148029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04385a94-f992-4243-8cf1-0048c77bb853 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:55.148310 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04385a94-f992-4243-8cf1-0048c77bb853 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:55.149797 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 511/1039] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:55.151590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063c05-f1ab-4aa2-a6e8-ffdd7a3f352c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:55.151814 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063c05-f1ab-4aa2-a6e8-ffdd7a3f352c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:55.152101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063c05-f1ab-4aa2-a6e8-ffdd7a3f352c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:55.169012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c7063c05-f1ab-4aa2-a6e8-ffdd7a3f352c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:55.170354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c7063c05-f1ab-4aa2-a6e8-ffdd7a3f352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:55.192060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e22f92-6a67-49d4-8192-2c2bb1ceb45e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:55.225469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946f70-b123-4388-9660-7e7d01f5ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:55.226123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946f70-b123-4388-9660-7e7d01f5ed33 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:55.226404 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946f70-b123-4388-9660-7e7d01f5ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:55.226677 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946f70-b123-4388-9660-7e7d01f5ed33 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:55.227389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946f70-b123-4388-9660-7e7d01f5ed33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:55.227693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946f70-b123-4388-9660-7e7d01f5ed33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:55.229082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946f70-b123-4388-9660-7e7d01f5ed33 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:55.240724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 529/1040] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:55.241556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 512/1041] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:24:55.241939 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364c6c-3240-40aa-b9ce-f78d48ca6a1b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:55.242229 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364c6c-3240-40aa-b9ce-f78d48ca6a1b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:55.242509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364c6c-3240-40aa-b9ce-f78d48ca6a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:55.248750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7063c05-f1ab-4aa2-a6e8-ffdd7a3f352c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:55.271097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-dd364c6c-3240-40aa-b9ce-f78d48ca6a1b None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:55.272376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dd364c6c-3240-40aa-b9ce-f78d48ca6a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:55.280766 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:55.336184 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:55.347123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 530/1042] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:55.348027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd364c6c-3240-40aa-b9ce-f78d48ca6a1b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:55.358456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7063c05-f1ab-4aa2-a6e8-ffdd7a3f352c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:55.395630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a44169-64c0-4ad6-a45c-6ca92878dded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:55.396449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a44169-64c0-4ad6-a45c-6ca92878dded None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:55.396747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a44169-64c0-4ad6-a45c-6ca92878dded None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:55.397022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a44169-64c0-4ad6-a45c-6ca92878dded None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:55.403888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a44169-64c0-4ad6-a45c-6ca92878dded None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:55.405299 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a44169-64c0-4ad6-a45c-6ca92878dded None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c9a44169-64c0-4ad6-a45c-6ca92878dded None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:55.419844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:55.420884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:55.421809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:55.421809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:55.421809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:55.421809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:55.421809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:55.421809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:55.421809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:55.421809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:55.422564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 513/1043] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:55.423597 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a44169-64c0-4ad6-a45c-6ca92878dded None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:55.446282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd364c6c-3240-40aa-b9ce-f78d48ca6a1b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:55.480529 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478d230-07f9-4e12-9cd7-b049dc451854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:55.481321 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478d230-07f9-4e12-9cd7-b049dc451854 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:55.481603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478d230-07f9-4e12-9cd7-b049dc451854 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:55.481882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478d230-07f9-4e12-9cd7-b049dc451854 None admin] PATH_INFO: `/v3/services/image` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:55.482519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478d230-07f9-4e12-9cd7-b049dc451854 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:55.483871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478d230-07f9-4e12-9cd7-b049dc451854 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a478d230-07f9-4e12-9cd7-b049dc451854 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:55.495976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:55.497190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:55.498241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 531/1044] 10.222.0.66 () {56 vars in 1105 bytes} [Fri Jul 15 20:24:55 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:55.499212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478d230-07f9-4e12-9cd7-b049dc451854 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:55.519770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:55.528897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a44169-64c0-4ad6-a45c-6ca92878dded None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:55.553755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:55.562842 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de456be0-7682-4270-9311-634097ef0092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:55.563629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de456be0-7682-4270-9311-634097ef0092 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:55.563911 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de456be0-7682-4270-9311-634097ef0092 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:55.564186 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de456be0-7682-4270-9311-634097ef0092 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:55.565913 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de456be0-7682-4270-9311-634097ef0092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:55.567452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de456be0-7682-4270-9311-634097ef0092 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:55.569074 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 514/1045] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:55.569817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de456be0-7682-4270-9311-634097ef0092 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:55.600286 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478d230-07f9-4e12-9cd7-b049dc451854 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:55.633599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888caf7-64c0-423e-ba56-66f481888757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:55.634257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888caf7-64c0-423e-ba56-66f481888757 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:55.634543 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888caf7-64c0-423e-ba56-66f481888757 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:55.634820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888caf7-64c0-423e-ba56-66f481888757 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:55.635604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888caf7-64c0-423e-ba56-66f481888757 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:55.635915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888caf7-64c0-423e-ba56-66f481888757 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:55.637366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888caf7-64c0-423e-ba56-66f481888757 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:55.650798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 532/1046] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:55.651450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888caf7-64c0-423e-ba56-66f481888757 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:55.669447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de456be0-7682-4270-9311-634097ef0092 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:55.703942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd573c-1463-4e67-8f12-2420eda814f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:55.704628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd573c-1463-4e67-8f12-2420eda814f9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:55.704910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd573c-1463-4e67-8f12-2420eda814f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:55.705180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd573c-1463-4e67-8f12-2420eda814f9 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:55.705877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd573c-1463-4e67-8f12-2420eda814f9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:55.706813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd573c-1463-4e67-8f12-2420eda814f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:55.708178 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd573c-1463-4e67-8f12-2420eda814f9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:55.713012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 515/1047] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:55.713842 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd573c-1463-4e67-8f12-2420eda814f9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:55.738675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:55.758751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888caf7-64c0-423e-ba56-66f481888757 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:55.772893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:55.793069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e086b-5ad9-4ae7-a979-9e2410bd39e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:55.793740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e086b-5ad9-4ae7-a979-9e2410bd39e9 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:55.794027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e086b-5ad9-4ae7-a979-9e2410bd39e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:55.794304 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e086b-5ad9-4ae7-a979-9e2410bd39e9 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:55.795006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e086b-5ad9-4ae7-a979-9e2410bd39e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:55.796448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e086b-5ad9-4ae7-a979-9e2410bd39e9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:55.814745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd573c-1463-4e67-8f12-2420eda814f9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:55.817104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 533/1048] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:24:55 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:24:55.817911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e086b-5ad9-4ae7-a979-9e2410bd39e9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:55.853138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d71d6f-8a5e-4c36-898e-9b299e5c3774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:55.853819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d71d6f-8a5e-4c36-898e-9b299e5c3774 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:55.854104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d71d6f-8a5e-4c36-898e-9b299e5c3774 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:55.854385 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d71d6f-8a5e-4c36-898e-9b299e5c3774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:55.855224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d71d6f-8a5e-4c36-898e-9b299e5c3774 None admin] RBAC: Adding query filter params (role.id=8ba1a71f64804ac08b302f269ea99a20, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=b042da9298894712a0a29787a343bf85) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:55.855542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d71d6f-8a5e-4c36-898e-9b299e5c3774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:55.857122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d71d6f-8a5e-4c36-898e-9b299e5c3774 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:55.864607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 516/1049] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:55 2022] GET /identity/v3/role_assignments?user.id=b042da9298894712a0a29787a343bf85&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=8ba1a71f64804ac08b302f269ea99a20 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:55.954490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e086b-5ad9-4ae7-a979-9e2410bd39e9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:55.999906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb14b92-460a-4e37-97b0-fb8abe16051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:56.000644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb14b92-460a-4e37-97b0-fb8abe16051d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:56.001986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb14b92-460a-4e37-97b0-fb8abe16051d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:56.001986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb14b92-460a-4e37-97b0-fb8abe16051d None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:56.001986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb14b92-460a-4e37-97b0-fb8abe16051d None admin] RBAC: Adding query filter params (type=image) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:56.002360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb14b92-460a-4e37-97b0-fb8abe16051d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:56.003999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb14b92-460a-4e37-97b0-fb8abe16051d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:56.010375 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 534/1050] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:56.016088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d71d6f-8a5e-4c36-898e-9b299e5c3774 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:56.115157 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:56.129418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d71d6f-8a5e-4c36-898e-9b299e5c3774 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:56.163666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c6b52-fa78-4d43-a20d-42fa91fed3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:56.164606 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c6b52-fa78-4d43-a20d-42fa91fed3d6 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:56.164888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c6b52-fa78-4d43-a20d-42fa91fed3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:56.165165 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c6b52-fa78-4d43-a20d-42fa91fed3d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:56.165917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c6b52-fa78-4d43-a20d-42fa91fed3d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:56.167283 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c6b52-fa78-4d43-a20d-42fa91fed3d6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:56.188612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 517/1051] 10.222.0.66 () {60 vars in 1144 bytes} [Fri Jul 15 20:24:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:24:57.862941 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be6fb9-18c0-4e23-8318-63bccbb8a630 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:57.863431 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be6fb9-18c0-4e23-8318-63bccbb8a630 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:57.863431 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be6fb9-18c0-4e23-8318-63bccbb8a630 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:57.864958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 535/1052] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:57.870189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4cde4-a294-430c-84f4-c88ccf12cc10 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:57.870574 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4cde4-a294-430c-84f4-c88ccf12cc10 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:57.870745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4cde4-a294-430c-84f4-c88ccf12cc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:57.887667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7fb4cde4-a294-430c-84f4-c88ccf12cc10 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:57.888877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7fb4cde4-a294-430c-84f4-c88ccf12cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:57.927428 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e988c-ebae-4522-a254-60a211652776 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:57.927747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e988c-ebae-4522-a254-60a211652776 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:57.927995 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e988c-ebae-4522-a254-60a211652776 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:57.929546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 536/1053] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:24:57.934351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99da9-ab9c-48b2-9d29-6ccd7427288f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:57.934650 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99da9-ab9c-48b2-9d29-6ccd7427288f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:57.934930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99da9-ab9c-48b2-9d29-6ccd7427288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:57.952548 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-44a99da9-ab9c-48b2-9d29-6ccd7427288f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:57.953744 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-44a99da9-ab9c-48b2-9d29-6ccd7427288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:57.968076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 518/1054] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:24:57.982167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:57.991101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4cde4-a294-430c-84f4-c88ccf12cc10 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:58.026702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 537/1055] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:24:58.050248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a99da9-ab9c-48b2-9d29-6ccd7427288f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:58.065782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:58.103126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4cde4-a294-430c-84f4-c88ccf12cc10 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:58.143025 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a79638-68e0-4bf6-a783-30251bae7ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:58.144978 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a79638-68e0-4bf6-a783-30251bae7ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:58.145436 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a79638-68e0-4bf6-a783-30251bae7ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:58.145720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a79638-68e0-4bf6-a783-30251bae7ec8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:58.156788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a99da9-ab9c-48b2-9d29-6ccd7427288f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:58.156942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a79638-68e0-4bf6-a783-30251bae7ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-95a79638-68e0-4bf6-a783-30251bae7ec8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:58.166344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:58.167280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:58.168132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:58.168132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:58.168132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:58.168132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:58.168132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:58.168132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:58.168132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:58.168132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:58.168132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:58.168132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:58.168132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 20:24:58.168132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:58.168132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 519/1056] 10.222.0.66 () {56 vars in 1120 bytes} [Fri Jul 15 20:24:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:58.174105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a79638-68e0-4bf6-a783-30251bae7ec8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:58.195407 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3180e-8f30-409a-a80a-b3117e109106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:58.196210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3180e-8f30-409a-a80a-b3117e109106 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:58.196526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3180e-8f30-409a-a80a-b3117e109106 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:58.196802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3180e-8f30-409a-a80a-b3117e109106 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:58.207924 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3180e-8f30-409a-a80a-b3117e109106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ecf3180e-8f30-409a-a80a-b3117e109106 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:24:58.215474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:58.216595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:58.222487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:58.222487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:58.222487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:58.222487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:58.222487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:24:58.222487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:24:58.222487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:24:58.222487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:24:58.222487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:24:58.222487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:24:58.222487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:24:58.222487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:58.222487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 538/1057] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:24:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:58.224654 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3180e-8f30-409a-a80a-b3117e109106 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:58.252103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:58.289422 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a79638-68e0-4bf6-a783-30251bae7ec8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:58.319814 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:58.325678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56411e4-2a69-4c78-89fe-1b640027a8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:58.326340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56411e4-2a69-4c78-89fe-1b640027a8ce None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:58.326617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56411e4-2a69-4c78-89fe-1b640027a8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:58.326889 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56411e4-2a69-4c78-89fe-1b640027a8ce None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:58.327621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56411e4-2a69-4c78-89fe-1b640027a8ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:58.327926 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56411e4-2a69-4c78-89fe-1b640027a8ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:58.329318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56411e4-2a69-4c78-89fe-1b640027a8ce None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:58.331641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3180e-8f30-409a-a80a-b3117e109106 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:58.337476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 520/1058] 10.222.0.66 () {56 vars in 1115 bytes} [Fri Jul 15 20:24:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:58.338838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddcc8f-99a7-48fc-8d51-f8997ff54888 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:58.339128 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddcc8f-99a7-48fc-8d51-f8997ff54888 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:58.339404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddcc8f-99a7-48fc-8d51-f8997ff54888 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:58.340650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 521/1059] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:24:58.347650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b8169-2a26-4fe7-81e4-05ff89774bef None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:58.347924 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b8169-2a26-4fe7-81e4-05ff89774bef None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:58.348196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b8169-2a26-4fe7-81e4-05ff89774bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:58.364600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b06b8169-2a26-4fe7-81e4-05ff89774bef None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:24:58.365775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b06b8169-2a26-4fe7-81e4-05ff89774bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:24:58.366197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba26d59-e943-42e3-88b3-ede85d0fea2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:58.366862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba26d59-e943-42e3-88b3-ede85d0fea2d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:58.367143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba26d59-e943-42e3-88b3-ede85d0fea2d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:58.367415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba26d59-e943-42e3-88b3-ede85d0fea2d None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:58.368156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba26d59-e943-42e3-88b3-ede85d0fea2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:58.368490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba26d59-e943-42e3-88b3-ede85d0fea2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:58.369849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba26d59-e943-42e3-88b3-ede85d0fea2d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:58.378238 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 539/1060] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:24:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:58.379006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba26d59-e943-42e3-88b3-ede85d0fea2d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:58.436954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 522/1061] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:24:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:24:58.437793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b8169-2a26-4fe7-81e4-05ff89774bef None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:58.468246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:58.483384 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba26d59-e943-42e3-88b3-ede85d0fea2d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:58.516950 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61acef-794d-40ce-93f0-d2003a77975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:58.517734 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61acef-794d-40ce-93f0-d2003a77975d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:58.518013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61acef-794d-40ce-93f0-d2003a77975d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:58.518283 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61acef-794d-40ce-93f0-d2003a77975d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:58.529123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61acef-794d-40ce-93f0-d2003a77975d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:58.530631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61acef-794d-40ce-93f0-d2003a77975d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:58.546703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b8169-2a26-4fe7-81e4-05ff89774bef None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-5c61acef-794d-40ce-93f0-d2003a77975d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:58.548450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:58.549377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:58.550575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:58.550575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:58.550575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:58.550575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:58.550575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 540/1062] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:58.550575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61acef-794d-40ce-93f0-d2003a77975d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:58.570541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:58.582767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458826f-26f8-4cf1-991f-ca94b0726ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:58.583637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458826f-26f8-4cf1-991f-ca94b0726ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:58.583925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458826f-26f8-4cf1-991f-ca94b0726ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:58.584203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458826f-26f8-4cf1-991f-ca94b0726ad4 None admin] PATH_INFO: `/v3/users/c2129e4da4474b2ea43af8bb1083e14a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:58.598319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458826f-26f8-4cf1-991f-ca94b0726ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=c2129e4da4474b2ea43af8bb1083e14a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:58.599779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458826f-26f8-4cf1-991f-ca94b0726ad4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:58.601486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 523/1063] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:24:58 2022] GET /identity/v3/users/c2129e4da4474b2ea43af8bb1083e14a => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:58.602246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458826f-26f8-4cf1-991f-ca94b0726ad4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:58.650419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61acef-794d-40ce-93f0-d2003a77975d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:58.685443 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c0bc9-1af6-477f-b7a5-ca9895698d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:58.686089 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c0bc9-1af6-477f-b7a5-ca9895698d2d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:58.686372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c0bc9-1af6-477f-b7a5-ca9895698d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:58.686647 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c0bc9-1af6-477f-b7a5-ca9895698d2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:58.695693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:58.702871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458826f-26f8-4cf1-991f-ca94b0726ad4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:58.736903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910897d-7673-4ec3-8d43-e9abd8684d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:58.738108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910897d-7673-4ec3-8d43-e9abd8684d5b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:58.738428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910897d-7673-4ec3-8d43-e9abd8684d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:58.738702 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910897d-7673-4ec3-8d43-e9abd8684d5b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:58.739409 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910897d-7673-4ec3-8d43-e9abd8684d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:58.739712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910897d-7673-4ec3-8d43-e9abd8684d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:58.741094 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910897d-7673-4ec3-8d43-e9abd8684d5b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:58.752072 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 524/1064] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:58.752958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910897d-7673-4ec3-8d43-e9abd8684d5b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:58.756224 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c0bc9-1af6-477f-b7a5-ca9895698d2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:58.757710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c0bc9-1af6-477f-b7a5-ca9895698d2d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:58.795802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:58.854341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910897d-7673-4ec3-8d43-e9abd8684d5b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:58.855906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 541/1065] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:24:58.856765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c0bc9-1af6-477f-b7a5-ca9895698d2d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:58.891613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c420d-ba86-4f89-bed4-6cd625fa0eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:58.892274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c420d-ba86-4f89-bed4-6cd625fa0eed None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:58.892595 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c420d-ba86-4f89-bed4-6cd625fa0eed None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:58.892880 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c420d-ba86-4f89-bed4-6cd625fa0eed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:58.894797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:58.953944 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c0bc9-1af6-477f-b7a5-ca9895698d2d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:58.961220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c420d-ba86-4f89-bed4-6cd625fa0eed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:58.962676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c420d-ba86-4f89-bed4-6cd625fa0eed None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:58.988598 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bd34a-3aea-4196-849e-456bce4857fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:58.989385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bd34a-3aea-4196-849e-456bce4857fd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:58.989674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bd34a-3aea-4196-849e-456bce4857fd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:58.989951 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bd34a-3aea-4196-849e-456bce4857fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:58.996855 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bd34a-3aea-4196-849e-456bce4857fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:58.998298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bd34a-3aea-4196-849e-456bce4857fd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:59.002911 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-502bd34a-3aea-4196-849e-456bce4857fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:24:59.012557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:59.013670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:59.014644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:59.014644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:59.014644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:24:59.014644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:24:59.014644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:24:59.014644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:24:59.014644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:24:59.014644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:24:59.014644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:24:59.014644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:59.014644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 542/1066] 10.222.0.66 () {56 vars in 1093 bytes} [Fri Jul 15 20:24:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:59.014644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bd34a-3aea-4196-849e-456bce4857fd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:59.063236 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 525/1067] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:24:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:24:59.064064 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c420d-ba86-4f89-bed4-6cd625fa0eed None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:59.111108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:59.115797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bd34a-3aea-4196-849e-456bce4857fd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:59.149330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce14bf8-3e56-4976-b6a2-a2d7a613b77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:59.150117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce14bf8-3e56-4976-b6a2-a2d7a613b77e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:59.150397 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce14bf8-3e56-4976-b6a2-a2d7a613b77e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:59.150670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce14bf8-3e56-4976-b6a2-a2d7a613b77e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:59.161021 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce14bf8-3e56-4976-b6a2-a2d7a613b77e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:59.162452 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce14bf8-3e56-4976-b6a2-a2d7a613b77e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:59.165021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c420d-ba86-4f89-bed4-6cd625fa0eed None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-9ce14bf8-3e56-4976-b6a2-a2d7a613b77e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:59.182061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:59.182963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:59.183877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:59.183877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:59.183877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:59.183877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:59.184302 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 543/1068] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:59.185246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce14bf8-3e56-4976-b6a2-a2d7a613b77e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:59.200624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58750c3c-9b18-42a4-b1da-58b371620f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:59.201492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750c3c-9b18-42a4-b1da-58b371620f3d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:59.201773 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750c3c-9b18-42a4-b1da-58b371620f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:59.202044 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750c3c-9b18-42a4-b1da-58b371620f3d None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:59.202870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58750c3c-9b18-42a4-b1da-58b371620f3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:59.203178 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58750c3c-9b18-42a4-b1da-58b371620f3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:59.204667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58750c3c-9b18-42a4-b1da-58b371620f3d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:59.214465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:59.223164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 526/1069] 10.222.0.66 () {56 vars in 1133 bytes} [Fri Jul 15 20:24:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:59.223954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58750c3c-9b18-42a4-b1da-58b371620f3d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:59.284802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce14bf8-3e56-4976-b6a2-a2d7a613b77e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:59.322077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d80133-b670-4270-8841-89d93ad2894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:59.322935 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80133-b670-4270-8841-89d93ad2894a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:59.323222 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80133-b670-4270-8841-89d93ad2894a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:59.323503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80133-b670-4270-8841-89d93ad2894a None admin] PATH_INFO: `/v3/projects/812380931f0a47c7bbcde0fcfaef3839` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:59.324704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d80133-b670-4270-8841-89d93ad2894a None admin] RBAC: Authorizing `identity:get_project(project_id=812380931f0a47c7bbcde0fcfaef3839)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:59.326089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58750c3c-9b18-42a4-b1da-58b371620f3d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:59.326199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d80133-b670-4270-8841-89d93ad2894a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:59.327833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 544/1070] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:24:59 2022] GET /identity/v3/projects/812380931f0a47c7bbcde0fcfaef3839 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:59.328612 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d80133-b670-4270-8841-89d93ad2894a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:59.347713 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:59.361008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454db82f-89f8-4cdd-9b41-0ea9437fb7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:59.361671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454db82f-89f8-4cdd-9b41-0ea9437fb7bf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:59.361960 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454db82f-89f8-4cdd-9b41-0ea9437fb7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:59.362294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454db82f-89f8-4cdd-9b41-0ea9437fb7bf None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:59.363013 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454db82f-89f8-4cdd-9b41-0ea9437fb7bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:59.363321 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454db82f-89f8-4cdd-9b41-0ea9437fb7bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:59.364728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454db82f-89f8-4cdd-9b41-0ea9437fb7bf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:59.375710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 527/1071] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:59.376518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454db82f-89f8-4cdd-9b41-0ea9437fb7bf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:59.436458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d80133-b670-4270-8841-89d93ad2894a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:59.458477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:59.481965 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe05b90-3f16-4c88-97e1-9a9c5fc9e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:59.482784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05b90-3f16-4c88-97e1-9a9c5fc9e0db None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:59.483392 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05b90-3f16-4c88-97e1-9a9c5fc9e0db None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:59.483675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05b90-3f16-4c88-97e1-9a9c5fc9e0db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:59.496310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe05b90-3f16-4c88-97e1-9a9c5fc9e0db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:59.497853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe05b90-3f16-4c88-97e1-9a9c5fc9e0db None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:59.508611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454db82f-89f8-4cdd-9b41-0ea9437fb7bf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-abe05b90-3f16-4c88-97e1-9a9c5fc9e0db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:24:59.518794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:59.519925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:59.520896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:24:59.520896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:24:59.520896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:24:59.520896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:24:59.520896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 545/1072] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:24:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:24:59.526028 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe05b90-3f16-4c88-97e1-9a9c5fc9e0db None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:59.554048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebf485-60c9-4fa3-8c50-7c3f97c322e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:59.555079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebf485-60c9-4fa3-8c50-7c3f97c322e3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:59.555379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebf485-60c9-4fa3-8c50-7c3f97c322e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:59.555662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebf485-60c9-4fa3-8c50-7c3f97c322e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:59.556701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebf485-60c9-4fa3-8c50-7c3f97c322e3 None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=812380931f0a47c7bbcde0fcfaef3839, user.id=c2129e4da4474b2ea43af8bb1083e14a) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:59.557114 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebf485-60c9-4fa3-8c50-7c3f97c322e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:59.558678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebf485-60c9-4fa3-8c50-7c3f97c322e3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:59.564739 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 528/1073] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:24:59 2022] GET /identity/v3/role_assignments?user.id=c2129e4da4474b2ea43af8bb1083e14a&scope.project.id=812380931f0a47c7bbcde0fcfaef3839&role.id=43e0afe364894278be44a97662ca6f8e => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:24:59.612996 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:59.652020 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe05b90-3f16-4c88-97e1-9a9c5fc9e0db None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:59.693500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d89cb-aef3-4897-a5c5-0647347a3ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:59.694193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d89cb-aef3-4897-a5c5-0647347a3ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:59.694481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d89cb-aef3-4897-a5c5-0647347a3ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:59.694762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d89cb-aef3-4897-a5c5-0647347a3ca8 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:59.695535 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d89cb-aef3-4897-a5c5-0647347a3ca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:24:59.695847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d89cb-aef3-4897-a5c5-0647347a3ca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:59.697379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d89cb-aef3-4897-a5c5-0647347a3ca8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:59.714598 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 546/1074] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:24:59.715721 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebf485-60c9-4fa3-8c50-7c3f97c322e3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:59.816601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebf485-60c9-4fa3-8c50-7c3f97c322e3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:24:59.838236 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:24:59.851426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9408d-8233-4ef8-9dd2-afd81d5719d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:24:59.852219 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9408d-8233-4ef8-9dd2-afd81d5719d6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:24:59.852529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9408d-8233-4ef8-9dd2-afd81d5719d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:24:59.854290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9408d-8233-4ef8-9dd2-afd81d5719d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:24:59.859979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9408d-8233-4ef8-9dd2-afd81d5719d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:24:59.861451 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9408d-8233-4ef8-9dd2-afd81d5719d6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d7a9408d-8233-4ef8-9dd2-afd81d5719d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:24:59.875804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:24:59.876980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:24:59.878383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:24:59.878383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:24:59.878383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:24:59.878383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:24:59.878383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:24:59.878383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:24:59.878383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:24:59.878383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:24:59.878383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 529/1075] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:24:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:24:59.883370 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d89cb-aef3-4897-a5c5-0647347a3ca8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:24:59.984152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d89cb-aef3-4897-a5c5-0647347a3ca8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:00.012245 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:00.019034 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6b609-4837-453e-9ca2-b7005ffac3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:00.019771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6b609-4837-453e-9ca2-b7005ffac3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:00.020115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6b609-4837-453e-9ca2-b7005ffac3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:00.020410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6b609-4837-453e-9ca2-b7005ffac3f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:00.021201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6b609-4837-453e-9ca2-b7005ffac3f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:00.021512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6b609-4837-453e-9ca2-b7005ffac3f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:00.022934 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6b609-4837-453e-9ca2-b7005ffac3f4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:00.034866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 547/1076] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:24:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:00.041335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9408d-8233-4ef8-9dd2-afd81d5719d6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:00.141845 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9408d-8233-4ef8-9dd2-afd81d5719d6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:00.176669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ac6c6-179e-47e1-9ea2-dcd4d1bbcafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:00.177550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac6c6-179e-47e1-9ea2-dcd4d1bbcafd None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:00.177831 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac6c6-179e-47e1-9ea2-dcd4d1bbcafd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:00.178103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac6c6-179e-47e1-9ea2-dcd4d1bbcafd None admin] PATH_INFO: `/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/b042da9298894712a0a29787a343bf85/roles/8ba1a71f64804ac08b302f269ea99a20` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:00.180266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ac6c6-179e-47e1-9ea2-dcd4d1bbcafd None admin] RBAC: Authorizing `identity:create_grant(project_id=52dd45fcba114e3f8ff40d8b954ee5cc, user_id=b042da9298894712a0a29787a343bf85, role_id=8ba1a71f64804ac08b302f269ea99a20)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:00.181718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ac6c6-179e-47e1-9ea2-dcd4d1bbcafd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:00.194970 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 530/1077] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:25:00 2022] PUT /identity/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/b042da9298894712a0a29787a343bf85/roles/8ba1a71f64804ac08b302f269ea99a20 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:25:01.559575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0510fe-85d0-42c7-b676-5a1e45d0bb3a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:01.560108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0510fe-85d0-42c7-b676-5a1e45d0bb3a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:01.560201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0510fe-85d0-42c7-b676-5a1e45d0bb3a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:01.561825 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 548/1078] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:01.567707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb1a72-9530-40fe-8f14-93bd5c5d0b58 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:01.568129 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb1a72-9530-40fe-8f14-93bd5c5d0b58 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:01.568260 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb1a72-9530-40fe-8f14-93bd5c5d0b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:01.585532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-14fb1a72-9530-40fe-8f14-93bd5c5d0b58 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:01.586693 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-14fb1a72-9530-40fe-8f14-93bd5c5d0b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:01.620312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:01.654002 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 531/1079] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:01.677909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0510fe-85d0-42c7-b676-5a1e45d0bb3a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:01.778344 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0510fe-85d0-42c7-b676-5a1e45d0bb3a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:01.811396 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba6476-d4cd-4597-859e-b460a1e11d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:01.812180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba6476-d4cd-4597-859e-b460a1e11d28 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:01.812491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba6476-d4cd-4597-859e-b460a1e11d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:01.812766 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba6476-d4cd-4597-859e-b460a1e11d28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:01.823253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba6476-d4cd-4597-859e-b460a1e11d28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ccba6476-d4cd-4597-859e-b460a1e11d28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:25:01.830782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:25:01.831956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:25:01.832862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:25:01.832862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:25:01.832862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:25:01.832862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:25:01.832862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:25:01.832862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:25:01.832862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:25:01.832862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:25:01.832862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:25:01.832862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:25:01.832862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:01.832862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:25:01.832862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 549/1080] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:25:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:25:01.837991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb1a72-9530-40fe-8f14-93bd5c5d0b58 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:01.934593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb1a72-9530-40fe-8f14-93bd5c5d0b58 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:01.967853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbab513-ffe1-4602-bd64-4c883724f6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:01.968540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbab513-ffe1-4602-bd64-4c883724f6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:01.968824 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbab513-ffe1-4602-bd64-4c883724f6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:01.969096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbab513-ffe1-4602-bd64-4c883724f6c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:01.969829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbab513-ffe1-4602-bd64-4c883724f6c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:01.970130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbab513-ffe1-4602-bd64-4c883724f6c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:01.971583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbab513-ffe1-4602-bd64-4c883724f6c5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:01.979522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 532/1081] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:25:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:25:01.985233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba6476-d4cd-4597-859e-b460a1e11d28 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:02.033864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:02.083993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba6476-d4cd-4597-859e-b460a1e11d28 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:02.116983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebec8cf-5480-419e-8371-0eb66a117b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:02.117932 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebec8cf-5480-419e-8371-0eb66a117b27 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:02.118225 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebec8cf-5480-419e-8371-0eb66a117b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:02.118503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebec8cf-5480-419e-8371-0eb66a117b27 None admin] PATH_INFO: `/v3/users/c2129e4da4474b2ea43af8bb1083e14a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:02.119709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebec8cf-5480-419e-8371-0eb66a117b27 None admin] RBAC: Authorizing `identity:get_user(user_id=c2129e4da4474b2ea43af8bb1083e14a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:02.121186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebec8cf-5480-419e-8371-0eb66a117b27 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:02.122835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 550/1082] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:25:01 2022] GET /identity/v3/users/c2129e4da4474b2ea43af8bb1083e14a => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:02.129289 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbab513-ffe1-4602-bd64-4c883724f6c5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:02.164327 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:02.188148 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2313a1-ae62-4367-ba0c-b897d868d903 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:02.188462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2313a1-ae62-4367-ba0c-b897d868d903 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:02.188742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2313a1-ae62-4367-ba0c-b897d868d903 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:02.190130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 551/1083] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:25:02.195035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18936f16-7a19-4dab-8502-678a6d66ee94 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:02.195334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18936f16-7a19-4dab-8502-678a6d66ee94 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:02.195620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18936f16-7a19-4dab-8502-678a6d66ee94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:02.211969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-18936f16-7a19-4dab-8502-678a6d66ee94 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:02.213191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-18936f16-7a19-4dab-8502-678a6d66ee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:02.231492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbab513-ffe1-4602-bd64-4c883724f6c5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:02.264136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4675b-8a74-4800-8083-0451f292bc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:02.265022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4675b-8a74-4800-8083-0451f292bc9d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:02.265305 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4675b-8a74-4800-8083-0451f292bc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:02.265581 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4675b-8a74-4800-8083-0451f292bc9d None admin] PATH_INFO: `/v3/projects/812380931f0a47c7bbcde0fcfaef3839` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:02.266753 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4675b-8a74-4800-8083-0451f292bc9d None admin] RBAC: Authorizing `identity:get_project(project_id=812380931f0a47c7bbcde0fcfaef3839)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:02.268175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4675b-8a74-4800-8083-0451f292bc9d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:02.270017 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 533/1084] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:25:02 2022] GET /identity/v3/projects/812380931f0a47c7bbcde0fcfaef3839 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:02.275743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4675b-8a74-4800-8083-0451f292bc9d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:02.280810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 552/1085] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:25:02.304849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18936f16-7a19-4dab-8502-678a6d66ee94 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:02.352784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:02.374319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4675b-8a74-4800-8083-0451f292bc9d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:02.375893 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:02.404933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18936f16-7a19-4dab-8502-678a6d66ee94 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:02.408443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062fa87-b049-43db-9b69-ee53619e4b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:02.409934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062fa87-b049-43db-9b69-ee53619e4b83 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:02.410262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062fa87-b049-43db-9b69-ee53619e4b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:02.410542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062fa87-b049-43db-9b69-ee53619e4b83 None admin] PATH_INFO: `/v3/projects/812380931f0a47c7bbcde0fcfaef3839/users/c2129e4da4474b2ea43af8bb1083e14a/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:02.412566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062fa87-b049-43db-9b69-ee53619e4b83 None admin] RBAC: Authorizing `identity:create_grant(project_id=812380931f0a47c7bbcde0fcfaef3839, user_id=c2129e4da4474b2ea43af8bb1083e14a, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:02.414260 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062fa87-b049-43db-9b69-ee53619e4b83 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:02.428310 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 534/1086] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:25:02 2022] PUT /identity/v3/projects/812380931f0a47c7bbcde0fcfaef3839/users/c2129e4da4474b2ea43af8bb1083e14a/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:25:02.440779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6fec7-af3a-4e3c-b458-83ec4e7cd897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:02.441688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6fec7-af3a-4e3c-b458-83ec4e7cd897 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:02.441982 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6fec7-af3a-4e3c-b458-83ec4e7cd897 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:02.442318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6fec7-af3a-4e3c-b458-83ec4e7cd897 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:02.454553 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6fec7-af3a-4e3c-b458-83ec4e7cd897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-f3a6fec7-af3a-4e3c-b458-83ec4e7cd897 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:25:02.463792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:25:02.465149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:25:02.466212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:25:02.466212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:25:02.466212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:25:02.466212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:25:02.466212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:25:02.466212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:25:02.466212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:25:02.466212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:25:02.466212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:25:02.466212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:25:02.466212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 20:25:02.466212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:25:02.467235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 553/1087] 10.222.0.66 () {56 vars in 1120 bytes} [Fri Jul 15 20:25:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:25:02.472441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062fa87-b049-43db-9b69-ee53619e4b83 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:02.583151 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062fa87-b049-43db-9b69-ee53619e4b83 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:02.617637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aba2f-7bf5-4513-8b79-52e929998ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:02.618309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aba2f-7bf5-4513-8b79-52e929998ddc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:02.618594 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aba2f-7bf5-4513-8b79-52e929998ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:02.618871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aba2f-7bf5-4513-8b79-52e929998ddc None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:02.619610 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4aba2f-7bf5-4513-8b79-52e929998ddc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:02.619918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4aba2f-7bf5-4513-8b79-52e929998ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:02.621317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4aba2f-7bf5-4513-8b79-52e929998ddc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:02.629676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 535/1088] 10.222.0.66 () {56 vars in 1115 bytes} [Fri Jul 15 20:25:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:02.635632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6fec7-af3a-4e3c-b458-83ec4e7cd897 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:02.734668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6fec7-af3a-4e3c-b458-83ec4e7cd897 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:02.744222 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:02.769491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93ee37-9313-4cf4-987e-07fc6c1a0b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:02.770236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93ee37-9313-4cf4-987e-07fc6c1a0b3e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:02.770525 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93ee37-9313-4cf4-987e-07fc6c1a0b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:02.770808 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93ee37-9313-4cf4-987e-07fc6c1a0b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:02.781200 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93ee37-9313-4cf4-987e-07fc6c1a0b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:02.782643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93ee37-9313-4cf4-987e-07fc6c1a0b3e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-fc93ee37-9313-4cf4-987e-07fc6c1a0b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:25:02.800367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:25:02.801386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:25:02.802291 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:25:02.802291 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:25:02.802291 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:25:02.802291 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:25:02.802291 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 554/1089] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:25:02.807260 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aba2f-7bf5-4513-8b79-52e929998ddc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:02.833847 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:02.912067 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aba2f-7bf5-4513-8b79-52e929998ddc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:02.945565 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b89f4a-ee63-4694-9355-f7b90815a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:02.946227 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b89f4a-ee63-4694-9355-f7b90815a90b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:02.946514 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b89f4a-ee63-4694-9355-f7b90815a90b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:02.946795 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b89f4a-ee63-4694-9355-f7b90815a90b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:02.947511 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b89f4a-ee63-4694-9355-f7b90815a90b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:02.947821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b89f4a-ee63-4694-9355-f7b90815a90b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:02.949219 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b89f4a-ee63-4694-9355-f7b90815a90b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:02.961200 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 536/1090] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:02.966588 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93ee37-9313-4cf4-987e-07fc6c1a0b3e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:03.065023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93ee37-9313-4cf4-987e-07fc6c1a0b3e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:03.098926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28ac28-d022-4dfc-80ad-b10755d2baec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:03.099638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28ac28-d022-4dfc-80ad-b10755d2baec None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:03.099922 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28ac28-d022-4dfc-80ad-b10755d2baec None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:03.100195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28ac28-d022-4dfc-80ad-b10755d2baec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:03.107773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28ac28-d022-4dfc-80ad-b10755d2baec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:03.109272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28ac28-d022-4dfc-80ad-b10755d2baec None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ce28ac28-d022-4dfc-80ad-b10755d2baec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:25:03.123711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:25:03.124699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:25:03.125643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:25:03.125643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:25:03.125643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:25:03.125643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:25:03.125643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:25:03.125643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:25:03.125643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:25:03.125643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:25:03.125643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 20:25:03.125643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:25:03.125643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 555/1091] 10.222.0.66 () {56 vars in 1093 bytes} [Fri Jul 15 20:25:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:25:03.130671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b89f4a-ee63-4694-9355-f7b90815a90b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:03.214246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:03.230454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b89f4a-ee63-4694-9355-f7b90815a90b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:03.263361 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998a929-bbcc-4e79-aba5-f73615bc97e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:03.264024 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998a929-bbcc-4e79-aba5-f73615bc97e4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:03.264308 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998a929-bbcc-4e79-aba5-f73615bc97e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:03.264609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998a929-bbcc-4e79-aba5-f73615bc97e4 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:03.265439 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998a929-bbcc-4e79-aba5-f73615bc97e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:03.265751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998a929-bbcc-4e79-aba5-f73615bc97e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:03.267177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998a929-bbcc-4e79-aba5-f73615bc97e4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:03.286065 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 537/1092] 10.222.0.66 () {56 vars in 1133 bytes} [Fri Jul 15 20:25:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:03.291746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28ac28-d022-4dfc-80ad-b10755d2baec None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:03.313738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:03.389938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28ac28-d022-4dfc-80ad-b10755d2baec None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:03.423703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053394b5-b81a-4584-aa53-896a207a42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:03.424350 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053394b5-b81a-4584-aa53-896a207a42db None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:03.424997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053394b5-b81a-4584-aa53-896a207a42db None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:03.424997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053394b5-b81a-4584-aa53-896a207a42db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:03.498669 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053394b5-b81a-4584-aa53-896a207a42db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:03.500152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053394b5-b81a-4584-aa53-896a207a42db None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:03.522723 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:03.601093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 556/1093] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:25:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:25:03.606566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998a929-bbcc-4e79-aba5-f73615bc97e4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:03.708957 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998a929-bbcc-4e79-aba5-f73615bc97e4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:03.742217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104a6b4-0604-43e6-af7a-5e3ad89274ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:03.743008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104a6b4-0604-43e6-af7a-5e3ad89274ae None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:03.743291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104a6b4-0604-43e6-af7a-5e3ad89274ae None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:03.743567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104a6b4-0604-43e6-af7a-5e3ad89274ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:03.754091 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104a6b4-0604-43e6-af7a-5e3ad89274ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:03.755516 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104a6b4-0604-43e6-af7a-5e3ad89274ae None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:03.757208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-5104a6b4-0604-43e6-af7a-5e3ad89274ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:25:03.775118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:25:03.776008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:25:03.777218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:25:03.777218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:25:03.777218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:25:03.777218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:25:03.777218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 538/1094] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:25:03.781941 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053394b5-b81a-4584-aa53-896a207a42db None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:03.880834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053394b5-b81a-4584-aa53-896a207a42db None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:03.901358 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:03.916347 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2112120-15b7-4464-8850-c18d79cdc5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:03.917039 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112120-15b7-4464-8850-c18d79cdc5ae None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:03.917326 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112120-15b7-4464-8850-c18d79cdc5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:03.917602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112120-15b7-4464-8850-c18d79cdc5ae None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:03.918325 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2112120-15b7-4464-8850-c18d79cdc5ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:03.918632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2112120-15b7-4464-8850-c18d79cdc5ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:03.919993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2112120-15b7-4464-8850-c18d79cdc5ae None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:03.931765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 557/1095] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:03.937499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104a6b4-0604-43e6-af7a-5e3ad89274ae None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:04.035542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104a6b4-0604-43e6-af7a-5e3ad89274ae None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:04.069488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fe743-8420-43b5-a3eb-09d5acd5f4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:04.070276 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fe743-8420-43b5-a3eb-09d5acd5f4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:04.070563 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fe743-8420-43b5-a3eb-09d5acd5f4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:04.070844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fe743-8420-43b5-a3eb-09d5acd5f4c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:04.077739 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70fe743-8420-43b5-a3eb-09d5acd5f4c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:04.079199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70fe743-8420-43b5-a3eb-09d5acd5f4c8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d70fe743-8420-43b5-a3eb-09d5acd5f4c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:25:04.093423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:25:04.094428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:25:04.095317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:25:04.095317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:25:04.095317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:25:04.095317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:25:04.095317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:25:04.095317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:25:04.095317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:25:04.095317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:25:04.095317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 539/1096] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:25:04.100713 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2112120-15b7-4464-8850-c18d79cdc5ae None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:04.206162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2112120-15b7-4464-8850-c18d79cdc5ae None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:04.240439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67987d0-2481-4d73-ae1e-8b9935a56d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:04.241108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67987d0-2481-4d73-ae1e-8b9935a56d78 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:04.241395 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67987d0-2481-4d73-ae1e-8b9935a56d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:04.241672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67987d0-2481-4d73-ae1e-8b9935a56d78 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:04.242485 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67987d0-2481-4d73-ae1e-8b9935a56d78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:04.242797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67987d0-2481-4d73-ae1e-8b9935a56d78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:04.244222 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67987d0-2481-4d73-ae1e-8b9935a56d78 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:04.256623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 558/1097] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:25:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:25:04.262700 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fe743-8420-43b5-a3eb-09d5acd5f4c8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:04.318221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:04.363087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fe743-8420-43b5-a3eb-09d5acd5f4c8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:04.395222 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7935777-1878-4d9f-9ad1-4f6956adc206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:04.395875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7935777-1878-4d9f-9ad1-4f6956adc206 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:04.396157 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7935777-1878-4d9f-9ad1-4f6956adc206 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:04.396456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7935777-1878-4d9f-9ad1-4f6956adc206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:04.397309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7935777-1878-4d9f-9ad1-4f6956adc206 None admin] RBAC: Adding query filter params (role.id=8ba1a71f64804ac08b302f269ea99a20, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=b042da9298894712a0a29787a343bf85) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:04.397710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7935777-1878-4d9f-9ad1-4f6956adc206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:04.399148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7935777-1878-4d9f-9ad1-4f6956adc206 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:04.399489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f8c3d-d234-4489-b7ed-ebddf2480a7e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:04.399845 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f8c3d-d234-4489-b7ed-ebddf2480a7e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:04.400202 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f8c3d-d234-4489-b7ed-ebddf2480a7e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:04.401674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 559/1098] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:04.406571 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde036fd-f48a-4ce4-9826-54e0260ad704 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:04.406865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde036fd-f48a-4ce4-9826-54e0260ad704 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:04.407151 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde036fd-f48a-4ce4-9826-54e0260ad704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:04.407949 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 540/1099] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:25:04 2022] GET /identity/v3/role_assignments?user.id=b042da9298894712a0a29787a343bf85&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=8ba1a71f64804ac08b302f269ea99a20 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:04.426704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cde036fd-f48a-4ce4-9826-54e0260ad704 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:04.427957 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cde036fd-f48a-4ce4-9826-54e0260ad704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:04.466309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:04.502401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 560/1100] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:25:04.525874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7935777-1878-4d9f-9ad1-4f6956adc206 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:04.630860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7935777-1878-4d9f-9ad1-4f6956adc206 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:04.648168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:04.672695 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5256a-a8e3-4409-982a-66717afeee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:04.673519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5256a-a8e3-4409-982a-66717afeee07 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:04.673807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5256a-a8e3-4409-982a-66717afeee07 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:04.674084 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5256a-a8e3-4409-982a-66717afeee07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:04.685682 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5256a-a8e3-4409-982a-66717afeee07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-56b5256a-a8e3-4409-982a-66717afeee07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:25:04.694405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:25:04.695374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:25:04.696312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:25:04.696312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:25:04.696312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:25:04.696312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:25:04.696312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:25:04.696312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:25:04.696312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:25:04.696312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:25:04.696312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:25:04.696312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:25:04.696312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:04.696312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:25:04.696312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 541/1101] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:25:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:25:04.701770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde036fd-f48a-4ce4-9826-54e0260ad704 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:04.809221 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde036fd-f48a-4ce4-9826-54e0260ad704 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:04.843062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b0a2-7e9c-4497-9a87-bcb753c16c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:04.843739 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b0a2-7e9c-4497-9a87-bcb753c16c60 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:04.844046 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b0a2-7e9c-4497-9a87-bcb753c16c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:04.844299 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b0a2-7e9c-4497-9a87-bcb753c16c60 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:04.845076 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943b0a2-7e9c-4497-9a87-bcb753c16c60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:04.845386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943b0a2-7e9c-4497-9a87-bcb753c16c60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:04.846889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943b0a2-7e9c-4497-9a87-bcb753c16c60 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:04.855342 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 561/1102] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:25:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:04.861291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5256a-a8e3-4409-982a-66717afeee07 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:04.967392 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5256a-a8e3-4409-982a-66717afeee07 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:05.004636 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee395ad-a6bb-433b-b27e-d0d7c507b160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:05.005514 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee395ad-a6bb-433b-b27e-d0d7c507b160 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:05.005801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee395ad-a6bb-433b-b27e-d0d7c507b160 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:05.006079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee395ad-a6bb-433b-b27e-d0d7c507b160 None admin] PATH_INFO: `/v3/users/c2129e4da4474b2ea43af8bb1083e14a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:05.007277 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee395ad-a6bb-433b-b27e-d0d7c507b160 None admin] RBAC: Authorizing `identity:get_user(user_id=c2129e4da4474b2ea43af8bb1083e14a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:05.008746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee395ad-a6bb-433b-b27e-d0d7c507b160 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:05.010739 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 542/1103] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:25:04 2022] GET /identity/v3/users/c2129e4da4474b2ea43af8bb1083e14a => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:05.016169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b0a2-7e9c-4497-9a87-bcb753c16c60 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:05.047720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:05.123110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b0a2-7e9c-4497-9a87-bcb753c16c60 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:05.158852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d143d7-cf5b-465c-a867-656c19a52e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:05.159606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d143d7-cf5b-465c-a867-656c19a52e57 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:05.159773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d143d7-cf5b-465c-a867-656c19a52e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:05.160049 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d143d7-cf5b-465c-a867-656c19a52e57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:05.229489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d143d7-cf5b-465c-a867-656c19a52e57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:05.230864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d143d7-cf5b-465c-a867-656c19a52e57 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:05.260813 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:05.328568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 562/1104] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:25:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:25:05.335160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee395ad-a6bb-433b-b27e-d0d7c507b160 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:05.380473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:05.444932 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee395ad-a6bb-433b-b27e-d0d7c507b160 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:05.477683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12676a17-5bb6-4745-9f27-2a0f5986ca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:05.478537 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12676a17-5bb6-4745-9f27-2a0f5986ca64 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:05.478824 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12676a17-5bb6-4745-9f27-2a0f5986ca64 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:05.479103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12676a17-5bb6-4745-9f27-2a0f5986ca64 None admin] PATH_INFO: `/v3/projects/812380931f0a47c7bbcde0fcfaef3839` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:05.480316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12676a17-5bb6-4745-9f27-2a0f5986ca64 None admin] RBAC: Authorizing `identity:get_project(project_id=812380931f0a47c7bbcde0fcfaef3839)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:05.481725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12676a17-5bb6-4745-9f27-2a0f5986ca64 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:05.483405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 543/1105] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:25:05 2022] GET /identity/v3/projects/812380931f0a47c7bbcde0fcfaef3839 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:05.490231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d143d7-cf5b-465c-a867-656c19a52e57 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:05.585429 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d143d7-cf5b-465c-a867-656c19a52e57 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:05.614029 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:05.619593 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1df6a-b639-4cbc-94c6-1157771011ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:05.620367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1df6a-b639-4cbc-94c6-1157771011ed None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:05.620858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1df6a-b639-4cbc-94c6-1157771011ed None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:05.621143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1df6a-b639-4cbc-94c6-1157771011ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:05.621977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1df6a-b639-4cbc-94c6-1157771011ed None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=812380931f0a47c7bbcde0fcfaef3839, user.id=c2129e4da4474b2ea43af8bb1083e14a) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:05.622288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1df6a-b639-4cbc-94c6-1157771011ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:05.623707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1df6a-b639-4cbc-94c6-1157771011ed None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:05.630036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 563/1106] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:25:05 2022] GET /identity/v3/role_assignments?user.id=c2129e4da4474b2ea43af8bb1083e14a&scope.project.id=812380931f0a47c7bbcde0fcfaef3839&role.id=43e0afe364894278be44a97662ca6f8e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:07.625504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16006-6bf7-4320-af97-59eb43d97e02 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:07.626015 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16006-6bf7-4320-af97-59eb43d97e02 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:07.626140 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16006-6bf7-4320-af97-59eb43d97e02 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:07.627441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 544/1107] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:07.632977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c7687-375b-473c-aac1-74ad3b61e360 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:07.633386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c7687-375b-473c-aac1-74ad3b61e360 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:07.633534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c7687-375b-473c-aac1-74ad3b61e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:07.650140 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5d6c7687-375b-473c-aac1-74ad3b61e360 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:07.651320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5d6c7687-375b-473c-aac1-74ad3b61e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:07.715617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 564/1108] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:07.741440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce16006-6bf7-4320-af97-59eb43d97e02 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:07.842274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce16006-6bf7-4320-af97-59eb43d97e02 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:07.855931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:07.876266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fca0e-ca55-406f-bb6a-08b5f2a799a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:07.877076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fca0e-ca55-406f-bb6a-08b5f2a799a1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:07.877370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fca0e-ca55-406f-bb6a-08b5f2a799a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:07.877651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fca0e-ca55-406f-bb6a-08b5f2a799a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:07.878818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fca0e-ca55-406f-bb6a-08b5f2a799a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:07.880244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fca0e-ca55-406f-bb6a-08b5f2a799a1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:07.881874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 545/1109] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:25:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:07.887821 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c7687-375b-473c-aac1-74ad3b61e360 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:07.982172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c7687-375b-473c-aac1-74ad3b61e360 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:08.006862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:08.015382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd0355-ad7d-4163-b142-150ee6c70b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:08.016037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd0355-ad7d-4163-b142-150ee6c70b0b None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:08.016322 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd0355-ad7d-4163-b142-150ee6c70b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:08.016626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd0355-ad7d-4163-b142-150ee6c70b0b None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:08.017331 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd0355-ad7d-4163-b142-150ee6c70b0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:08.019360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd0355-ad7d-4163-b142-150ee6c70b0b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:08.038301 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 565/1110] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:25:07 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:25:10.060307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245b7e-ad19-4bde-9b87-d70b418a8b31 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:10.060879 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245b7e-ad19-4bde-9b87-d70b418a8b31 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:10.060879 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245b7e-ad19-4bde-9b87-d70b418a8b31 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:10.062258 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 546/1111] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:10.068498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7335a75-374f-47c5-b4bc-5c9dfc5cb8b6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:10.068915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7335a75-374f-47c5-b4bc-5c9dfc5cb8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:10.069067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7335a75-374f-47c5-b4bc-5c9dfc5cb8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:10.086327 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d7335a75-374f-47c5-b4bc-5c9dfc5cb8b6 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:10.087510 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d7335a75-374f-47c5-b4bc-5c9dfc5cb8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:10.153625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 566/1112] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:10.178925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50245b7e-ad19-4bde-9b87-d70b418a8b31 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:10.284768 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50245b7e-ad19-4bde-9b87-d70b418a8b31 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:10.318213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdf16f-68bb-49c4-8852-f2b147654838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:10.319006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdf16f-68bb-49c4-8852-f2b147654838 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:10.319291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdf16f-68bb-49c4-8852-f2b147654838 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:10.319567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdf16f-68bb-49c4-8852-f2b147654838 None admin] PATH_INFO: `/v3/roles/e97c8dedb3a147c6ab5d98229f5a000c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:10.321060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdf16f-68bb-49c4-8852-f2b147654838 None admin] RBAC: Authorizing `identity:get_role(role_id=e97c8dedb3a147c6ab5d98229f5a000c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:10.322425 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdf16f-68bb-49c4-8852-f2b147654838 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:10.323776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 547/1113] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:25:10 2022] GET /identity/v3/roles/e97c8dedb3a147c6ab5d98229f5a000c => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:10.329927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7335a75-374f-47c5-b4bc-5c9dfc5cb8b6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:10.427333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7335a75-374f-47c5-b4bc-5c9dfc5cb8b6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:10.439893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:10.463046 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7e550-3412-4866-ad63-b9ce88f6d558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:10.463925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7e550-3412-4866-ad63-b9ce88f6d558 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:10.464217 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7e550-3412-4866-ad63-b9ce88f6d558 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:10.464535 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7e550-3412-4866-ad63-b9ce88f6d558 None admin] PATH_INFO: `/v3/users/99f6aaf468f6458d9abe4776784deaad` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:10.478366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7e550-3412-4866-ad63-b9ce88f6d558 None admin] RBAC: Authorizing `identity:get_user(user_id=99f6aaf468f6458d9abe4776784deaad)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:10.479796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7e550-3412-4866-ad63-b9ce88f6d558 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:10.481481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 567/1114] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:25:10 2022] GET /identity/v3/users/99f6aaf468f6458d9abe4776784deaad => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:10.487539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdf16f-68bb-49c4-8852-f2b147654838 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:10.535895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:10.583725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdf16f-68bb-49c4-8852-f2b147654838 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:10.616557 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c0e7e-7084-4989-8036-9fd1a47f8684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:10.617176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c0e7e-7084-4989-8036-9fd1a47f8684 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:10.617459 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c0e7e-7084-4989-8036-9fd1a47f8684 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:10.617734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c0e7e-7084-4989-8036-9fd1a47f8684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:10.681925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c0e7e-7084-4989-8036-9fd1a47f8684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:10.683358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c0e7e-7084-4989-8036-9fd1a47f8684 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:10.729045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:10.779262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 548/1115] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:25:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:25:10.786031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7e550-3412-4866-ad63-b9ce88f6d558 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:10.882454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7e550-3412-4866-ad63-b9ce88f6d558 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:10.915049 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1055c16-dd0d-4477-a699-978848fed10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:10.915898 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1055c16-dd0d-4477-a699-978848fed10c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:10.916177 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1055c16-dd0d-4477-a699-978848fed10c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:10.916473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1055c16-dd0d-4477-a699-978848fed10c None admin] PATH_INFO: `/v3/projects/812380931f0a47c7bbcde0fcfaef3839` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:10.917614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1055c16-dd0d-4477-a699-978848fed10c None admin] RBAC: Authorizing `identity:get_project(project_id=812380931f0a47c7bbcde0fcfaef3839)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:10.919033 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1055c16-dd0d-4477-a699-978848fed10c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:10.920732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 568/1116] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:25:10 2022] GET /identity/v3/projects/812380931f0a47c7bbcde0fcfaef3839 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:10.927121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c0e7e-7084-4989-8036-9fd1a47f8684 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:11.024807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c0e7e-7084-4989-8036-9fd1a47f8684 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:11.057855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467c916-d1bd-4953-b50f-86d4cd02d72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:11.058496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467c916-d1bd-4953-b50f-86d4cd02d72b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:11.058779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467c916-d1bd-4953-b50f-86d4cd02d72b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:11.059053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467c916-d1bd-4953-b50f-86d4cd02d72b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:11.059868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467c916-d1bd-4953-b50f-86d4cd02d72b None admin] RBAC: Adding query filter params (role.id=e97c8dedb3a147c6ab5d98229f5a000c, scope.project.id=812380931f0a47c7bbcde0fcfaef3839, user.id=99f6aaf468f6458d9abe4776784deaad) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:11.060179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467c916-d1bd-4953-b50f-86d4cd02d72b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:11.061640 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467c916-d1bd-4953-b50f-86d4cd02d72b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:11.067704 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 549/1117] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:25:10 2022] GET /identity/v3/role_assignments?user.id=99f6aaf468f6458d9abe4776784deaad&scope.project.id=812380931f0a47c7bbcde0fcfaef3839&role.id=e97c8dedb3a147c6ab5d98229f5a000c => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:13.026795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e3be3-3634-451a-9b24-3a5f44a66676 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:13.027354 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e3be3-3634-451a-9b24-3a5f44a66676 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:13.027354 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e3be3-3634-451a-9b24-3a5f44a66676 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:13.028777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 569/1118] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:13.034581 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77546d-5e41-4f7a-9b36-a9c6540c4448 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:13.035002 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77546d-5e41-4f7a-9b36-a9c6540c4448 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:13.035122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77546d-5e41-4f7a-9b36-a9c6540c4448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:13.052293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5c77546d-5e41-4f7a-9b36-a9c6540c4448 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:13.053495 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5c77546d-5e41-4f7a-9b36-a9c6540c4448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:13.065580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:13.123956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 550/1119] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:25:13.146892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e3be3-3634-451a-9b24-3a5f44a66676 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:13.188237 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:13.248709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e3be3-3634-451a-9b24-3a5f44a66676 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:13.281720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2e890-2f32-4fa8-a7c9-e7056f4e48cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:13.282512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2e890-2f32-4fa8-a7c9-e7056f4e48cd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:13.282796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2e890-2f32-4fa8-a7c9-e7056f4e48cd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:13.283073 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2e890-2f32-4fa8-a7c9-e7056f4e48cd None admin] PATH_INFO: `/v3/roles/e97c8dedb3a147c6ab5d98229f5a000c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:13.285474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2e890-2f32-4fa8-a7c9-e7056f4e48cd None admin] RBAC: Authorizing `identity:get_role(role_id=e97c8dedb3a147c6ab5d98229f5a000c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:13.286843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2e890-2f32-4fa8-a7c9-e7056f4e48cd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:13.288204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 570/1120] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:25:13 2022] GET /identity/v3/roles/e97c8dedb3a147c6ab5d98229f5a000c => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:13.294146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77546d-5e41-4f7a-9b36-a9c6540c4448 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:13.391630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77546d-5e41-4f7a-9b36-a9c6540c4448 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:13.426002 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325370-c366-47d9-8da7-ebbfb7824854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:13.426865 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325370-c366-47d9-8da7-ebbfb7824854 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:13.427152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325370-c366-47d9-8da7-ebbfb7824854 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:13.427430 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325370-c366-47d9-8da7-ebbfb7824854 None admin] PATH_INFO: `/v3/users/99f6aaf468f6458d9abe4776784deaad` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:13.428657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68325370-c366-47d9-8da7-ebbfb7824854 None admin] RBAC: Authorizing `identity:get_user(user_id=99f6aaf468f6458d9abe4776784deaad)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:13.430092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68325370-c366-47d9-8da7-ebbfb7824854 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:13.431719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 551/1121] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:25:13 2022] GET /identity/v3/users/99f6aaf468f6458d9abe4776784deaad => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:13.437569 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2e890-2f32-4fa8-a7c9-e7056f4e48cd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:13.535720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2e890-2f32-4fa8-a7c9-e7056f4e48cd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:13.543014 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:13.568747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3504931-ff2a-4557-a9c4-0edc338a7904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:13.569610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3504931-ff2a-4557-a9c4-0edc338a7904 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:13.569892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3504931-ff2a-4557-a9c4-0edc338a7904 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:13.570166 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3504931-ff2a-4557-a9c4-0edc338a7904 None admin] PATH_INFO: `/v3/projects/812380931f0a47c7bbcde0fcfaef3839` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:13.571325 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3504931-ff2a-4557-a9c4-0edc338a7904 None admin] RBAC: Authorizing `identity:get_project(project_id=812380931f0a47c7bbcde0fcfaef3839)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:13.572778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3504931-ff2a-4557-a9c4-0edc338a7904 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:13.574456 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 571/1122] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:25:13 2022] GET /identity/v3/projects/812380931f0a47c7bbcde0fcfaef3839 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:13.581412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325370-c366-47d9-8da7-ebbfb7824854 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:13.595783 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:13.679786 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325370-c366-47d9-8da7-ebbfb7824854 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:13.712988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5cfe8-4a31-428a-b852-8da1641848b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:13.713872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5cfe8-4a31-428a-b852-8da1641848b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:13.714176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5cfe8-4a31-428a-b852-8da1641848b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:13.714457 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5cfe8-4a31-428a-b852-8da1641848b5 None admin] PATH_INFO: `/v3/projects/812380931f0a47c7bbcde0fcfaef3839/users/99f6aaf468f6458d9abe4776784deaad/roles/e97c8dedb3a147c6ab5d98229f5a000c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:13.716667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5cfe8-4a31-428a-b852-8da1641848b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=812380931f0a47c7bbcde0fcfaef3839, user_id=99f6aaf468f6458d9abe4776784deaad, role_id=e97c8dedb3a147c6ab5d98229f5a000c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:13.718110 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5cfe8-4a31-428a-b852-8da1641848b5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:13.731498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 552/1123] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:25:13 2022] PUT /identity/v3/projects/812380931f0a47c7bbcde0fcfaef3839/users/99f6aaf468f6458d9abe4776784deaad/roles/e97c8dedb3a147c6ab5d98229f5a000c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:25:15.733803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbee56-632e-49b1-9b00-cfbfbd54dd63 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:15.734293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbee56-632e-49b1-9b00-cfbfbd54dd63 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:15.734293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbee56-632e-49b1-9b00-cfbfbd54dd63 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:15.735653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 572/1124] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:15.741929 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfc176-b456-4d7b-a66e-d3335a522e92 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:15.742346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfc176-b456-4d7b-a66e-d3335a522e92 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:15.742494 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfc176-b456-4d7b-a66e-d3335a522e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:15.759638 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b0dfc176-b456-4d7b-a66e-d3335a522e92 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:15.760845 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b0dfc176-b456-4d7b-a66e-d3335a522e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:15.826290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 553/1125] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:15.851379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbee56-632e-49b1-9b00-cfbfbd54dd63 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:15.950965 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbee56-632e-49b1-9b00-cfbfbd54dd63 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:15.984442 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134cd83-fab6-4fa1-9df5-b097853939e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:15.985232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134cd83-fab6-4fa1-9df5-b097853939e7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:15.985523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134cd83-fab6-4fa1-9df5-b097853939e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:15.985802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134cd83-fab6-4fa1-9df5-b097853939e7 None admin] PATH_INFO: `/v3/roles/e97c8dedb3a147c6ab5d98229f5a000c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:15.987329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134cd83-fab6-4fa1-9df5-b097853939e7 None admin] RBAC: Authorizing `identity:get_role(role_id=e97c8dedb3a147c6ab5d98229f5a000c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:15.988894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134cd83-fab6-4fa1-9df5-b097853939e7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:15.990266 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 573/1126] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:25:15 2022] GET /identity/v3/roles/e97c8dedb3a147c6ab5d98229f5a000c => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:15.996373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfc176-b456-4d7b-a66e-d3335a522e92 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:15.998592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:16.094719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfc176-b456-4d7b-a66e-d3335a522e92 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:16.128375 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126f681-9814-4822-a80e-c35d549b006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:16.129258 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f681-9814-4822-a80e-c35d549b006f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:16.129545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f681-9814-4822-a80e-c35d549b006f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:16.129850 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f681-9814-4822-a80e-c35d549b006f None admin] PATH_INFO: `/v3/users/99f6aaf468f6458d9abe4776784deaad` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:16.131033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126f681-9814-4822-a80e-c35d549b006f None admin] RBAC: Authorizing `identity:get_user(user_id=99f6aaf468f6458d9abe4776784deaad)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:16.132491 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126f681-9814-4822-a80e-c35d549b006f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:16.134104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 554/1127] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:25:15 2022] GET /identity/v3/users/99f6aaf468f6458d9abe4776784deaad => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:16.139814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134cd83-fab6-4fa1-9df5-b097853939e7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:16.182662 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:16.237592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134cd83-fab6-4fa1-9df5-b097853939e7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:16.271207 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f0a48-46f7-4238-a298-3e8e1e770ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:16.271838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f0a48-46f7-4238-a298-3e8e1e770ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:16.272116 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f0a48-46f7-4238-a298-3e8e1e770ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:16.272417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f0a48-46f7-4238-a298-3e8e1e770ca3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:16.338247 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f0a48-46f7-4238-a298-3e8e1e770ca3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:16.339667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f0a48-46f7-4238-a298-3e8e1e770ca3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:16.379259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:16.437547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 574/1128] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:25:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:25:16.444169 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126f681-9814-4822-a80e-c35d549b006f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:16.511146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:16.540834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126f681-9814-4822-a80e-c35d549b006f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:16.573559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cc719-aa42-4a13-8971-354e998fdf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:16.574400 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cc719-aa42-4a13-8971-354e998fdf3c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:16.574680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cc719-aa42-4a13-8971-354e998fdf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:16.574954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cc719-aa42-4a13-8971-354e998fdf3c None admin] PATH_INFO: `/v3/projects/812380931f0a47c7bbcde0fcfaef3839` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:16.576101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cc719-aa42-4a13-8971-354e998fdf3c None admin] RBAC: Authorizing `identity:get_project(project_id=812380931f0a47c7bbcde0fcfaef3839)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:16.577546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cc719-aa42-4a13-8971-354e998fdf3c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:16.579200 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 555/1129] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:25:16 2022] GET /identity/v3/projects/812380931f0a47c7bbcde0fcfaef3839 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:16.585385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f0a48-46f7-4238-a298-3e8e1e770ca3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:16.682303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f0a48-46f7-4238-a298-3e8e1e770ca3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:16.715285 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2e9d2-a2e4-4205-8fb3-589bde22079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:16.715933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2e9d2-a2e4-4205-8fb3-589bde22079d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:16.716222 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2e9d2-a2e4-4205-8fb3-589bde22079d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:16.716537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2e9d2-a2e4-4205-8fb3-589bde22079d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:16.717371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2e9d2-a2e4-4205-8fb3-589bde22079d None admin] RBAC: Adding query filter params (role.id=e97c8dedb3a147c6ab5d98229f5a000c, scope.project.id=812380931f0a47c7bbcde0fcfaef3839, user.id=99f6aaf468f6458d9abe4776784deaad) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:16.717688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2e9d2-a2e4-4205-8fb3-589bde22079d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:16.719110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2e9d2-a2e4-4205-8fb3-589bde22079d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:16.725515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 575/1130] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:25:16 2022] GET /identity/v3/role_assignments?user.id=99f6aaf468f6458d9abe4776784deaad&scope.project.id=812380931f0a47c7bbcde0fcfaef3839&role.id=e97c8dedb3a147c6ab5d98229f5a000c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:18.742358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232af7c-18c0-4de0-b6b8-76e5f95bd107 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:18.742849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232af7c-18c0-4de0-b6b8-76e5f95bd107 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:18.742849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232af7c-18c0-4de0-b6b8-76e5f95bd107 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:18.744208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 556/1131] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:18.749431 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74319bd-8c81-4c9b-8c9c-7921f2abd720 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:18.749806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74319bd-8c81-4c9b-8c9c-7921f2abd720 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:18.749989 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74319bd-8c81-4c9b-8c9c-7921f2abd720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:18.762010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:18.767186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d74319bd-8c81-4c9b-8c9c-7921f2abd720 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:18.768371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d74319bd-8c81-4c9b-8c9c-7921f2abd720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:18.832336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 576/1132] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:18.855309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232af7c-18c0-4de0-b6b8-76e5f95bd107 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:18.955555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232af7c-18c0-4de0-b6b8-76e5f95bd107 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:18.991217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940b82d-02dd-4a53-882f-dd53ca036241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:18.991997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940b82d-02dd-4a53-882f-dd53ca036241 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:18.992284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940b82d-02dd-4a53-882f-dd53ca036241 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:18.992644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940b82d-02dd-4a53-882f-dd53ca036241 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:18.993769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940b82d-02dd-4a53-882f-dd53ca036241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:18.995189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940b82d-02dd-4a53-882f-dd53ca036241 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:18.996817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 557/1133] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:25:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:19.002932 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74319bd-8c81-4c9b-8c9c-7921f2abd720 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:19.099330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74319bd-8c81-4c9b-8c9c-7921f2abd720 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:19.132626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c03224-9f19-4afa-818e-f2d1671a3d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:19.133274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c03224-9f19-4afa-818e-f2d1671a3d11 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:19.133564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c03224-9f19-4afa-818e-f2d1671a3d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:19.133845 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c03224-9f19-4afa-818e-f2d1671a3d11 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:19.134553 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c03224-9f19-4afa-818e-f2d1671a3d11 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:19.135988 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c03224-9f19-4afa-818e-f2d1671a3d11 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:19.139950 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:19.160794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 577/1134] 10.222.0.66 () {60 vars in 1141 bytes} [Fri Jul 15 20:25:19 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:25:21.149532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff8f09-9a0b-4f44-8c20-8c0f9f4dd6ef None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:21.150077 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff8f09-9a0b-4f44-8c20-8c0f9f4dd6ef None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:21.150077 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff8f09-9a0b-4f44-8c20-8c0f9f4dd6ef None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:21.151494 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 558/1135] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:21.156721 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f520-74c2-4f4f-a817-0c325c2863f5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:21.157136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f520-74c2-4f4f-a817-0c325c2863f5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:21.157279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f520-74c2-4f4f-a817-0c325c2863f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:21.174758 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-bfa1f520-74c2-4f4f-a817-0c325c2863f5 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:21.175931 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bfa1f520-74c2-4f4f-a817-0c325c2863f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:21.240266 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 578/1136] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:21.264382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff8f09-9a0b-4f44-8c20-8c0f9f4dd6ef None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:21.278238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:21.369042 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff8f09-9a0b-4f44-8c20-8c0f9f4dd6ef None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:21.401832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d7e4f-6da1-4683-9543-9e64f7482faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:21.402609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d7e4f-6da1-4683-9543-9e64f7482faf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:21.402888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d7e4f-6da1-4683-9543-9e64f7482faf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:21.403160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d7e4f-6da1-4683-9543-9e64f7482faf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:21.404304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d7e4f-6da1-4683-9543-9e64f7482faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:21.405756 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d7e4f-6da1-4683-9543-9e64f7482faf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:21.407332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 559/1137] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:25:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:21.413309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1f520-74c2-4f4f-a817-0c325c2863f5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:21.517065 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1f520-74c2-4f4f-a817-0c325c2863f5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:21.534614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:21.551761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca6c11-9d47-49ee-ba43-5bbd6ba40336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:21.552454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca6c11-9d47-49ee-ba43-5bbd6ba40336 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:21.552743 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca6c11-9d47-49ee-ba43-5bbd6ba40336 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:21.553019 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca6c11-9d47-49ee-ba43-5bbd6ba40336 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:21.553736 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca6c11-9d47-49ee-ba43-5bbd6ba40336 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:21.555169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca6c11-9d47-49ee-ba43-5bbd6ba40336 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:21.575036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 579/1138] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:25:21 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:25:23.593644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3bbd2-d33c-4878-af9e-e9551bc8b278 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:23.594148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3bbd2-d33c-4878-af9e-e9551bc8b278 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:23.594269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3bbd2-d33c-4878-af9e-e9551bc8b278 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:23.596071 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 560/1139] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:23.601493 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea87ab-cb1e-4444-bef9-b35ed7d2c8f7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:23.601914 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea87ab-cb1e-4444-bef9-b35ed7d2c8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:23.602056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea87ab-cb1e-4444-bef9-b35ed7d2c8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:23.618908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d4ea87ab-cb1e-4444-bef9-b35ed7d2c8f7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:23.620072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d4ea87ab-cb1e-4444-bef9-b35ed7d2c8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:23.684054 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 580/1140] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:23.706306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3bbd2-d33c-4878-af9e-e9551bc8b278 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:23.779163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:23.804939 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3bbd2-d33c-4878-af9e-e9551bc8b278 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:23.837527 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716a4b0-d932-431f-98c8-93f319a0b613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:23.838302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716a4b0-d932-431f-98c8-93f319a0b613 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:23.838587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716a4b0-d932-431f-98c8-93f319a0b613 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:23.838864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716a4b0-d932-431f-98c8-93f319a0b613 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:23.848710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716a4b0-d932-431f-98c8-93f319a0b613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9716a4b0-d932-431f-98c8-93f319a0b613 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:25:23.856293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:25:23.857293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:25:23.858268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:25:23.858268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:25:23.858268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:25:23.858268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:25:23.858268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:25:23.858268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:25:23.858268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:25:23.858268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:25:23.858268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:25:23.858268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:25:23.858268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:23.858268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:25:23.858268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 561/1141] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:25:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:25:23.864135 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea87ab-cb1e-4444-bef9-b35ed7d2c8f7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:23.958945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea87ab-cb1e-4444-bef9-b35ed7d2c8f7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:23.961211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:23.993098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f4706-70dc-4a8a-b3fd-6482010bc4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:23.993755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4706-70dc-4a8a-b3fd-6482010bc4ed None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:23.994042 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4706-70dc-4a8a-b3fd-6482010bc4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:23.994319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4706-70dc-4a8a-b3fd-6482010bc4ed None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:23.995061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f4706-70dc-4a8a-b3fd-6482010bc4ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:23.995627 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f4706-70dc-4a8a-b3fd-6482010bc4ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:23.997029 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f4706-70dc-4a8a-b3fd-6482010bc4ed None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:24.005503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 581/1142] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:25:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:24.011158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716a4b0-d932-431f-98c8-93f319a0b613 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:24.108852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716a4b0-d932-431f-98c8-93f319a0b613 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:24.142137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a20fb3-66de-4501-abbf-924bb5a38a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:24.143174 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a20fb3-66de-4501-abbf-924bb5a38a2e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:24.143460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a20fb3-66de-4501-abbf-924bb5a38a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:24.143738 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a20fb3-66de-4501-abbf-924bb5a38a2e None admin] PATH_INFO: `/v3/users/e3c1e2ea57aa4b49a13f21c5bd694a7a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:24.145624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:24.156908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a20fb3-66de-4501-abbf-924bb5a38a2e None admin] RBAC: Authorizing `identity:get_user(user_id=e3c1e2ea57aa4b49a13f21c5bd694a7a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:24.158604 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a20fb3-66de-4501-abbf-924bb5a38a2e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:24.160297 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 562/1143] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:25:24 2022] GET /identity/v3/users/e3c1e2ea57aa4b49a13f21c5bd694a7a => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:24.166567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f4706-70dc-4a8a-b3fd-6482010bc4ed None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:24.265499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f4706-70dc-4a8a-b3fd-6482010bc4ed None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:24.299547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71855f86-2caa-4712-b230-9ee395f7ab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:24.300186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71855f86-2caa-4712-b230-9ee395f7ab31 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:24.300501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71855f86-2caa-4712-b230-9ee395f7ab31 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:24.300782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71855f86-2caa-4712-b230-9ee395f7ab31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:24.333137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:24.368487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71855f86-2caa-4712-b230-9ee395f7ab31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:24.369944 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71855f86-2caa-4712-b230-9ee395f7ab31 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:24.472565 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 582/1144] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:25:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:25:24.478446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a20fb3-66de-4501-abbf-924bb5a38a2e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:24.574489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a20fb3-66de-4501-abbf-924bb5a38a2e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:24.606998 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f372f9-feac-463a-9368-509fa8a2960c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:24.607844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f372f9-feac-463a-9368-509fa8a2960c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:24.608126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f372f9-feac-463a-9368-509fa8a2960c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:24.608424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f372f9-feac-463a-9368-509fa8a2960c None admin] PATH_INFO: `/v3/projects/8075c4debcd545819c56d5f6e1920e0c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:24.609590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f372f9-feac-463a-9368-509fa8a2960c None admin] RBAC: Authorizing `identity:get_project(project_id=8075c4debcd545819c56d5f6e1920e0c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:24.611013 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f372f9-feac-463a-9368-509fa8a2960c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:24.613368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 563/1145] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:25:24 2022] GET /identity/v3/projects/8075c4debcd545819c56d5f6e1920e0c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:24.619479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71855f86-2caa-4712-b230-9ee395f7ab31 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:24.683489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:24.718216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71855f86-2caa-4712-b230-9ee395f7ab31 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:24.752138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac7af3-7f6d-4e28-ba2f-eaf2f8f2e446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:24.752811 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac7af3-7f6d-4e28-ba2f-eaf2f8f2e446 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:24.753100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac7af3-7f6d-4e28-ba2f-eaf2f8f2e446 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:24.753378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac7af3-7f6d-4e28-ba2f-eaf2f8f2e446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:24.754204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac7af3-7f6d-4e28-ba2f-eaf2f8f2e446 None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=8075c4debcd545819c56d5f6e1920e0c, user.id=e3c1e2ea57aa4b49a13f21c5bd694a7a) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:24.754519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac7af3-7f6d-4e28-ba2f-eaf2f8f2e446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:24.755940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac7af3-7f6d-4e28-ba2f-eaf2f8f2e446 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:24.761538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 583/1146] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:25:24 2022] GET /identity/v3/role_assignments?user.id=e3c1e2ea57aa4b49a13f21c5bd694a7a&scope.project.id=8075c4debcd545819c56d5f6e1920e0c&role.id=43e0afe364894278be44a97662ca6f8e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:26.775541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bf583-24b1-45a2-b72a-72f875fddb1c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:26.776053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bf583-24b1-45a2-b72a-72f875fddb1c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:26.776053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bf583-24b1-45a2-b72a-72f875fddb1c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:26.777430 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 564/1147] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:26.782558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b25f9a-9183-431d-aaf6-c8b735b2f7e0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:26.783521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b25f9a-9183-431d-aaf6-c8b735b2f7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:26.783625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b25f9a-9183-431d-aaf6-c8b735b2f7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:26.801159 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a8b25f9a-9183-431d-aaf6-c8b735b2f7e0 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:26.802330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a8b25f9a-9183-431d-aaf6-c8b735b2f7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:26.865576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 584/1148] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:26.887006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bf583-24b1-45a2-b72a-72f875fddb1c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:26.953168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:26.994799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bf583-24b1-45a2-b72a-72f875fddb1c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:27.029618 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca9c43-72b9-41ec-a5eb-785e3e67c6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:27.030337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9c43-72b9-41ec-a5eb-785e3e67c6bf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:27.030622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9c43-72b9-41ec-a5eb-785e3e67c6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:27.030898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9c43-72b9-41ec-a5eb-785e3e67c6bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:27.041558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca9c43-72b9-41ec-a5eb-785e3e67c6bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e5ca9c43-72b9-41ec-a5eb-785e3e67c6bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:25:27.049208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:25:27.050288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:25:27.051316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:25:27.051316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:25:27.051316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:25:27.051316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:25:27.051316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:25:27.051316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:25:27.051316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:25:27.051316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:25:27.051316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:25:27.051316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:25:27.051316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:27.051316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:25:27.051316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 565/1149] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:25:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:25:27.056572 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b25f9a-9183-431d-aaf6-c8b735b2f7e0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:27.113534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:27.152702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b25f9a-9183-431d-aaf6-c8b735b2f7e0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:27.185499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219744e-f4be-4e5b-b102-01d0ef0dc966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:27.186156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219744e-f4be-4e5b-b102-01d0ef0dc966 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:27.186444 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219744e-f4be-4e5b-b102-01d0ef0dc966 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:27.186724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219744e-f4be-4e5b-b102-01d0ef0dc966 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:27.187460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219744e-f4be-4e5b-b102-01d0ef0dc966 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:27.187769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219744e-f4be-4e5b-b102-01d0ef0dc966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:27.189744 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219744e-f4be-4e5b-b102-01d0ef0dc966 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:27.197569 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 585/1150] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:25:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:27.203329 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca9c43-72b9-41ec-a5eb-785e3e67c6bf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:27.300557 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca9c43-72b9-41ec-a5eb-785e3e67c6bf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:27.320338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:27.335624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ce13c-ef63-4c06-89f1-bd55795cbb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:27.336553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ce13c-ef63-4c06-89f1-bd55795cbb63 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:27.336842 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ce13c-ef63-4c06-89f1-bd55795cbb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:27.337120 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ce13c-ef63-4c06-89f1-bd55795cbb63 None admin] PATH_INFO: `/v3/users/e3c1e2ea57aa4b49a13f21c5bd694a7a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:27.338301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ce13c-ef63-4c06-89f1-bd55795cbb63 None admin] RBAC: Authorizing `identity:get_user(user_id=e3c1e2ea57aa4b49a13f21c5bd694a7a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:27.339725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ce13c-ef63-4c06-89f1-bd55795cbb63 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:27.341380 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 566/1151] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:25:27 2022] GET /identity/v3/users/e3c1e2ea57aa4b49a13f21c5bd694a7a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:27.347196 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219744e-f4be-4e5b-b102-01d0ef0dc966 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:27.442742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219744e-f4be-4e5b-b102-01d0ef0dc966 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:27.465162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:27.476989 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec2af6-2605-404a-98f1-781faa15ed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:27.477874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec2af6-2605-404a-98f1-781faa15ed2d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:27.478157 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec2af6-2605-404a-98f1-781faa15ed2d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:27.478433 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec2af6-2605-404a-98f1-781faa15ed2d None admin] PATH_INFO: `/v3/projects/8075c4debcd545819c56d5f6e1920e0c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:27.479594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec2af6-2605-404a-98f1-781faa15ed2d None admin] RBAC: Authorizing `identity:get_project(project_id=8075c4debcd545819c56d5f6e1920e0c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:27.481064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec2af6-2605-404a-98f1-781faa15ed2d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:27.482757 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 586/1152] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:25:27 2022] GET /identity/v3/projects/8075c4debcd545819c56d5f6e1920e0c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:27.489250 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ce13c-ef63-4c06-89f1-bd55795cbb63 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:27.590216 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ce13c-ef63-4c06-89f1-bd55795cbb63 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:27.623679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4f391-4030-4a6f-91c7-a329d20c8f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:27.624575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4f391-4030-4a6f-91c7-a329d20c8f25 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:27.624863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4f391-4030-4a6f-91c7-a329d20c8f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:27.625143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4f391-4030-4a6f-91c7-a329d20c8f25 None admin] PATH_INFO: `/v3/projects/8075c4debcd545819c56d5f6e1920e0c/users/e3c1e2ea57aa4b49a13f21c5bd694a7a/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:27.628118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4f391-4030-4a6f-91c7-a329d20c8f25 None admin] RBAC: Authorizing `identity:create_grant(project_id=8075c4debcd545819c56d5f6e1920e0c, user_id=e3c1e2ea57aa4b49a13f21c5bd694a7a, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:27.629585 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4f391-4030-4a6f-91c7-a329d20c8f25 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:27.643699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 567/1153] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:25:27 2022] PUT /identity/v3/projects/8075c4debcd545819c56d5f6e1920e0c/users/e3c1e2ea57aa4b49a13f21c5bd694a7a/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:25:29.598288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ad842-5b12-48d0-8ec1-d7768d8f5a7d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:29.598814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ad842-5b12-48d0-8ec1-d7768d8f5a7d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:29.598921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ad842-5b12-48d0-8ec1-d7768d8f5a7d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:29.600216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 587/1154] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:29.605249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff1e06-2189-46e7-bdf8-dd4abf3bd875 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:29.605668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff1e06-2189-46e7-bdf8-dd4abf3bd875 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:29.605815 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff1e06-2189-46e7-bdf8-dd4abf3bd875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:29.622821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9aff1e06-2189-46e7-bdf8-dd4abf3bd875 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:29.624002 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9aff1e06-2189-46e7-bdf8-dd4abf3bd875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:29.667303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:29.691451 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 568/1155] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:29.715139 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ad842-5b12-48d0-8ec1-d7768d8f5a7d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:29.815249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ad842-5b12-48d0-8ec1-d7768d8f5a7d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:29.848626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0152d-7f3f-482a-8135-f26c0ce5e39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:29.849407 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0152d-7f3f-482a-8135-f26c0ce5e39f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:29.849692 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0152d-7f3f-482a-8135-f26c0ce5e39f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:29.849969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0152d-7f3f-482a-8135-f26c0ce5e39f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:29.859763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0152d-7f3f-482a-8135-f26c0ce5e39f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-09f0152d-7f3f-482a-8135-f26c0ce5e39f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:25:29.867401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:25:29.868528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:25:29.869871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:25:29.869871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:25:29.869871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:25:29.869871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:25:29.869871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:25:29.869871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:25:29.869871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:25:29.869871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:25:29.869871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:25:29.869871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:25:29.869871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:29.869871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:25:29.869871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 588/1156] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:25:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:25:29.874594 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff1e06-2189-46e7-bdf8-dd4abf3bd875 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:29.972599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff1e06-2189-46e7-bdf8-dd4abf3bd875 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:30.004597 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412909b-61d0-4d96-a74e-03a71817a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:30.005250 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412909b-61d0-4d96-a74e-03a71817a346 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:30.005541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412909b-61d0-4d96-a74e-03a71817a346 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:30.005820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412909b-61d0-4d96-a74e-03a71817a346 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:30.006554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412909b-61d0-4d96-a74e-03a71817a346 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:30.006863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412909b-61d0-4d96-a74e-03a71817a346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:30.008225 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412909b-61d0-4d96-a74e-03a71817a346 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:30.016004 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 569/1157] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:25:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:30.022309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0152d-7f3f-482a-8135-f26c0ce5e39f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:30.071612 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:30.120613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0152d-7f3f-482a-8135-f26c0ce5e39f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:30.153809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844be1b-f1a4-4b70-8a3d-b996113b13a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:30.154673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844be1b-f1a4-4b70-8a3d-b996113b13a7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:30.154957 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844be1b-f1a4-4b70-8a3d-b996113b13a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:30.155231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844be1b-f1a4-4b70-8a3d-b996113b13a7 None admin] PATH_INFO: `/v3/users/e3c1e2ea57aa4b49a13f21c5bd694a7a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:30.156431 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844be1b-f1a4-4b70-8a3d-b996113b13a7 None admin] RBAC: Authorizing `identity:get_user(user_id=e3c1e2ea57aa4b49a13f21c5bd694a7a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:30.158485 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844be1b-f1a4-4b70-8a3d-b996113b13a7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:30.160117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 589/1158] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:25:30 2022] GET /identity/v3/users/e3c1e2ea57aa4b49a13f21c5bd694a7a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:30.166121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412909b-61d0-4d96-a74e-03a71817a346 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:30.208092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:30.277674 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412909b-61d0-4d96-a74e-03a71817a346 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:30.310384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d47d5-8543-4022-ba58-1a14ee83afdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:30.311028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d47d5-8543-4022-ba58-1a14ee83afdd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:30.311315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d47d5-8543-4022-ba58-1a14ee83afdd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:30.311596 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d47d5-8543-4022-ba58-1a14ee83afdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:30.377640 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d47d5-8543-4022-ba58-1a14ee83afdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:30.378977 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d47d5-8543-4022-ba58-1a14ee83afdd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:30.418661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:30.480456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 570/1159] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:25:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:25:30.486427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844be1b-f1a4-4b70-8a3d-b996113b13a7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:30.592435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844be1b-f1a4-4b70-8a3d-b996113b13a7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:30.608576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:30.625422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e1ad6-55e2-423c-92c4-dd52c110fd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:30.626279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e1ad6-55e2-423c-92c4-dd52c110fd38 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:30.626703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e1ad6-55e2-423c-92c4-dd52c110fd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:30.627180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e1ad6-55e2-423c-92c4-dd52c110fd38 None admin] PATH_INFO: `/v3/projects/8075c4debcd545819c56d5f6e1920e0c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:30.628349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e1ad6-55e2-423c-92c4-dd52c110fd38 None admin] RBAC: Authorizing `identity:get_project(project_id=8075c4debcd545819c56d5f6e1920e0c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:30.629800 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e1ad6-55e2-423c-92c4-dd52c110fd38 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:30.631483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 590/1160] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:25:30 2022] GET /identity/v3/projects/8075c4debcd545819c56d5f6e1920e0c => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:30.637609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d47d5-8543-4022-ba58-1a14ee83afdd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:30.736584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d47d5-8543-4022-ba58-1a14ee83afdd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:30.770964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168044d-e062-4a76-ad5c-1acdfc529b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:30.771614 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168044d-e062-4a76-ad5c-1acdfc529b21 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:30.771903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168044d-e062-4a76-ad5c-1acdfc529b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:30.772184 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168044d-e062-4a76-ad5c-1acdfc529b21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:30.773041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168044d-e062-4a76-ad5c-1acdfc529b21 None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=8075c4debcd545819c56d5f6e1920e0c, user.id=e3c1e2ea57aa4b49a13f21c5bd694a7a) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:30.773357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168044d-e062-4a76-ad5c-1acdfc529b21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:30.774788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168044d-e062-4a76-ad5c-1acdfc529b21 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:30.780487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 571/1161] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:25:30 2022] GET /identity/v3/role_assignments?user.id=e3c1e2ea57aa4b49a13f21c5bd694a7a&scope.project.id=8075c4debcd545819c56d5f6e1920e0c&role.id=43e0afe364894278be44a97662ca6f8e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:32.811395 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020b2f9-0a3c-4ce0-93ea-1b57068cb9e9 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:32.811899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020b2f9-0a3c-4ce0-93ea-1b57068cb9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:32.811899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020b2f9-0a3c-4ce0-93ea-1b57068cb9e9 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:32.813273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 591/1162] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:32.818555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f29db0-d699-4bbe-bee9-618ab0649c57 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:32.818994 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f29db0-d699-4bbe-bee9-618ab0649c57 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:32.819123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f29db0-d699-4bbe-bee9-618ab0649c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:32.825038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:32.836093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-96f29db0-d699-4bbe-bee9-618ab0649c57 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:32.837322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-96f29db0-d699-4bbe-bee9-618ab0649c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:32.903139 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 572/1163] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:32.926865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020b2f9-0a3c-4ce0-93ea-1b57068cb9e9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:33.024521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020b2f9-0a3c-4ce0-93ea-1b57068cb9e9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:33.057259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758bc84-6bd0-4768-8e17-ed68ed285880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:33.057884 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758bc84-6bd0-4768-8e17-ed68ed285880 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:33.058167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758bc84-6bd0-4768-8e17-ed68ed285880 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:33.058444 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758bc84-6bd0-4768-8e17-ed68ed285880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:33.110750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:33.123921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758bc84-6bd0-4768-8e17-ed68ed285880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:33.125385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758bc84-6bd0-4768-8e17-ed68ed285880 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:33.221054 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 592/1164] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:25:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:25:33.227095 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f29db0-d699-4bbe-bee9-618ab0649c57 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:33.325305 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f29db0-d699-4bbe-bee9-618ab0649c57 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:33.357781 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795b2bc-9dc1-4282-8dfa-2f1524a590ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:33.358575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795b2bc-9dc1-4282-8dfa-2f1524a590ad None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:33.358863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795b2bc-9dc1-4282-8dfa-2f1524a590ad None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:33.359142 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795b2bc-9dc1-4282-8dfa-2f1524a590ad None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:33.361757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:33.367104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795b2bc-9dc1-4282-8dfa-2f1524a590ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:33.368698 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795b2bc-9dc1-4282-8dfa-2f1524a590ad None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0795b2bc-9dc1-4282-8dfa-2f1524a590ad None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:25:33.383564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:25:33.384820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:25:33.385745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 573/1165] 10.222.0.66 () {56 vars in 1117 bytes} [Fri Jul 15 20:25:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:25:33.390788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758bc84-6bd0-4768-8e17-ed68ed285880 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:33.472648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:33.487912 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758bc84-6bd0-4768-8e17-ed68ed285880 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:33.520830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6168e33-5f25-4bcd-826b-0ff7b6cc0c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:33.521483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6168e33-5f25-4bcd-826b-0ff7b6cc0c47 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:33.521768 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6168e33-5f25-4bcd-826b-0ff7b6cc0c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:33.522044 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6168e33-5f25-4bcd-826b-0ff7b6cc0c47 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:33.522752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6168e33-5f25-4bcd-826b-0ff7b6cc0c47 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:33.523059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6168e33-5f25-4bcd-826b-0ff7b6cc0c47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:33.524433 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6168e33-5f25-4bcd-826b-0ff7b6cc0c47 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:33.531377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 593/1166] 10.222.0.66 () {56 vars in 1115 bytes} [Fri Jul 15 20:25:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:35.507696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af2261-573e-412f-a60e-bf7cc0fd9e18 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:35.508201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af2261-573e-412f-a60e-bf7cc0fd9e18 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:35.508304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af2261-573e-412f-a60e-bf7cc0fd9e18 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:35.509644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 574/1167] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:35.514942 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeab4aa-c7b0-4e6b-bc2b-1ddf60d910e5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:35.515328 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeab4aa-c7b0-4e6b-bc2b-1ddf60d910e5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:35.515505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeab4aa-c7b0-4e6b-bc2b-1ddf60d910e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:35.531694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2eeab4aa-c7b0-4e6b-bc2b-1ddf60d910e5 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:35.532901 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2eeab4aa-c7b0-4e6b-bc2b-1ddf60d910e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:35.598122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 594/1168] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:35.620448 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af2261-573e-412f-a60e-bf7cc0fd9e18 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:35.718829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af2261-573e-412f-a60e-bf7cc0fd9e18 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:35.751002 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428f509-1f98-4c56-86d3-e0ee671329b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:35.752332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428f509-1f98-4c56-86d3-e0ee671329b2 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:35.752648 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428f509-1f98-4c56-86d3-e0ee671329b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:35.752927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428f509-1f98-4c56-86d3-e0ee671329b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:35.753676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428f509-1f98-4c56-86d3-e0ee671329b2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:35.755039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428f509-1f98-4c56-86d3-e0ee671329b2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:35.769243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 575/1169] 10.222.0.66 () {60 vars in 1138 bytes} [Fri Jul 15 20:25:35 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:25:37.830604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3fa5f-fe2b-4f90-850c-2508c06627e9 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:37.831099 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3fa5f-fe2b-4f90-850c-2508c06627e9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:37.831099 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3fa5f-fe2b-4f90-850c-2508c06627e9 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:37.832666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 595/1170] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:37.837691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6ac63-ab40-4eab-894c-b2ad39432ebb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:37.838081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6ac63-ab40-4eab-894c-b2ad39432ebb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:37.838252 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6ac63-ab40-4eab-894c-b2ad39432ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:37.854964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0eb6ac63-ab40-4eab-894c-b2ad39432ebb None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:37.856130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0eb6ac63-ab40-4eab-894c-b2ad39432ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:37.903607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:37.921213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 576/1171] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 20:25:37.943899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3fa5f-fe2b-4f90-850c-2508c06627e9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:38.023787 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:38.044315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3fa5f-fe2b-4f90-850c-2508c06627e9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:38.076904 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02799188-9d3b-4734-9a49-141e7605d45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:38.077961 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02799188-9d3b-4734-9a49-141e7605d45c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:38.078410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02799188-9d3b-4734-9a49-141e7605d45c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:38.078697 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02799188-9d3b-4734-9a49-141e7605d45c None admin] PATH_INFO: `/v3/domains/d58982a73e69432c80ba523b95fe0583` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:38.090450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02799188-9d3b-4734-9a49-141e7605d45c None admin] RBAC: Authorizing `identity:get_domain(domain_id=d58982a73e69432c80ba523b95fe0583)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:38.092094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02799188-9d3b-4734-9a49-141e7605d45c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:38.093802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 596/1172] 10.222.0.66 () {56 vars in 1183 bytes} [Fri Jul 15 20:25:37 2022] GET /identity/v3/domains/d58982a73e69432c80ba523b95fe0583 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:38.101077 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6ac63-ab40-4eab-894c-b2ad39432ebb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:38.195256 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6ac63-ab40-4eab-894c-b2ad39432ebb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:38.227512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dd9a8-a563-4c78-a10f-4b83945faf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:38.228146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd9a8-a563-4c78-a10f-4b83945faf62 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:38.228489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd9a8-a563-4c78-a10f-4b83945faf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:38.228765 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd9a8-a563-4c78-a10f-4b83945faf62 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:38.229452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dd9a8-a563-4c78-a10f-4b83945faf62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:38.230869 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dd9a8-a563-4c78-a10f-4b83945faf62 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:38.255991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 577/1173] 10.222.0.66 () {60 vars in 1141 bytes} [Fri Jul 15 20:25:38 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:25:40.290010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6ebd3-b320-4762-9762-960dbe5630d8 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:40.290531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6ebd3-b320-4762-9762-960dbe5630d8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:40.290647 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6ebd3-b320-4762-9762-960dbe5630d8 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:40.291954 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 597/1174] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:40.297359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92cffd-784a-445e-b70f-f5e23b071f55 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:40.297749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92cffd-784a-445e-b70f-f5e23b071f55 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:40.298409 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92cffd-784a-445e-b70f-f5e23b071f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:40.316520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2e92cffd-784a-445e-b70f-f5e23b071f55 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:40.317720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2e92cffd-784a-445e-b70f-f5e23b071f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:40.346853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:40.385065 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 578/1175] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:40.410886 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6ebd3-b320-4762-9762-960dbe5630d8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:40.510519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6ebd3-b320-4762-9762-960dbe5630d8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:40.543471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2529a-71fd-489b-bd1c-cce8d9459643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:40.544260 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2529a-71fd-489b-bd1c-cce8d9459643 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:40.544570 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2529a-71fd-489b-bd1c-cce8d9459643 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:40.544847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2529a-71fd-489b-bd1c-cce8d9459643 None admin] PATH_INFO: `/v3/domains/d58982a73e69432c80ba523b95fe0583` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:40.546004 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2529a-71fd-489b-bd1c-cce8d9459643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d58982a73e69432c80ba523b95fe0583)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:40.547417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2529a-71fd-489b-bd1c-cce8d9459643 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:40.549677 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 598/1176] 10.222.0.66 () {56 vars in 1183 bytes} [Fri Jul 15 20:25:40 2022] GET /identity/v3/domains/d58982a73e69432c80ba523b95fe0583 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:40.555500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92cffd-784a-445e-b70f-f5e23b071f55 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:40.652992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92cffd-784a-445e-b70f-f5e23b071f55 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:40.686731 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9bf78-93d5-48a6-81b0-3c85a134fe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:40.687390 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9bf78-93d5-48a6-81b0-3c85a134fe4b None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:40.687671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9bf78-93d5-48a6-81b0-3c85a134fe4b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:40.687944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9bf78-93d5-48a6-81b0-3c85a134fe4b None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:40.688758 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9bf78-93d5-48a6-81b0-3c85a134fe4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:40.690286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9bf78-93d5-48a6-81b0-3c85a134fe4b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:40.709171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 579/1177] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:25:40 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:25:42.795611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9e981-b79f-4831-9266-90bc05f366a0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:42.796160 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9e981-b79f-4831-9266-90bc05f366a0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:42.796160 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9e981-b79f-4831-9266-90bc05f366a0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:42.797542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 599/1178] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:42.802668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d4db2-44b2-4de2-95d0-cde52db40d6e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:42.803055 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d4db2-44b2-4de2-95d0-cde52db40d6e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:42.803240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d4db2-44b2-4de2-95d0-cde52db40d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:42.820097 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-df9d4db2-44b2-4de2-95d0-cde52db40d6e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:42.821320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-df9d4db2-44b2-4de2-95d0-cde52db40d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:42.837821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:42.887773 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 580/1179] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:42.911748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9e981-b79f-4831-9266-90bc05f366a0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:42.922653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:43.011178 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9e981-b79f-4831-9266-90bc05f366a0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:43.043155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cda58d-1f3d-4129-b590-cad43008cbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:43.043936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda58d-1f3d-4129-b590-cad43008cbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:43.044217 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda58d-1f3d-4129-b590-cad43008cbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:43.044521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda58d-1f3d-4129-b590-cad43008cbc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:43.054851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cda58d-1f3d-4129-b590-cad43008cbc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-71cda58d-1f3d-4129-b590-cad43008cbc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:25:43.062400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:25:43.064351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:25:43.065605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:25:43.065605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:25:43.065605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:25:43.065605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:25:43.065605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:25:43.065605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:25:43.065605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:25:43.065605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:25:43.065605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:25:43.065605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:25:43.065605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:43.065605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:25:43.065605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 600/1180] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:25:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:25:43.070134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d4db2-44b2-4de2-95d0-cde52db40d6e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:43.170388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d4db2-44b2-4de2-95d0-cde52db40d6e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:43.207395 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128bb91-03b7-428a-8331-bafa755d086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:43.208073 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128bb91-03b7-428a-8331-bafa755d086c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:43.208364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128bb91-03b7-428a-8331-bafa755d086c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:43.208676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128bb91-03b7-428a-8331-bafa755d086c None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:43.209426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128bb91-03b7-428a-8331-bafa755d086c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:43.209738 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128bb91-03b7-428a-8331-bafa755d086c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:43.211114 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128bb91-03b7-428a-8331-bafa755d086c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:43.219313 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 581/1181] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:25:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:43.225133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cda58d-1f3d-4129-b590-cad43008cbc7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:43.296876 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:43.332850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cda58d-1f3d-4129-b590-cad43008cbc7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:43.367638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745fc1a-a380-487a-a04e-061cc0a88f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:43.368545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745fc1a-a380-487a-a04e-061cc0a88f99 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:43.368831 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745fc1a-a380-487a-a04e-061cc0a88f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:43.369108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745fc1a-a380-487a-a04e-061cc0a88f99 None admin] PATH_INFO: `/v3/users/f8362cb95b154260a54773196244371e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:43.382252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745fc1a-a380-487a-a04e-061cc0a88f99 None admin] RBAC: Authorizing `identity:get_user(user_id=f8362cb95b154260a54773196244371e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:43.383700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745fc1a-a380-487a-a04e-061cc0a88f99 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:43.385389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 601/1182] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:25:43 2022] GET /identity/v3/users/f8362cb95b154260a54773196244371e => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:43.391239 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128bb91-03b7-428a-8331-bafa755d086c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:43.407750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:43.493229 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128bb91-03b7-428a-8331-bafa755d086c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:43.525536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a30f7-d356-4087-b542-af340f177874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:43.526172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a30f7-d356-4087-b542-af340f177874 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:43.526455 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a30f7-d356-4087-b542-af340f177874 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:43.526729 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a30f7-d356-4087-b542-af340f177874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:43.591143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a30f7-d356-4087-b542-af340f177874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:43.592545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a30f7-d356-4087-b542-af340f177874 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:43.606872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:43.688719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 582/1183] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:25:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:25:43.694517 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745fc1a-a380-487a-a04e-061cc0a88f99 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:43.791727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745fc1a-a380-487a-a04e-061cc0a88f99 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:43.816548 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:43.825265 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60a102-6e13-4a48-bc68-47f20aa66eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:43.826117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a102-6e13-4a48-bc68-47f20aa66eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:43.826401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a102-6e13-4a48-bc68-47f20aa66eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:43.826676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a102-6e13-4a48-bc68-47f20aa66eb4 None admin] PATH_INFO: `/v3/projects/36df49b3d425400bacc5310ebc6aa592` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:43.827834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60a102-6e13-4a48-bc68-47f20aa66eb4 None admin] RBAC: Authorizing `identity:get_project(project_id=36df49b3d425400bacc5310ebc6aa592)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:43.829984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60a102-6e13-4a48-bc68-47f20aa66eb4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:43.831665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 602/1184] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:25:43 2022] GET /identity/v3/projects/36df49b3d425400bacc5310ebc6aa592 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:43.837916 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a30f7-d356-4087-b542-af340f177874 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:43.933113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a30f7-d356-4087-b542-af340f177874 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:43.946562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:43.966659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26884bd-5e76-4127-9b8d-6075a68da215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:43.967295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26884bd-5e76-4127-9b8d-6075a68da215 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:43.967576 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26884bd-5e76-4127-9b8d-6075a68da215 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:43.967852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26884bd-5e76-4127-9b8d-6075a68da215 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:43.968692 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26884bd-5e76-4127-9b8d-6075a68da215 None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=36df49b3d425400bacc5310ebc6aa592, user.id=f8362cb95b154260a54773196244371e) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:43.969000 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26884bd-5e76-4127-9b8d-6075a68da215 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:43.970462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26884bd-5e76-4127-9b8d-6075a68da215 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:43.975954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 583/1185] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:25:43 2022] GET /identity/v3/role_assignments?user.id=f8362cb95b154260a54773196244371e&scope.project.id=36df49b3d425400bacc5310ebc6aa592&role.id=43e0afe364894278be44a97662ca6f8e => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:46.052958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f0f29-19de-4013-9e7b-8eb0bae7a3e3 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:46.053506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f0f29-19de-4013-9e7b-8eb0bae7a3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:46.053506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f0f29-19de-4013-9e7b-8eb0bae7a3e3 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:46.054878 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 603/1186] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:46.060033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b27b85-d946-41d7-bbcd-1acfe12f8989 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:46.060429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b27b85-d946-41d7-bbcd-1acfe12f8989 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:46.060606 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b27b85-d946-41d7-bbcd-1acfe12f8989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:46.077502 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c6b27b85-d946-41d7-bbcd-1acfe12f8989 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:46.078666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c6b27b85-d946-41d7-bbcd-1acfe12f8989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:46.142461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 584/1187] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:46.165189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f0f29-19de-4013-9e7b-8eb0bae7a3e3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:46.267730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f0f29-19de-4013-9e7b-8eb0bae7a3e3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:46.301547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c8b16-4ec0-4455-8854-406ec79a209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:46.302325 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c8b16-4ec0-4455-8854-406ec79a209b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:46.302610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c8b16-4ec0-4455-8854-406ec79a209b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:46.302884 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c8b16-4ec0-4455-8854-406ec79a209b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:46.312742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c8b16-4ec0-4455-8854-406ec79a209b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-f85c8b16-4ec0-4455-8854-406ec79a209b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:25:46.320895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:25:46.321984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:25:46.323031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:25:46.323031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:25:46.323031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:25:46.323031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:25:46.323031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:25:46.323031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:25:46.323031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:25:46.323031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:25:46.323031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:25:46.323031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:25:46.323031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:46.323031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:25:46.323031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 604/1188] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:25:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:25:46.328191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b27b85-d946-41d7-bbcd-1acfe12f8989 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:46.427109 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b27b85-d946-41d7-bbcd-1acfe12f8989 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:46.435867 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:46.460694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118592-243a-484e-aafc-e445c93932a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:46.461361 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118592-243a-484e-aafc-e445c93932a3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:46.461647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118592-243a-484e-aafc-e445c93932a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:46.461921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118592-243a-484e-aafc-e445c93932a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:46.462656 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97118592-243a-484e-aafc-e445c93932a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:46.462965 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97118592-243a-484e-aafc-e445c93932a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:46.464335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97118592-243a-484e-aafc-e445c93932a3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:46.472933 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 585/1189] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:25:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:46.478722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c8b16-4ec0-4455-8854-406ec79a209b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:46.534513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:46.579638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c8b16-4ec0-4455-8854-406ec79a209b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:46.612810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41074a6a-1a42-415d-85b0-5f01ad2ed8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:46.613662 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41074a6a-1a42-415d-85b0-5f01ad2ed8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:46.613946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41074a6a-1a42-415d-85b0-5f01ad2ed8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:46.614220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41074a6a-1a42-415d-85b0-5f01ad2ed8d4 None admin] PATH_INFO: `/v3/users/f8362cb95b154260a54773196244371e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:46.615390 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41074a6a-1a42-415d-85b0-5f01ad2ed8d4 None admin] RBAC: Authorizing `identity:get_user(user_id=f8362cb95b154260a54773196244371e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:46.616838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41074a6a-1a42-415d-85b0-5f01ad2ed8d4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:46.618439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 605/1190] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:25:46 2022] GET /identity/v3/users/f8362cb95b154260a54773196244371e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:46.624313 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118592-243a-484e-aafc-e445c93932a3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:46.727787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118592-243a-484e-aafc-e445c93932a3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:46.760786 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94e6e1-01cf-49b2-9ddb-3ce2a0e71227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:46.761631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94e6e1-01cf-49b2-9ddb-3ce2a0e71227 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:46.761916 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94e6e1-01cf-49b2-9ddb-3ce2a0e71227 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:46.762197 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94e6e1-01cf-49b2-9ddb-3ce2a0e71227 None admin] PATH_INFO: `/v3/projects/36df49b3d425400bacc5310ebc6aa592` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:46.763364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94e6e1-01cf-49b2-9ddb-3ce2a0e71227 None admin] RBAC: Authorizing `identity:get_project(project_id=36df49b3d425400bacc5310ebc6aa592)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:46.764830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94e6e1-01cf-49b2-9ddb-3ce2a0e71227 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:46.767335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 586/1191] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:25:46 2022] GET /identity/v3/projects/36df49b3d425400bacc5310ebc6aa592 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:46.773185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41074a6a-1a42-415d-85b0-5f01ad2ed8d4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:46.871323 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41074a6a-1a42-415d-85b0-5f01ad2ed8d4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:46.893537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:46.904955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf58cb-7b66-4f05-9527-a34e7fb0d35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:46.905838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf58cb-7b66-4f05-9527-a34e7fb0d35c None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:46.906125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf58cb-7b66-4f05-9527-a34e7fb0d35c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:46.906405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf58cb-7b66-4f05-9527-a34e7fb0d35c None admin] PATH_INFO: `/v3/projects/36df49b3d425400bacc5310ebc6aa592/users/f8362cb95b154260a54773196244371e/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:46.909234 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf58cb-7b66-4f05-9527-a34e7fb0d35c None admin] RBAC: Authorizing `identity:create_grant(project_id=36df49b3d425400bacc5310ebc6aa592, user_id=f8362cb95b154260a54773196244371e, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:46.910660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf58cb-7b66-4f05-9527-a34e7fb0d35c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:46.922931 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 606/1192] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:25:46 2022] PUT /identity/v3/projects/36df49b3d425400bacc5310ebc6aa592/users/f8362cb95b154260a54773196244371e/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:25:48.876949 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f954-dc24-4bef-9e57-53334d01796f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:48.877474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f954-dc24-4bef-9e57-53334d01796f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:48.877474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f954-dc24-4bef-9e57-53334d01796f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:48.878796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 587/1193] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:25:48.883969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197792f4-eacb-4d33-80ca-734c86a2eb93 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:48.884339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197792f4-eacb-4d33-80ca-734c86a2eb93 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:48.884568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197792f4-eacb-4d33-80ca-734c86a2eb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:48.901343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-197792f4-eacb-4d33-80ca-734c86a2eb93 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:25:48.902512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-197792f4-eacb-4d33-80ca-734c86a2eb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:25:48.966237 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 607/1194] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:25:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:25:48.989310 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603f954-dc24-4bef-9e57-53334d01796f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:49.030513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:49.090119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603f954-dc24-4bef-9e57-53334d01796f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:49.123162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9eaac-15e7-463d-80e4-c3eec6ac5f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:49.123938 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9eaac-15e7-463d-80e4-c3eec6ac5f0d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:49.124226 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9eaac-15e7-463d-80e4-c3eec6ac5f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:49.124536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9eaac-15e7-463d-80e4-c3eec6ac5f0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:49.135187 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9eaac-15e7-463d-80e4-c3eec6ac5f0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7aa9eaac-15e7-463d-80e4-c3eec6ac5f0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:25:49.142899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:25:49.144047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:25:49.145148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:25:49.145148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:25:49.145148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:25:49.145148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:25:49.145148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:25:49.145148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:25:49.145148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:25:49.145148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:25:49.145148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:25:49.145148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:25:49.145148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:25:49.145148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:25:49.145148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 588/1195] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:25:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:25:49.150104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197792f4-eacb-4d33-80ca-734c86a2eb93 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:49.245913 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197792f4-eacb-4d33-80ca-734c86a2eb93 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:49.259375 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:49.280447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b77d1-1b57-48eb-b02f-c03732329a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:49.281108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b77d1-1b57-48eb-b02f-c03732329a16 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:49.281392 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b77d1-1b57-48eb-b02f-c03732329a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:49.281668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b77d1-1b57-48eb-b02f-c03732329a16 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:49.282438 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b77d1-1b57-48eb-b02f-c03732329a16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:49.282743 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b77d1-1b57-48eb-b02f-c03732329a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:49.284113 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b77d1-1b57-48eb-b02f-c03732329a16 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:49.292244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 608/1196] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:49.298780 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9eaac-15e7-463d-80e4-c3eec6ac5f0d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:49.394856 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:49.398748 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9eaac-15e7-463d-80e4-c3eec6ac5f0d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:49.432558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29920ab-c55e-4bf1-9b7c-953ea14c11ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:49.433419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29920ab-c55e-4bf1-9b7c-953ea14c11ac None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:49.433705 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29920ab-c55e-4bf1-9b7c-953ea14c11ac None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:49.433983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29920ab-c55e-4bf1-9b7c-953ea14c11ac None admin] PATH_INFO: `/v3/users/f8362cb95b154260a54773196244371e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:49.435156 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29920ab-c55e-4bf1-9b7c-953ea14c11ac None admin] RBAC: Authorizing `identity:get_user(user_id=f8362cb95b154260a54773196244371e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:49.436616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29920ab-c55e-4bf1-9b7c-953ea14c11ac None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:49.439341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 589/1197] 10.222.0.66 () {56 vars in 1177 bytes} [Fri Jul 15 20:25:49 2022] GET /identity/v3/users/f8362cb95b154260a54773196244371e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:49.444738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b77d1-1b57-48eb-b02f-c03732329a16 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:49.547173 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b77d1-1b57-48eb-b02f-c03732329a16 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:49.580011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f73e0-f21f-4c01-8410-b49260847026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:49.580670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f73e0-f21f-4c01-8410-b49260847026 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:49.580956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f73e0-f21f-4c01-8410-b49260847026 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:49.581231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f73e0-f21f-4c01-8410-b49260847026 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:49.620811 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:49.645167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f73e0-f21f-4c01-8410-b49260847026 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:49.646536 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f73e0-f21f-4c01-8410-b49260847026 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:49.740220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 609/1198] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:25:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:25:49.746263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29920ab-c55e-4bf1-9b7c-953ea14c11ac None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:49.843185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29920ab-c55e-4bf1-9b7c-953ea14c11ac None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:49.875196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b5fa9-b193-4514-a0db-13b1b14939cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:49.876289 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b5fa9-b193-4514-a0db-13b1b14939cb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:49.876592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b5fa9-b193-4514-a0db-13b1b14939cb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:49.876870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b5fa9-b193-4514-a0db-13b1b14939cb None admin] PATH_INFO: `/v3/projects/36df49b3d425400bacc5310ebc6aa592` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:49.878022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b5fa9-b193-4514-a0db-13b1b14939cb None admin] RBAC: Authorizing `identity:get_project(project_id=36df49b3d425400bacc5310ebc6aa592)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:49.880097 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b5fa9-b193-4514-a0db-13b1b14939cb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:49.881891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 590/1199] 10.222.0.66 () {56 vars in 1186 bytes} [Fri Jul 15 20:25:49 2022] GET /identity/v3/projects/36df49b3d425400bacc5310ebc6aa592 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:49.887976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f73e0-f21f-4c01-8410-b49260847026 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:25:49.960175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:25:49.984953 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f73e0-f21f-4c01-8410-b49260847026 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:25:50.017063 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fe21c-6959-41d9-add8-b850b1238ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:25:50.017700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe21c-6959-41d9-add8-b850b1238ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:25:50.017983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe21c-6959-41d9-add8-b850b1238ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:25:50.018258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe21c-6959-41d9-add8-b850b1238ab9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:25:50.019075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fe21c-6959-41d9-add8-b850b1238ab9 None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=36df49b3d425400bacc5310ebc6aa592, user.id=f8362cb95b154260a54773196244371e) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:25:50.019383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fe21c-6959-41d9-add8-b850b1238ab9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:25:50.020819 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fe21c-6959-41d9-add8-b850b1238ab9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:25:50.026417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 610/1200] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:25:49 2022] GET /identity/v3/role_assignments?user.id=f8362cb95b154260a54773196244371e&scope.project.id=36df49b3d425400bacc5310ebc6aa592&role.id=43e0afe364894278be44a97662ca6f8e => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:25:59.871342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=83 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:00.023916 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=31 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:45.284757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be7b4-3eaa-4c1e-a191-c006133b1549 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:45.285335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be7b4-3eaa-4c1e-a191-c006133b1549 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:45.285335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be7b4-3eaa-4c1e-a191-c006133b1549 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:45.286689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 591/1201] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:26:45.293729 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54692ca5-df76-43f9-9efb-f0f2deda3b34 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:45.294200 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54692ca5-df76-43f9-9efb-f0f2deda3b34 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:45.294389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54692ca5-df76-43f9-9efb-f0f2deda3b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:45.313490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-54692ca5-df76-43f9-9efb-f0f2deda3b34 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:26:45.314696 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-54692ca5-df76-43f9-9efb-f0f2deda3b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:26:45.405867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 611/1202] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:26:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:26:45.435247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503be7b4-3eaa-4c1e-a191-c006133b1549 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:45.581112 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503be7b4-3eaa-4c1e-a191-c006133b1549 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:45.632145 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718434a-cf35-445a-a8e2-d0c15621a624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:45.633068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718434a-cf35-445a-a8e2-d0c15621a624 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:45.633346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718434a-cf35-445a-a8e2-d0c15621a624 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:45.633621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718434a-cf35-445a-a8e2-d0c15621a624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:45.646886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718434a-cf35-445a-a8e2-d0c15621a624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:45.649005 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718434a-cf35-445a-a8e2-d0c15621a624 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3718434a-cf35-445a-a8e2-d0c15621a624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:26:45.672479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:45.673546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:45.675304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:26:45.675304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:26:45.675304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:26:45.675304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:26:45.675304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 592/1203] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:26:45.680343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54692ca5-df76-43f9-9efb-f0f2deda3b34 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:45.817095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54692ca5-df76-43f9-9efb-f0f2deda3b34 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:45.856776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:45.868514 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5f43c-7495-4195-b608-17bea235a89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:45.869269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5f43c-7495-4195-b608-17bea235a89f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:45.869548 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5f43c-7495-4195-b608-17bea235a89f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:45.869830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5f43c-7495-4195-b608-17bea235a89f None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:45.870587 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5f43c-7495-4195-b608-17bea235a89f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:45.870976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5f43c-7495-4195-b608-17bea235a89f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:45.872612 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5f43c-7495-4195-b608-17bea235a89f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:45.894571 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 612/1204] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:26:45.896450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718434a-cf35-445a-a8e2-d0c15621a624 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:45.988547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:46.055037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718434a-cf35-445a-a8e2-d0c15621a624 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:46.103151 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bff05-b01c-4c05-990a-93d6865db80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:46.104019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bff05-b01c-4c05-990a-93d6865db80f None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:46.104349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bff05-b01c-4c05-990a-93d6865db80f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:46.104682 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bff05-b01c-4c05-990a-93d6865db80f None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:46.105427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bff05-b01c-4c05-990a-93d6865db80f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:46.107058 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bff05-b01c-4c05-990a-93d6865db80f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:46.134592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 593/1205] 10.222.0.66 () {60 vars in 1132 bytes} [Fri Jul 15 20:26:45 2022] POST /identity/v3/users => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:26:48.377069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f5de6-0e6d-49df-b6dd-5cdc4c11c525 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:48.377633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f5de6-0e6d-49df-b6dd-5cdc4c11c525 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:48.377633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f5de6-0e6d-49df-b6dd-5cdc4c11c525 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:48.379040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 613/1206] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:26:48.384224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd75d3-f1fa-4260-abb7-661b9ad64855 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:48.384678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd75d3-f1fa-4260-abb7-661b9ad64855 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:48.384886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd75d3-f1fa-4260-abb7-661b9ad64855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:48.403048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c6fd75d3-f1fa-4260-abb7-661b9ad64855 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:26:48.404244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c6fd75d3-f1fa-4260-abb7-661b9ad64855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:26:48.488226 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 594/1207] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:26:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:26:48.512438 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f5de6-0e6d-49df-b6dd-5cdc4c11c525 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:48.643978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f5de6-0e6d-49df-b6dd-5cdc4c11c525 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:48.694692 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83f6c2-1207-4574-b63d-d553f5d437c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:48.695493 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83f6c2-1207-4574-b63d-d553f5d437c1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:48.695779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83f6c2-1207-4574-b63d-d553f5d437c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:48.696046 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83f6c2-1207-4574-b63d-d553f5d437c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:48.707523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83f6c2-1207-4574-b63d-d553f5d437c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ff83f6c2-1207-4574-b63d-d553f5d437c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:26:48.715709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:48.717402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:48.718263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:48.718263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:48.718263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:48.718263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:48.718263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:26:48.718263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:26:48.718263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:26:48.718263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:26:48.718263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:26:48.718263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:26:48.718263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:26:48.718263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:26:48.718263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 614/1208] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:26:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:26:48.726277 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd75d3-f1fa-4260-abb7-661b9ad64855 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:48.771730 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:48.843060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd75d3-f1fa-4260-abb7-661b9ad64855 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:48.885026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29b8f0-2fc5-4b95-b03e-0ed555016f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:48.885935 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29b8f0-2fc5-4b95-b03e-0ed555016f63 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:48.886230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29b8f0-2fc5-4b95-b03e-0ed555016f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:48.886544 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29b8f0-2fc5-4b95-b03e-0ed555016f63 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:48.887278 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29b8f0-2fc5-4b95-b03e-0ed555016f63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:48.887587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29b8f0-2fc5-4b95-b03e-0ed555016f63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:48.889578 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29b8f0-2fc5-4b95-b03e-0ed555016f63 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:48.899925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 595/1209] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:26:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:26:48.905577 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83f6c2-1207-4574-b63d-d553f5d437c1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:48.963081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:49.025513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83f6c2-1207-4574-b63d-d553f5d437c1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:49.066403 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd533b-3575-42f7-871a-e6d184d3b888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:49.067576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd533b-3575-42f7-871a-e6d184d3b888 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:49.068063 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd533b-3575-42f7-871a-e6d184d3b888 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:49.068572 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd533b-3575-42f7-871a-e6d184d3b888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:49.082112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd533b-3575-42f7-871a-e6d184d3b888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:49.083625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd533b-3575-42f7-871a-e6d184d3b888 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-fdfd533b-3575-42f7-871a-e6d184d3b888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:26:49.102769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:49.103804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:49.104774 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:26:49.104774 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:26:49.104774 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:26:49.104774 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:26:49.108768 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 615/1210] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:26:49.111039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29b8f0-2fc5-4b95-b03e-0ed555016f63 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:49.236826 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:49.239903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29b8f0-2fc5-4b95-b03e-0ed555016f63 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:49.283373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c9a42-3f8b-4682-ad9d-18c118186f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:49.284334 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c9a42-3f8b-4682-ad9d-18c118186f20 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:49.284697 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c9a42-3f8b-4682-ad9d-18c118186f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:49.285019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c9a42-3f8b-4682-ad9d-18c118186f20 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:49.285843 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c9a42-3f8b-4682-ad9d-18c118186f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:49.286253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c9a42-3f8b-4682-ad9d-18c118186f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:49.287977 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c9a42-3f8b-4682-ad9d-18c118186f20 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:49.304884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 596/1211] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:26:49.310726 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd533b-3575-42f7-871a-e6d184d3b888 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:49.438003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd533b-3575-42f7-871a-e6d184d3b888 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:49.442449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:49.475396 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62682113-5e9e-4538-b309-4f4f3fe4bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:49.476205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62682113-5e9e-4538-b309-4f4f3fe4bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:49.476524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62682113-5e9e-4538-b309-4f4f3fe4bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:49.476805 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62682113-5e9e-4538-b309-4f4f3fe4bdc7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:49.485484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62682113-5e9e-4538-b309-4f4f3fe4bdc7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:49.487089 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62682113-5e9e-4538-b309-4f4f3fe4bdc7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-62682113-5e9e-4538-b309-4f4f3fe4bdc7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:26:49.504722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:49.505986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:49.507104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:49.507104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:49.507104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:26:49.507104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:26:49.507104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:26:49.507104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:26:49.507104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:26:49.507104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:26:49.507104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:26:49.507104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:26:49.507104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 616/1212] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:26:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:26:49.512219 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c9a42-3f8b-4682-ad9d-18c118186f20 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:49.624524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c9a42-3f8b-4682-ad9d-18c118186f20 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:49.666777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52671f-d332-425a-bdb7-1bb9e45003a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:49.667450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52671f-d332-425a-bdb7-1bb9e45003a0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:49.667739 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52671f-d332-425a-bdb7-1bb9e45003a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:49.669499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52671f-d332-425a-bdb7-1bb9e45003a0 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:49.669499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52671f-d332-425a-bdb7-1bb9e45003a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:49.669499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52671f-d332-425a-bdb7-1bb9e45003a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:49.671469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52671f-d332-425a-bdb7-1bb9e45003a0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:49.702446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 597/1213] 10.222.0.66 () {56 vars in 1143 bytes} [Fri Jul 15 20:26:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:26:49.706211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62682113-5e9e-4538-b309-4f4f3fe4bdc7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:49.827398 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62682113-5e9e-4538-b309-4f4f3fe4bdc7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:49.866335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5449c39-f781-45a3-beac-1c9d18ca766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:49.867085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449c39-f781-45a3-beac-1c9d18ca766b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:49.867376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449c39-f781-45a3-beac-1c9d18ca766b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:49.867658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449c39-f781-45a3-beac-1c9d18ca766b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:49.902006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:49.950062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5449c39-f781-45a3-beac-1c9d18ca766b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:49.952381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5449c39-f781-45a3-beac-1c9d18ca766b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:50.070565 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 617/1214] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:26:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:26:50.076758 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52671f-d332-425a-bdb7-1bb9e45003a0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:50.099006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:50.196710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52671f-d332-425a-bdb7-1bb9e45003a0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:50.244211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be049a-c772-4d57-b3f5-6361756d5c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:50.245144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be049a-c772-4d57-b3f5-6361756d5c76 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:50.245430 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be049a-c772-4d57-b3f5-6361756d5c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:50.245719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be049a-c772-4d57-b3f5-6361756d5c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:50.257359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be049a-c772-4d57-b3f5-6361756d5c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:50.258811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be049a-c772-4d57-b3f5-6361756d5c76 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e8be049a-c772-4d57-b3f5-6361756d5c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:26:50.278467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:50.280237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:50.281290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:26:50.281290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:26:50.281290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:26:50.281290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:26:50.281290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 598/1215] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:26:50.286950 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5449c39-f781-45a3-beac-1c9d18ca766b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:50.362167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:50.408605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5449c39-f781-45a3-beac-1c9d18ca766b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:50.448849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ffff5-2b57-4c81-aa49-883046857ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:50.449534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ffff5-2b57-4c81-aa49-883046857ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:50.449797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ffff5-2b57-4c81-aa49-883046857ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:50.450075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ffff5-2b57-4c81-aa49-883046857ec7 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:50.450983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ffff5-2b57-4c81-aa49-883046857ec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:50.451461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ffff5-2b57-4c81-aa49-883046857ec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:50.455407 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ffff5-2b57-4c81-aa49-883046857ec7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:50.467532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 618/1216] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:26:50.473901 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be049a-c772-4d57-b3f5-6361756d5c76 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:50.552256 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:50.585369 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be049a-c772-4d57-b3f5-6361756d5c76 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:50.620539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385eb62-470c-464e-99b8-0a89822b71b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:50.621360 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385eb62-470c-464e-99b8-0a89822b71b9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:50.621694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385eb62-470c-464e-99b8-0a89822b71b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:50.622033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385eb62-470c-464e-99b8-0a89822b71b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:50.629515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385eb62-470c-464e-99b8-0a89822b71b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:50.631018 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385eb62-470c-464e-99b8-0a89822b71b9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0385eb62-470c-464e-99b8-0a89822b71b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:26:50.645370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:50.646559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:50.647711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:26:50.647711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:26:50.647711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:26:50.647711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:26:50.647711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:26:50.647711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:26:50.647711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:26:50.647711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:26:50.653303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 599/1217] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:26:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:26:50.654552 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ffff5-2b57-4c81-aa49-883046857ec7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:50.774225 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ffff5-2b57-4c81-aa49-883046857ec7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:50.799095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:50.812572 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf8ae1-5a39-4b3e-9829-0bd9928a9f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:50.813277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf8ae1-5a39-4b3e-9829-0bd9928a9f95 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:50.813563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf8ae1-5a39-4b3e-9829-0bd9928a9f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:50.813927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf8ae1-5a39-4b3e-9829-0bd9928a9f95 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:50.815023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf8ae1-5a39-4b3e-9829-0bd9928a9f95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:50.815382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf8ae1-5a39-4b3e-9829-0bd9928a9f95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:50.816885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf8ae1-5a39-4b3e-9829-0bd9928a9f95 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:50.835153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 619/1218] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:26:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:26:50.836325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385eb62-470c-464e-99b8-0a89822b71b9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:50.947396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385eb62-470c-464e-99b8-0a89822b71b9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:50.978820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:50.986179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df688eef-8d66-408b-bd44-95b02699cd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:50.986824 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df688eef-8d66-408b-bd44-95b02699cd36 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:50.987287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df688eef-8d66-408b-bd44-95b02699cd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:50.987746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df688eef-8d66-408b-bd44-95b02699cd36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:50.988629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df688eef-8d66-408b-bd44-95b02699cd36 None admin] RBAC: Adding query filter params (role.id=c81d50150272454fa5fe29cf1428c69e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=6693dd1ea26049c1ac8460faf1bc9b63) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:50.988940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df688eef-8d66-408b-bd44-95b02699cd36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:50.990363 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df688eef-8d66-408b-bd44-95b02699cd36 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:51.004440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 600/1219] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:26:50 2022] GET /identity/v3/role_assignments?user.id=6693dd1ea26049c1ac8460faf1bc9b63&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=c81d50150272454fa5fe29cf1428c69e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:26:53.020956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa4cc4-316a-4b5a-a156-5f04976c8393 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:53.021521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa4cc4-316a-4b5a-a156-5f04976c8393 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:53.021793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa4cc4-316a-4b5a-a156-5f04976c8393 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:53.023455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 620/1220] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:26:53.028868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba70abf-1c79-4a76-bedd-169d56dc411c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:53.029288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba70abf-1c79-4a76-bedd-169d56dc411c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:53.029461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba70abf-1c79-4a76-bedd-169d56dc411c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:53.047576 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5ba70abf-1c79-4a76-bedd-169d56dc411c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:26:53.048812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5ba70abf-1c79-4a76-bedd-169d56dc411c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:26:53.126746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 601/1221] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:26:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:26:53.148955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa4cc4-316a-4b5a-a156-5f04976c8393 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:53.262851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa4cc4-316a-4b5a-a156-5f04976c8393 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:53.300945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6be2f-7256-4003-9094-e2d1f335fce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:53.301838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6be2f-7256-4003-9094-e2d1f335fce6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:53.302116 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6be2f-7256-4003-9094-e2d1f335fce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:53.302389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6be2f-7256-4003-9094-e2d1f335fce6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:53.313038 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6be2f-7256-4003-9094-e2d1f335fce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-6ff6be2f-7256-4003-9094-e2d1f335fce6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:26:53.320737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:53.321949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:53.323023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:53.323023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:53.323023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:53.323023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:53.323023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:26:53.323023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:26:53.323023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:26:53.323023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:26:53.323023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:26:53.323023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:26:53.323023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:26:53.323023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:26:53.323023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 621/1222] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:26:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:26:53.329013 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba70abf-1c79-4a76-bedd-169d56dc411c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:53.439263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba70abf-1c79-4a76-bedd-169d56dc411c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:53.466315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:53.478207 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfe407-b111-4d15-a160-4d184d724de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:53.478884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfe407-b111-4d15-a160-4d184d724de6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:53.479172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfe407-b111-4d15-a160-4d184d724de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:53.479451 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfe407-b111-4d15-a160-4d184d724de6 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:53.480203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfe407-b111-4d15-a160-4d184d724de6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:53.480552 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfe407-b111-4d15-a160-4d184d724de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:53.481924 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfe407-b111-4d15-a160-4d184d724de6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:53.490850 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 602/1223] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:26:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:26:53.496681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6be2f-7256-4003-9094-e2d1f335fce6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:53.547368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:53.606361 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6be2f-7256-4003-9094-e2d1f335fce6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:53.644365 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64562f6-39a4-414e-91ee-381a1b3d638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:53.645184 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64562f6-39a4-414e-91ee-381a1b3d638a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:53.645473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64562f6-39a4-414e-91ee-381a1b3d638a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:53.645750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64562f6-39a4-414e-91ee-381a1b3d638a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:53.656664 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64562f6-39a4-414e-91ee-381a1b3d638a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:53.658122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64562f6-39a4-414e-91ee-381a1b3d638a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-b64562f6-39a4-414e-91ee-381a1b3d638a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:26:53.676318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:53.677471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:53.678391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:26:53.678391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:26:53.678391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:26:53.678391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:26:53.678391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 622/1224] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:26:53.683300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfe407-b111-4d15-a160-4d184d724de6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:53.792062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfe407-b111-4d15-a160-4d184d724de6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:53.828163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f6d9c-34c3-44dc-9d16-69f8ce32a0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:53.828857 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f6d9c-34c3-44dc-9d16-69f8ce32a0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:53.829144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f6d9c-34c3-44dc-9d16-69f8ce32a0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:53.829422 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f6d9c-34c3-44dc-9d16-69f8ce32a0e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:53.830147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f6d9c-34c3-44dc-9d16-69f8ce32a0e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:53.830459 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f6d9c-34c3-44dc-9d16-69f8ce32a0e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:53.831941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f6d9c-34c3-44dc-9d16-69f8ce32a0e3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:53.844955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 603/1225] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:26:53.851004 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64562f6-39a4-414e-91ee-381a1b3d638a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:53.952551 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:53.959287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64562f6-39a4-414e-91ee-381a1b3d638a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:53.997163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d890940-2195-455d-9dd9-a8c81e923bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:53.998830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d890940-2195-455d-9dd9-a8c81e923bee None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:53.999120 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d890940-2195-455d-9dd9-a8c81e923bee None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:53.999415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d890940-2195-455d-9dd9-a8c81e923bee None admin] PATH_INFO: `/v3/users/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:54.006754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d890940-2195-455d-9dd9-a8c81e923bee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:54.008201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d890940-2195-455d-9dd9-a8c81e923bee None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-9d890940-2195-455d-9dd9-a8c81e923bee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:26:54.023936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:54.025532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:54.026703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:54.026703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:54.026703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:26:54.026703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:26:54.026703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:26:54.026703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:26:54.026703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:26:54.026703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:26:54.026703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:26:54.026703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:26:54.030398 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 623/1226] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:26:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:26:54.031488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f6d9c-34c3-44dc-9d16-69f8ce32a0e3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:54.087449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:54.145204 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f6d9c-34c3-44dc-9d16-69f8ce32a0e3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:54.182670 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77fb0a-f9dc-4bdc-91d1-27c6d220b2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:54.183382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77fb0a-f9dc-4bdc-91d1-27c6d220b2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:54.183688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77fb0a-f9dc-4bdc-91d1-27c6d220b2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:54.183985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77fb0a-f9dc-4bdc-91d1-27c6d220b2b4 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:54.184947 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77fb0a-f9dc-4bdc-91d1-27c6d220b2b4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:54.185263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77fb0a-f9dc-4bdc-91d1-27c6d220b2b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:54.186844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77fb0a-f9dc-4bdc-91d1-27c6d220b2b4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:54.207578 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 604/1227] 10.222.0.66 () {56 vars in 1143 bytes} [Fri Jul 15 20:26:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:26:54.213824 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d890940-2195-455d-9dd9-a8c81e923bee None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:54.327196 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d890940-2195-455d-9dd9-a8c81e923bee None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:54.366527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268e47e-5e9c-427f-bfe0-98ad2f9e63a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:54.367389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268e47e-5e9c-427f-bfe0-98ad2f9e63a0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:54.367677 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268e47e-5e9c-427f-bfe0-98ad2f9e63a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:54.367956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268e47e-5e9c-427f-bfe0-98ad2f9e63a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:54.379581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268e47e-5e9c-427f-bfe0-98ad2f9e63a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:54.383617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268e47e-5e9c-427f-bfe0-98ad2f9e63a0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d268e47e-5e9c-427f-bfe0-98ad2f9e63a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:26:54.402930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:54.404161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:54.405756 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:26:54.405756 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:26:54.405756 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:26:54.405756 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:26:54.408834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 624/1228] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:26:54.411071 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77fb0a-f9dc-4bdc-91d1-27c6d220b2b4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:54.525013 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77fb0a-f9dc-4bdc-91d1-27c6d220b2b4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:54.527478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:54.563184 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207c793-f635-44fe-aa69-ce8d12565564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:54.563848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207c793-f635-44fe-aa69-ce8d12565564 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:54.564131 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207c793-f635-44fe-aa69-ce8d12565564 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:54.564431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207c793-f635-44fe-aa69-ce8d12565564 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:54.565146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207c793-f635-44fe-aa69-ce8d12565564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:54.565530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207c793-f635-44fe-aa69-ce8d12565564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:54.567031 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207c793-f635-44fe-aa69-ce8d12565564 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:54.586081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 605/1229] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:26:54.587408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268e47e-5e9c-427f-bfe0-98ad2f9e63a0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:54.597923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:54.698249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268e47e-5e9c-427f-bfe0-98ad2f9e63a0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:54.733829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458a777-3dc9-4727-8033-d09cdeaa1db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:54.734526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458a777-3dc9-4727-8033-d09cdeaa1db0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:54.734814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458a777-3dc9-4727-8033-d09cdeaa1db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:54.735113 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458a777-3dc9-4727-8033-d09cdeaa1db0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:54.742416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458a777-3dc9-4727-8033-d09cdeaa1db0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:54.743994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458a777-3dc9-4727-8033-d09cdeaa1db0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-8458a777-3dc9-4727-8033-d09cdeaa1db0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:26:54.760487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:54.761580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:54.762491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:26:54.762491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:26:54.762491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:26:54.762491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:26:54.762491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:26:54.762491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:26:54.762491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:26:54.762491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:26:54.762491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 625/1230] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:26:54.768862 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207c793-f635-44fe-aa69-ce8d12565564 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:54.877752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207c793-f635-44fe-aa69-ce8d12565564 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:54.914263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bac41-9f01-44ac-a497-b60663e660c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:54.914948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bac41-9f01-44ac-a497-b60663e660c3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:54.915322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bac41-9f01-44ac-a497-b60663e660c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:54.915630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bac41-9f01-44ac-a497-b60663e660c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:54.916566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bac41-9f01-44ac-a497-b60663e660c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:54.916952 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bac41-9f01-44ac-a497-b60663e660c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:54.918702 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bac41-9f01-44ac-a497-b60663e660c3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:54.932989 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 606/1231] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:26:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:26:54.940147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458a777-3dc9-4727-8033-d09cdeaa1db0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:55.009514 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:55.049508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458a777-3dc9-4727-8033-d09cdeaa1db0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:55.086035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b09963-1095-4bc0-8db0-5dd7d7633738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:55.086973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b09963-1095-4bc0-8db0-5dd7d7633738 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:55.087288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b09963-1095-4bc0-8db0-5dd7d7633738 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:55.087606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b09963-1095-4bc0-8db0-5dd7d7633738 None admin] PATH_INFO: `/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/6693dd1ea26049c1ac8460faf1bc9b63/roles/c81d50150272454fa5fe29cf1428c69e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:55.104167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b09963-1095-4bc0-8db0-5dd7d7633738 None admin] RBAC: Authorizing `identity:create_grant(project_id=52dd45fcba114e3f8ff40d8b954ee5cc, user_id=6693dd1ea26049c1ac8460faf1bc9b63, role_id=c81d50150272454fa5fe29cf1428c69e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:55.105756 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b09963-1095-4bc0-8db0-5dd7d7633738 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:55.118687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 626/1232] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:26:54 2022] PUT /identity/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/6693dd1ea26049c1ac8460faf1bc9b63/roles/c81d50150272454fa5fe29cf1428c69e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:26:57.268480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852f3f-0f96-42d0-9dbd-37866fdc867d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:57.269057 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852f3f-0f96-42d0-9dbd-37866fdc867d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:57.269171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852f3f-0f96-42d0-9dbd-37866fdc867d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:57.272434 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 607/1233] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:26:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:26:57.276584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a8b67-33ff-478f-9e81-dbda4e27a71d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:57.276988 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a8b67-33ff-478f-9e81-dbda4e27a71d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:57.277147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a8b67-33ff-478f-9e81-dbda4e27a71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:57.296305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e56a8b67-33ff-478f-9e81-dbda4e27a71d None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:26:57.297751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e56a8b67-33ff-478f-9e81-dbda4e27a71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:26:57.366747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 627/1234] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:26:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:26:57.391036 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed852f3f-0f96-42d0-9dbd-37866fdc867d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:57.419222 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:57.505293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed852f3f-0f96-42d0-9dbd-37866fdc867d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:57.546343 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1f72d-fa72-4888-a4c2-1be313e72731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:57.547065 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1f72d-fa72-4888-a4c2-1be313e72731 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:57.547349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1f72d-fa72-4888-a4c2-1be313e72731 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:57.547621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1f72d-fa72-4888-a4c2-1be313e72731 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:57.558801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1f72d-fa72-4888-a4c2-1be313e72731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3fa1f72d-fa72-4888-a4c2-1be313e72731 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:26:57.567958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:57.569191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:57.573532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:57.573532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:57.573532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:57.573532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:57.573532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:26:57.573532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:26:57.573532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:26:57.573532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:26:57.573532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:26:57.573532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:26:57.573532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 20:26:57.573532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:26:57.573532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 608/1235] 10.222.0.66 () {56 vars in 1102 bytes} [Fri Jul 15 20:26:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:26:57.575958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a8b67-33ff-478f-9e81-dbda4e27a71d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:57.627132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:57.685148 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a8b67-33ff-478f-9e81-dbda4e27a71d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:57.724917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57ef9b-2e88-4156-bbb4-7a5fe8f9ce14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:57.725687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57ef9b-2e88-4156-bbb4-7a5fe8f9ce14 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:57.726031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57ef9b-2e88-4156-bbb4-7a5fe8f9ce14 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:57.726334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57ef9b-2e88-4156-bbb4-7a5fe8f9ce14 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:57.727236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57ef9b-2e88-4156-bbb4-7a5fe8f9ce14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:57.727639 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57ef9b-2e88-4156-bbb4-7a5fe8f9ce14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:57.729047 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57ef9b-2e88-4156-bbb4-7a5fe8f9ce14 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:57.738131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 628/1236] 10.222.0.66 () {56 vars in 1103 bytes} [Fri Jul 15 20:26:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:26:57.744324 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1f72d-fa72-4888-a4c2-1be313e72731 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:57.846389 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:57.863348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1f72d-fa72-4888-a4c2-1be313e72731 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:57.899973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bc012-9f48-4740-b785-bf00b4ea444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:57.901013 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bc012-9f48-4740-b785-bf00b4ea444e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:57.901354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bc012-9f48-4740-b785-bf00b4ea444e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:57.901694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bc012-9f48-4740-b785-bf00b4ea444e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:57.912733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735bc012-9f48-4740-b785-bf00b4ea444e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:57.914173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735bc012-9f48-4740-b785-bf00b4ea444e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-735bc012-9f48-4740-b785-bf00b4ea444e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:26:57.933049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:57.934189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:57.935100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:26:57.935100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:26:57.935100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:26:57.935100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:26:57.935100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 609/1237] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:26:57.940777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57ef9b-2e88-4156-bbb4-7a5fe8f9ce14 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:58.048746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57ef9b-2e88-4156-bbb4-7a5fe8f9ce14 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:58.058900 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:58.094767 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca08fc4-7bbb-459b-ab10-8ca3c72c1420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:58.095445 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca08fc4-7bbb-459b-ab10-8ca3c72c1420 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:58.095737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca08fc4-7bbb-459b-ab10-8ca3c72c1420 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:58.096015 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca08fc4-7bbb-459b-ab10-8ca3c72c1420 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:58.096845 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca08fc4-7bbb-459b-ab10-8ca3c72c1420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:58.097100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca08fc4-7bbb-459b-ab10-8ca3c72c1420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:58.098485 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca08fc4-7bbb-459b-ab10-8ca3c72c1420 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:58.112311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 629/1238] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:26:58.118271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bc012-9f48-4740-b785-bf00b4ea444e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:58.249680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bc012-9f48-4740-b785-bf00b4ea444e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:58.286256 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b644b5e-3d7a-40d5-bd2c-f1d446eaf6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:58.287089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b644b5e-3d7a-40d5-bd2c-f1d446eaf6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:58.287614 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b644b5e-3d7a-40d5-bd2c-f1d446eaf6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:58.287897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b644b5e-3d7a-40d5-bd2c-f1d446eaf6d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:58.290718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:58.296916 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b644b5e-3d7a-40d5-bd2c-f1d446eaf6d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:58.298371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b644b5e-3d7a-40d5-bd2c-f1d446eaf6d2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1b644b5e-3d7a-40d5-bd2c-f1d446eaf6d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:26:58.315810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:58.317046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:58.318203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:58.318203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:58.318203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:26:58.318203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:26:58.318203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:26:58.318203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:26:58.318203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:26:58.318203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:26:58.318203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:26:58.318203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:26:58.318203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 610/1239] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:26:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:26:58.323346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca08fc4-7bbb-459b-ab10-8ca3c72c1420 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:58.431598 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca08fc4-7bbb-459b-ab10-8ca3c72c1420 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:58.468423 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a7ae3-f663-474d-928a-c007afde63ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:58.469306 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a7ae3-f663-474d-928a-c007afde63ee None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:58.469601 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a7ae3-f663-474d-928a-c007afde63ee None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:58.469871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a7ae3-f663-474d-928a-c007afde63ee None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:58.470765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a7ae3-f663-474d-928a-c007afde63ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:58.471077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a7ae3-f663-474d-928a-c007afde63ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:58.472537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a7ae3-f663-474d-928a-c007afde63ee None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:58.491861 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 630/1240] 10.222.0.66 () {56 vars in 1143 bytes} [Fri Jul 15 20:26:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:26:58.498370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b644b5e-3d7a-40d5-bd2c-f1d446eaf6d2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:58.603678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b644b5e-3d7a-40d5-bd2c-f1d446eaf6d2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:58.639358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bcfe7-80a9-4564-9768-03f73d9f84b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:58.639992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bcfe7-80a9-4564-9768-03f73d9f84b3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:58.640275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bcfe7-80a9-4564-9768-03f73d9f84b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:58.640668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bcfe7-80a9-4564-9768-03f73d9f84b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:58.712699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:58.720796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bcfe7-80a9-4564-9768-03f73d9f84b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:58.722313 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bcfe7-80a9-4564-9768-03f73d9f84b3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:58.826449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 611/1241] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:26:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:26:58.833468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a7ae3-f663-474d-928a-c007afde63ee None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:58.863085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:58.945158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a7ae3-f663-474d-928a-c007afde63ee None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:58.981145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866e9a9-8f2c-41cf-ae4e-29cef2b8df57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:58.982668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866e9a9-8f2c-41cf-ae4e-29cef2b8df57 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:58.982951 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866e9a9-8f2c-41cf-ae4e-29cef2b8df57 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:58.983249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866e9a9-8f2c-41cf-ae4e-29cef2b8df57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:58.993262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866e9a9-8f2c-41cf-ae4e-29cef2b8df57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:58.994715 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866e9a9-8f2c-41cf-ae4e-29cef2b8df57 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2866e9a9-8f2c-41cf-ae4e-29cef2b8df57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:26:59.013790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:59.014962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:59.016230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:26:59.016230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:26:59.016230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:26:59.016230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:26:59.016230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 631/1242] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:26:59.021708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bcfe7-80a9-4564-9768-03f73d9f84b3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:59.134382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:59.141943 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bcfe7-80a9-4564-9768-03f73d9f84b3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:59.180502 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9469be-eb67-4569-a373-d1d74bc095ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:59.181415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9469be-eb67-4569-a373-d1d74bc095ea None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:59.181784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9469be-eb67-4569-a373-d1d74bc095ea None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:59.182065 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9469be-eb67-4569-a373-d1d74bc095ea None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:59.182821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9469be-eb67-4569-a373-d1d74bc095ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:59.183187 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9469be-eb67-4569-a373-d1d74bc095ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:59.184758 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9469be-eb67-4569-a373-d1d74bc095ea None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:59.198000 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 612/1243] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:26:59.204173 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866e9a9-8f2c-41cf-ae4e-29cef2b8df57 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:59.297664 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:26:59.323668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866e9a9-8f2c-41cf-ae4e-29cef2b8df57 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:59.365000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65863ff-31ce-4fb6-824f-101a06168f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:59.365817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65863ff-31ce-4fb6-824f-101a06168f70 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:59.366082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65863ff-31ce-4fb6-824f-101a06168f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:59.366359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65863ff-31ce-4fb6-824f-101a06168f70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:59.374292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65863ff-31ce-4fb6-824f-101a06168f70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:59.376336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65863ff-31ce-4fb6-824f-101a06168f70 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d65863ff-31ce-4fb6-824f-101a06168f70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:26:59.390534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:26:59.391564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:26:59.392583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:26:59.392583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:26:59.392583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:26:59.392583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:26:59.392583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:26:59.392583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:26:59.392583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:26:59.392583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:26:59.392583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 632/1244] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:26:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:26:59.397759 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9469be-eb67-4569-a373-d1d74bc095ea None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:59.508555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9469be-eb67-4569-a373-d1d74bc095ea None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:59.550348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af5362-d836-4666-8097-7be2baf9d357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:59.550951 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af5362-d836-4666-8097-7be2baf9d357 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:59.551237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af5362-d836-4666-8097-7be2baf9d357 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:59.551517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af5362-d836-4666-8097-7be2baf9d357 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:59.552476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af5362-d836-4666-8097-7be2baf9d357 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:59.552789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af5362-d836-4666-8097-7be2baf9d357 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:59.554232 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af5362-d836-4666-8097-7be2baf9d357 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:59.567354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 613/1245] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:26:59.574123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65863ff-31ce-4fb6-824f-101a06168f70 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:26:59.684044 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65863ff-31ce-4fb6-824f-101a06168f70 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:26:59.724346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7198b-a292-49d2-83f0-ab3ff5ee673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:26:59.725039 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7198b-a292-49d2-83f0-ab3ff5ee673c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:26:59.725330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7198b-a292-49d2-83f0-ab3ff5ee673c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:26:59.725626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7198b-a292-49d2-83f0-ab3ff5ee673c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:26:59.726458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7198b-a292-49d2-83f0-ab3ff5ee673c None admin] RBAC: Adding query filter params (role.id=c81d50150272454fa5fe29cf1428c69e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=6693dd1ea26049c1ac8460faf1bc9b63) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:26:59.726778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7198b-a292-49d2-83f0-ab3ff5ee673c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:26:59.728229 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7198b-a292-49d2-83f0-ab3ff5ee673c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:26:59.735064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 633/1246] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:26:59 2022] GET /identity/v3/role_assignments?user.id=6693dd1ea26049c1ac8460faf1bc9b63&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=c81d50150272454fa5fe29cf1428c69e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:01.956816 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c9a7e-5df7-499b-bb36-00f3224d363c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:01.957333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c9a7e-5df7-499b-bb36-00f3224d363c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:01.957412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c9a7e-5df7-499b-bb36-00f3224d363c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:01.958790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 614/1247] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:27:01.964015 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e742a-b426-44ec-b71d-e39244d15933 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:01.964482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e742a-b426-44ec-b71d-e39244d15933 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:01.964620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e742a-b426-44ec-b71d-e39244d15933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:01.970434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:01.983782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0e2e742a-b426-44ec-b71d-e39244d15933 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:27:01.985075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0e2e742a-b426-44ec-b71d-e39244d15933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:27:02.058064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 634/1248] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:27:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:27:02.083429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c9a7e-5df7-499b-bb36-00f3224d363c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:02.103142 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:02.196764 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c9a7e-5df7-499b-bb36-00f3224d363c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:02.237742 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6580d96-2fb2-41a1-8586-801e9568df06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:02.238458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6580d96-2fb2-41a1-8586-801e9568df06 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:02.238736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6580d96-2fb2-41a1-8586-801e9568df06 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:02.239009 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6580d96-2fb2-41a1-8586-801e9568df06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:02.251493 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6580d96-2fb2-41a1-8586-801e9568df06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c6580d96-2fb2-41a1-8586-801e9568df06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:27:02.261162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:02.262307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:02.263274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:02.263274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:02.263274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:02.263274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:02.263274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:27:02.263274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:27:02.263274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:27:02.263274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:27:02.263274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:27:02.263274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:27:02.263274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:27:02.263274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:27:02.263274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 615/1249] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:27:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:02.270139 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e742a-b426-44ec-b71d-e39244d15933 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:02.379000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e742a-b426-44ec-b71d-e39244d15933 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:02.410780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:02.416261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cec7c-555e-4b90-b2fd-537dcc4b152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:02.417116 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cec7c-555e-4b90-b2fd-537dcc4b152c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:02.417412 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cec7c-555e-4b90-b2fd-537dcc4b152c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:02.417719 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cec7c-555e-4b90-b2fd-537dcc4b152c None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:02.418720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cec7c-555e-4b90-b2fd-537dcc4b152c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:02.419062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cec7c-555e-4b90-b2fd-537dcc4b152c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:02.421163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cec7c-555e-4b90-b2fd-537dcc4b152c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:02.431317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 635/1250] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:02.437500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6580d96-2fb2-41a1-8586-801e9568df06 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:02.531509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:02.559007 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6580d96-2fb2-41a1-8586-801e9568df06 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:02.598089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d7d19-eec3-4a3b-9ce5-0d040051c6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:02.598983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7d19-eec3-4a3b-9ce5-0d040051c6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:02.599323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7d19-eec3-4a3b-9ce5-0d040051c6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:02.599597 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7d19-eec3-4a3b-9ce5-0d040051c6e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:02.613688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d7d19-eec3-4a3b-9ce5-0d040051c6e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:02.615277 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d7d19-eec3-4a3b-9ce5-0d040051c6e7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9c2d7d19-eec3-4a3b-9ce5-0d040051c6e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:27:02.639092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:02.640645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:02.641787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:27:02.641787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:27:02.641787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:27:02.641787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:27:02.641787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 616/1251] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:02.646932 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cec7c-555e-4b90-b2fd-537dcc4b152c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:02.756661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cec7c-555e-4b90-b2fd-537dcc4b152c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:02.797124 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b50fc8-3f02-424e-8a2e-bd3f79d53bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:02.798155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b50fc8-3f02-424e-8a2e-bd3f79d53bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:02.798434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b50fc8-3f02-424e-8a2e-bd3f79d53bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:02.798779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b50fc8-3f02-424e-8a2e-bd3f79d53bb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:02.799505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b50fc8-3f02-424e-8a2e-bd3f79d53bb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:02.799809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b50fc8-3f02-424e-8a2e-bd3f79d53bb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:02.801303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b50fc8-3f02-424e-8a2e-bd3f79d53bb3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:02.815539 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 636/1252] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:27:02.821851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d7d19-eec3-4a3b-9ce5-0d040051c6e7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:02.946106 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d7d19-eec3-4a3b-9ce5-0d040051c6e7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:02.977969 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:02.988446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab8e1d-3c56-4fd8-817d-f8f2bedbd1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:02.989269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab8e1d-3c56-4fd8-817d-f8f2bedbd1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:02.989556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab8e1d-3c56-4fd8-817d-f8f2bedbd1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:02.989836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab8e1d-3c56-4fd8-817d-f8f2bedbd1c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:03.000544 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab8e1d-3c56-4fd8-817d-f8f2bedbd1c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:03.002173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab8e1d-3c56-4fd8-817d-f8f2bedbd1c9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-5aab8e1d-3c56-4fd8-817d-f8f2bedbd1c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:27:03.019694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:03.020908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:03.022082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:03.022082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:03.022082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:27:03.022082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:27:03.022082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:27:03.022082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:27:03.022082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:27:03.022082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:27:03.022082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:27:03.022082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:27:03.022082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 617/1253] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:27:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:03.027432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b50fc8-3f02-424e-8a2e-bd3f79d53bb3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:03.089417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:03.137521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b50fc8-3f02-424e-8a2e-bd3f79d53bb3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:03.176462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70839f4c-da91-4280-818d-9979219ba99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:03.177134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70839f4c-da91-4280-818d-9979219ba99d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:03.177414 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70839f4c-da91-4280-818d-9979219ba99d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:03.177693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70839f4c-da91-4280-818d-9979219ba99d None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:03.178522 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70839f4c-da91-4280-818d-9979219ba99d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:03.178830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70839f4c-da91-4280-818d-9979219ba99d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:03.180253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70839f4c-da91-4280-818d-9979219ba99d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:03.198629 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 637/1254] 10.222.0.66 () {56 vars in 1143 bytes} [Fri Jul 15 20:27:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:03.206488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab8e1d-3c56-4fd8-817d-f8f2bedbd1c9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:03.323967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab8e1d-3c56-4fd8-817d-f8f2bedbd1c9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:03.359978 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af81c68-cb7c-4d39-bc04-810e9b514f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:03.360630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af81c68-cb7c-4d39-bc04-810e9b514f8c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:03.360962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af81c68-cb7c-4d39-bc04-810e9b514f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:03.361245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af81c68-cb7c-4d39-bc04-810e9b514f8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:03.421426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:03.435029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af81c68-cb7c-4d39-bc04-810e9b514f8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:03.436520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af81c68-cb7c-4d39-bc04-810e9b514f8c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:03.553676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 618/1255] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:27:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:27:03.559822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70839f4c-da91-4280-818d-9979219ba99d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:03.676417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70839f4c-da91-4280-818d-9979219ba99d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:03.691463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:03.721017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a943f2-9fad-4765-b211-9f8dd16445ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:03.722132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a943f2-9fad-4765-b211-9f8dd16445ed None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:03.722525 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a943f2-9fad-4765-b211-9f8dd16445ed None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:03.722891 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a943f2-9fad-4765-b211-9f8dd16445ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:03.738127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a943f2-9fad-4765-b211-9f8dd16445ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:03.739611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a943f2-9fad-4765-b211-9f8dd16445ed None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-f0a943f2-9fad-4765-b211-9f8dd16445ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:27:03.758277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:03.759558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:03.760557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:27:03.760557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:27:03.760557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:27:03.760557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:27:03.760557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 638/1256] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:03.766139 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af81c68-cb7c-4d39-bc04-810e9b514f8c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:03.863040 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:03.876524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af81c68-cb7c-4d39-bc04-810e9b514f8c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:03.911417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24870ad9-0750-406b-8122-3fa8cf83f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:03.912119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24870ad9-0750-406b-8122-3fa8cf83f10c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:03.912702 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24870ad9-0750-406b-8122-3fa8cf83f10c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:03.912983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24870ad9-0750-406b-8122-3fa8cf83f10c None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:03.913707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24870ad9-0750-406b-8122-3fa8cf83f10c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:03.914017 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24870ad9-0750-406b-8122-3fa8cf83f10c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:03.915382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24870ad9-0750-406b-8122-3fa8cf83f10c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:03.927085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 619/1257] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:03.932912 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a943f2-9fad-4765-b211-9f8dd16445ed None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:04.040218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a943f2-9fad-4765-b211-9f8dd16445ed None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:04.079229 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15596499-2280-44b7-a085-ec9568127c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:04.080036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15596499-2280-44b7-a085-ec9568127c78 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:04.080324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15596499-2280-44b7-a085-ec9568127c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:04.080629 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15596499-2280-44b7-a085-ec9568127c78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:04.087545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15596499-2280-44b7-a085-ec9568127c78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:04.089036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15596499-2280-44b7-a085-ec9568127c78 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-15596499-2280-44b7-a085-ec9568127c78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:27:04.103368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:04.104272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:04.105278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:27:04.105278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:27:04.105278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:27:04.105278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:27:04.105278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:27:04.105278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:27:04.105278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:27:04.105278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:27:04.105278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 639/1258] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:04.111791 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24870ad9-0750-406b-8122-3fa8cf83f10c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:04.219589 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24870ad9-0750-406b-8122-3fa8cf83f10c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:04.257310 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239e80c-1f45-4d5b-a02a-1d7c1a8463a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:04.257971 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239e80c-1f45-4d5b-a02a-1d7c1a8463a7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:04.258254 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239e80c-1f45-4d5b-a02a-1d7c1a8463a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:04.258526 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239e80c-1f45-4d5b-a02a-1d7c1a8463a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:04.259313 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239e80c-1f45-4d5b-a02a-1d7c1a8463a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:04.259611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239e80c-1f45-4d5b-a02a-1d7c1a8463a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:04.261074 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239e80c-1f45-4d5b-a02a-1d7c1a8463a7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:04.274950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 620/1259] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:04.282022 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15596499-2280-44b7-a085-ec9568127c78 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:04.308066 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:04.385502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15596499-2280-44b7-a085-ec9568127c78 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:04.422732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d8bb0-247f-4895-ba3f-0f9088c245ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:04.423388 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d8bb0-247f-4895-ba3f-0f9088c245ed None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:04.423678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d8bb0-247f-4895-ba3f-0f9088c245ed None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:04.423960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d8bb0-247f-4895-ba3f-0f9088c245ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:04.424827 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d8bb0-247f-4895-ba3f-0f9088c245ed None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=6693dd1ea26049c1ac8460faf1bc9b63) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:04.425144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d8bb0-247f-4895-ba3f-0f9088c245ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:04.426580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d8bb0-247f-4895-ba3f-0f9088c245ed None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:04.432242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 640/1260] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:27:04 2022] GET /identity/v3/role_assignments?user.id=6693dd1ea26049c1ac8460faf1bc9b63&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=43e0afe364894278be44a97662ca6f8e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:27:06.475679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9ded2-c6b3-49a7-bf3b-0cf73dc89251 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:06.476079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9ded2-c6b3-49a7-bf3b-0cf73dc89251 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:06.476237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9ded2-c6b3-49a7-bf3b-0cf73dc89251 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:06.477647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 621/1261] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:27:06.482939 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76493d5f-f151-4b57-b21a-4313ec624e1b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:06.483361 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76493d5f-f151-4b57-b21a-4313ec624e1b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:06.483502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76493d5f-f151-4b57-b21a-4313ec624e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:06.499963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-76493d5f-f151-4b57-b21a-4313ec624e1b None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:27:06.501174 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-76493d5f-f151-4b57-b21a-4313ec624e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:27:06.566843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 641/1262] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:27:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:27:06.588633 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9ded2-c6b3-49a7-bf3b-0cf73dc89251 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:06.599714 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:06.689262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9ded2-c6b3-49a7-bf3b-0cf73dc89251 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:06.722528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83f587-1372-41c5-8dec-2b394ad12ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:06.723269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83f587-1372-41c5-8dec-2b394ad12ddb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:06.723550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83f587-1372-41c5-8dec-2b394ad12ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:06.723821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83f587-1372-41c5-8dec-2b394ad12ddb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:06.734196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83f587-1372-41c5-8dec-2b394ad12ddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8e83f587-1372-41c5-8dec-2b394ad12ddb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:27:06.741802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:06.742925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:06.744079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:06.744079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:06.744079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:06.744079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:06.744079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:27:06.744079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:27:06.744079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:27:06.744079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:27:06.744079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:27:06.744079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:27:06.744079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:27:06.744079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:27:06.744079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 622/1263] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:27:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:06.749122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76493d5f-f151-4b57-b21a-4313ec624e1b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:06.766860 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:06.844839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76493d5f-f151-4b57-b21a-4313ec624e1b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:06.878344 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752fe44-0969-4cfc-bf22-72032f90936f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:06.879004 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752fe44-0969-4cfc-bf22-72032f90936f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:06.879290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752fe44-0969-4cfc-bf22-72032f90936f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:06.879563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752fe44-0969-4cfc-bf22-72032f90936f None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:06.880295 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752fe44-0969-4cfc-bf22-72032f90936f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:06.880631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752fe44-0969-4cfc-bf22-72032f90936f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:06.881987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752fe44-0969-4cfc-bf22-72032f90936f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:06.889915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 642/1264] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:27:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:06.895562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83f587-1372-41c5-8dec-2b394ad12ddb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:06.959820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:06.992935 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83f587-1372-41c5-8dec-2b394ad12ddb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:07.025782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea04de-e2f8-4f88-85d1-b42e47787856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:07.026563 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea04de-e2f8-4f88-85d1-b42e47787856 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:07.026848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea04de-e2f8-4f88-85d1-b42e47787856 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:07.027121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea04de-e2f8-4f88-85d1-b42e47787856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:07.038166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea04de-e2f8-4f88-85d1-b42e47787856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:07.039600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea04de-e2f8-4f88-85d1-b42e47787856 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-dbea04de-e2f8-4f88-85d1-b42e47787856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:27:07.056335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:07.057412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:07.058521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:27:07.058521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:27:07.058521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:27:07.058521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:27:07.058521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 623/1265] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:07.063304 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752fe44-0969-4cfc-bf22-72032f90936f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:07.141455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:07.159996 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752fe44-0969-4cfc-bf22-72032f90936f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:07.192578 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9727a-172b-4df0-b632-908058d868b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:07.193289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9727a-172b-4df0-b632-908058d868b6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:07.193724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9727a-172b-4df0-b632-908058d868b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:07.193976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9727a-172b-4df0-b632-908058d868b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:07.194741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9727a-172b-4df0-b632-908058d868b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:07.195102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9727a-172b-4df0-b632-908058d868b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:07.196410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9727a-172b-4df0-b632-908058d868b6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:07.210292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 643/1266] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:07.217083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea04de-e2f8-4f88-85d1-b42e47787856 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:07.317761 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea04de-e2f8-4f88-85d1-b42e47787856 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:07.336722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:07.350802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9552d-1bb3-457c-9b26-b2725eed3324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:07.351590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9552d-1bb3-457c-9b26-b2725eed3324 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:07.351868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9552d-1bb3-457c-9b26-b2725eed3324 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:07.352141 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9552d-1bb3-457c-9b26-b2725eed3324 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:07.359429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9552d-1bb3-457c-9b26-b2725eed3324 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:07.360883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9552d-1bb3-457c-9b26-b2725eed3324 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-76c9552d-1bb3-457c-9b26-b2725eed3324 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:27:07.375282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:07.376418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:07.377535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:07.377535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:07.377535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:27:07.377535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:27:07.377535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:27:07.377535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:27:07.377535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:27:07.377535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:27:07.377535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:27:07.377535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:27:07.377535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 624/1267] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:27:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:07.382461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9727a-172b-4df0-b632-908058d868b6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:07.479797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9727a-172b-4df0-b632-908058d868b6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:07.512540 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f5136-fad9-49f0-a236-12a913d28bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:07.513732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5136-fad9-49f0-a236-12a913d28bbd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:07.514013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5136-fad9-49f0-a236-12a913d28bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:07.514285 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5136-fad9-49f0-a236-12a913d28bbd None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:07.515113 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f5136-fad9-49f0-a236-12a913d28bbd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:07.515422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f5136-fad9-49f0-a236-12a913d28bbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:07.516865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f5136-fad9-49f0-a236-12a913d28bbd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:07.525188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:07.534461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 644/1268] 10.222.0.66 () {56 vars in 1143 bytes} [Fri Jul 15 20:27:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:07.540369 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9552d-1bb3-457c-9b26-b2725eed3324 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:07.637243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9552d-1bb3-457c-9b26-b2725eed3324 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:07.672668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cd27a-d107-45f2-90fb-5e654a582383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:07.673460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cd27a-d107-45f2-90fb-5e654a582383 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:07.673744 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cd27a-d107-45f2-90fb-5e654a582383 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:07.674022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cd27a-d107-45f2-90fb-5e654a582383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:07.684163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cd27a-d107-45f2-90fb-5e654a582383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:07.686459 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cd27a-d107-45f2-90fb-5e654a582383 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-727cd27a-d107-45f2-90fb-5e654a582383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:27:07.703505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:07.704566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:07.705661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:27:07.705661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:27:07.705661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:27:07.705661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:27:07.705661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 625/1269] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:07.710498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f5136-fad9-49f0-a236-12a913d28bbd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:07.805221 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f5136-fad9-49f0-a236-12a913d28bbd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:07.838945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c0ccb-967f-41dd-8ce6-59c9f82d1328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:07.839591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c0ccb-967f-41dd-8ce6-59c9f82d1328 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:07.839871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c0ccb-967f-41dd-8ce6-59c9f82d1328 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:07.840142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c0ccb-967f-41dd-8ce6-59c9f82d1328 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:07.840878 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c0ccb-967f-41dd-8ce6-59c9f82d1328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:07.841203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c0ccb-967f-41dd-8ce6-59c9f82d1328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:07.842560 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c0ccb-967f-41dd-8ce6-59c9f82d1328 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:07.853404 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 645/1270] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:07.859730 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cd27a-d107-45f2-90fb-5e654a582383 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:07.890895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:07.957278 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cd27a-d107-45f2-90fb-5e654a582383 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:07.989093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc28f49-76a4-4db6-8034-07fb694939dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:07.989870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc28f49-76a4-4db6-8034-07fb694939dd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:07.990153 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc28f49-76a4-4db6-8034-07fb694939dd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:07.990426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc28f49-76a4-4db6-8034-07fb694939dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:07.996784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc28f49-76a4-4db6-8034-07fb694939dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:07.999006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc28f49-76a4-4db6-8034-07fb694939dd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6dc28f49-76a4-4db6-8034-07fb694939dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:27:08.013577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:08.014621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:08.015602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:27:08.015602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:27:08.015602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:27:08.015602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:27:08.015602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:27:08.015602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:27:08.015602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:27:08.015602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:27:08.015602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 626/1271] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:08.020499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c0ccb-967f-41dd-8ce6-59c9f82d1328 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:08.077127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:08.117749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c0ccb-967f-41dd-8ce6-59c9f82d1328 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:08.149259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3043bd-ff11-46ef-8d22-b104bb23fd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:08.149847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3043bd-ff11-46ef-8d22-b104bb23fd92 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:08.150126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3043bd-ff11-46ef-8d22-b104bb23fd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:08.150399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3043bd-ff11-46ef-8d22-b104bb23fd92 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:08.151170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3043bd-ff11-46ef-8d22-b104bb23fd92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:08.151473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3043bd-ff11-46ef-8d22-b104bb23fd92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:08.152925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3043bd-ff11-46ef-8d22-b104bb23fd92 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:08.165169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 646/1272] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:08.171840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc28f49-76a4-4db6-8034-07fb694939dd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:08.275148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:08.284717 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc28f49-76a4-4db6-8034-07fb694939dd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:08.317718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d2041-d3c8-416f-92d4-8c78a6a9ed23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:08.318596 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d2041-d3c8-416f-92d4-8c78a6a9ed23 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:08.318881 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d2041-d3c8-416f-92d4-8c78a6a9ed23 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:08.319158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d2041-d3c8-416f-92d4-8c78a6a9ed23 None admin] PATH_INFO: `/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/6693dd1ea26049c1ac8460faf1bc9b63/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:08.321078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d2041-d3c8-416f-92d4-8c78a6a9ed23 None admin] RBAC: Authorizing `identity:create_grant(project_id=52dd45fcba114e3f8ff40d8b954ee5cc, user_id=6693dd1ea26049c1ac8460faf1bc9b63, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:08.322513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d2041-d3c8-416f-92d4-8c78a6a9ed23 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:08.334423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 627/1273] 10.222.0.66 () {58 vars in 1439 bytes} [Fri Jul 15 20:27:08 2022] PUT /identity/v3/projects/52dd45fcba114e3f8ff40d8b954ee5cc/users/6693dd1ea26049c1ac8460faf1bc9b63/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:27:10.329720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba068c80-94b6-4240-b716-743a468b7848 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:10.330309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba068c80-94b6-4240-b716-743a468b7848 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:10.330309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba068c80-94b6-4240-b716-743a468b7848 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:10.331645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 647/1274] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:27:10.336724 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ca9c0-52f7-4b36-aea2-11455a541a56 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:10.337086 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ca9c0-52f7-4b36-aea2-11455a541a56 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:10.337299 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ca9c0-52f7-4b36-aea2-11455a541a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:10.354229 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-673ca9c0-52f7-4b36-aea2-11455a541a56 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:27:10.355410 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-673ca9c0-52f7-4b36-aea2-11455a541a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:27:10.421288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 628/1275] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:27:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:27:10.443893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba068c80-94b6-4240-b716-743a468b7848 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:10.545246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba068c80-94b6-4240-b716-743a468b7848 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:10.561825 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:10.578359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503c51f-faed-429a-bbbb-1b90a2ff6619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:10.579143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503c51f-faed-429a-bbbb-1b90a2ff6619 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:10.579430 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503c51f-faed-429a-bbbb-1b90a2ff6619 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:10.579708 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503c51f-faed-429a-bbbb-1b90a2ff6619 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:10.589650 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503c51f-faed-429a-bbbb-1b90a2ff6619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2503c51f-faed-429a-bbbb-1b90a2ff6619 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 20:27:10.598007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:10.599106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:10.599999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:10.599999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:10.599999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:10.599999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:10.599999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 20:27:10.599999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 20:27:10.599999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 20:27:10.599999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 20:27:10.599999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 20:27:10.599999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 20:27:10.599999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 20:27:10.599999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:27:10.599999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 648/1276] 10.222.0.66 () {56 vars in 1096 bytes} [Fri Jul 15 20:27:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:10.605201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ca9c0-52f7-4b36-aea2-11455a541a56 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:10.683295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:10.703028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ca9c0-52f7-4b36-aea2-11455a541a56 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:10.736785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20694c44-ea19-4ab1-b887-b399750f9664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:10.737447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20694c44-ea19-4ab1-b887-b399750f9664 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:10.737733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20694c44-ea19-4ab1-b887-b399750f9664 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:10.738012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20694c44-ea19-4ab1-b887-b399750f9664 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:10.738746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20694c44-ea19-4ab1-b887-b399750f9664 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:10.739053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20694c44-ea19-4ab1-b887-b399750f9664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:10.740437 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20694c44-ea19-4ab1-b887-b399750f9664 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:10.748483 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 629/1277] 10.222.0.66 () {56 vars in 1099 bytes} [Fri Jul 15 20:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:10.754292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503c51f-faed-429a-bbbb-1b90a2ff6619 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:10.852692 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503c51f-faed-429a-bbbb-1b90a2ff6619 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:10.884294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdb61b-ebc1-42fd-9136-c6c41a790661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:10.885106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdb61b-ebc1-42fd-9136-c6c41a790661 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:10.885391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdb61b-ebc1-42fd-9136-c6c41a790661 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:10.885667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdb61b-ebc1-42fd-9136-c6c41a790661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:10.896416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbdb61b-ebc1-42fd-9136-c6c41a790661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:10.897853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbdb61b-ebc1-42fd-9136-c6c41a790661 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-7bbdb61b-ebc1-42fd-9136-c6c41a790661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:27:10.915096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:10.916136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:10.917513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:27:10.917513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:27:10.917513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:27:10.917513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:27:10.917513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 649/1278] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:10.922176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20694c44-ea19-4ab1-b887-b399750f9664 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:11.019484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20694c44-ea19-4ab1-b887-b399750f9664 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:11.052318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17372b-945b-4ca3-8c8b-dfdc941d1d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:11.052993 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17372b-945b-4ca3-8c8b-dfdc941d1d0d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:11.053280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17372b-945b-4ca3-8c8b-dfdc941d1d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:11.053561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17372b-945b-4ca3-8c8b-dfdc941d1d0d None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:11.054275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17372b-945b-4ca3-8c8b-dfdc941d1d0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:11.054590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17372b-945b-4ca3-8c8b-dfdc941d1d0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:11.055953 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17372b-945b-4ca3-8c8b-dfdc941d1d0d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:11.067300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 630/1279] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:27:11.072894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdb61b-ebc1-42fd-9136-c6c41a790661 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:11.103830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:11.170627 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdb61b-ebc1-42fd-9136-c6c41a790661 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:11.208699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fec83-4ccf-438e-a80d-f136b9bcebf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:11.209648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fec83-4ccf-438e-a80d-f136b9bcebf3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:11.209921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fec83-4ccf-438e-a80d-f136b9bcebf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:11.210248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fec83-4ccf-438e-a80d-f136b9bcebf3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:11.219104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fec83-4ccf-438e-a80d-f136b9bcebf3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:11.220581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fec83-4ccf-438e-a80d-f136b9bcebf3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a93fec83-4ccf-438e-a80d-f136b9bcebf3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 20:27:11.235644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:11.236783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:11.237947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:11.237947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:11.237947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 20:27:11.237947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 20:27:11.237947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 20:27:11.237947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 20:27:11.237947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 20:27:11.237947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 20:27:11.237947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 20:27:11.237947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:27:11.237947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 650/1280] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:27:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:11.242660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17372b-945b-4ca3-8c8b-dfdc941d1d0d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:11.246365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:11.340601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17372b-945b-4ca3-8c8b-dfdc941d1d0d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:11.374246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb989d-d694-48ca-826a-8f65f592d07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:11.374839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb989d-d694-48ca-826a-8f65f592d07a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:11.375121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb989d-d694-48ca-826a-8f65f592d07a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:11.375399 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb989d-d694-48ca-826a-8f65f592d07a None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:11.376229 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb989d-d694-48ca-826a-8f65f592d07a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:11.376568 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb989d-d694-48ca-826a-8f65f592d07a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:11.377991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb989d-d694-48ca-826a-8f65f592d07a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:11.395345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 631/1281] 10.222.0.66 () {56 vars in 1143 bytes} [Fri Jul 15 20:27:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:11.401014 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fec83-4ccf-438e-a80d-f136b9bcebf3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:11.492132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:11.502576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fec83-4ccf-438e-a80d-f136b9bcebf3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:11.536576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93461b8e-d03d-4590-81e3-39203e620a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:11.537476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93461b8e-d03d-4590-81e3-39203e620a9a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:11.537764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93461b8e-d03d-4590-81e3-39203e620a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:11.538044 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93461b8e-d03d-4590-81e3-39203e620a9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:11.604581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93461b8e-d03d-4590-81e3-39203e620a9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:11.606022 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93461b8e-d03d-4590-81e3-39203e620a9a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:11.695724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:11.707302 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 651/1282] 10.222.0.66 () {58 vars in 1282 bytes} [Fri Jul 15 20:27:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 20:27:11.713389 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb989d-d694-48ca-826a-8f65f592d07a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:11.773035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:11.811158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb989d-d694-48ca-826a-8f65f592d07a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:11.845193 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a94ea-5cd8-454c-8a19-25a4d08a3b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:11.845981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a94ea-5cd8-454c-8a19-25a4d08a3b82 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:11.846265 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a94ea-5cd8-454c-8a19-25a4d08a3b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:11.846543 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a94ea-5cd8-454c-8a19-25a4d08a3b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:11.856230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a94ea-5cd8-454c-8a19-25a4d08a3b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:11.858903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a94ea-5cd8-454c-8a19-25a4d08a3b82 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c31a94ea-5cd8-454c-8a19-25a4d08a3b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 20:27:11.876477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:11.877523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:11.878580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 20:27:11.878580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 20:27:11.878580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 20:27:11.878580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:27:11.878580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 632/1283] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:11.883481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93461b8e-d03d-4590-81e3-39203e620a9a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:11.979783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93461b8e-d03d-4590-81e3-39203e620a9a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:12.012335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440874-e2ee-438b-a93d-c3c0c5d4bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:12.013661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440874-e2ee-438b-a93d-c3c0c5d4bcca None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:12.013948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440874-e2ee-438b-a93d-c3c0c5d4bcca None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:12.014225 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440874-e2ee-438b-a93d-c3c0c5d4bcca None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:12.014940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94440874-e2ee-438b-a93d-c3c0c5d4bcca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:12.015251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94440874-e2ee-438b-a93d-c3c0c5d4bcca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:12.016630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94440874-e2ee-438b-a93d-c3c0c5d4bcca None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:12.027468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 652/1284] 10.222.0.66 () {56 vars in 1109 bytes} [Fri Jul 15 20:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:12.033122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a94ea-5cd8-454c-8a19-25a4d08a3b82 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:12.130493 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a94ea-5cd8-454c-8a19-25a4d08a3b82 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:12.144348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:12.164186 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f831a-bab0-4516-a0b2-9a7e29e5cbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:12.164992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f831a-bab0-4516-a0b2-9a7e29e5cbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:12.165274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f831a-bab0-4516-a0b2-9a7e29e5cbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:12.165549 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f831a-bab0-4516-a0b2-9a7e29e5cbf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:12.172199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f831a-bab0-4516-a0b2-9a7e29e5cbf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:12.173660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f831a-bab0-4516-a0b2-9a7e29e5cbf9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-497f831a-bab0-4516-a0b2-9a7e29e5cbf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 20:27:12.189517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:12.190460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:12.191370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 20:27:12.191370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 20:27:12.191370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 20:27:12.191370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 20:27:12.191370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 20:27:12.191370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 20:27:12.191370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 20:27:12.191370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 15 20:27:12.191370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 633/1285] 10.222.0.66 () {56 vars in 1111 bytes} [Fri Jul 15 20:27:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 20:27:12.196825 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440874-e2ee-438b-a93d-c3c0c5d4bcca None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:12.248351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:12.297487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440874-e2ee-438b-a93d-c3c0c5d4bcca None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:12.329895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466bd77-f71b-4b44-b448-a605b3e048c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:12.330542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466bd77-f71b-4b44-b448-a605b3e048c4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:12.330823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466bd77-f71b-4b44-b448-a605b3e048c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:12.331094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466bd77-f71b-4b44-b448-a605b3e048c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:12.331867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466bd77-f71b-4b44-b448-a605b3e048c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:12.332168 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466bd77-f71b-4b44-b448-a605b3e048c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:12.333607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466bd77-f71b-4b44-b448-a605b3e048c4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:12.345779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 653/1286] 10.222.0.66 () {56 vars in 1148 bytes} [Fri Jul 15 20:27:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:12.351829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f831a-bab0-4516-a0b2-9a7e29e5cbf9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:12.450746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f831a-bab0-4516-a0b2-9a7e29e5cbf9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:12.483568 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d643ee-b660-4017-b936-200506bfabe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:12.484215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d643ee-b660-4017-b936-200506bfabe7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:12.484526 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d643ee-b660-4017-b936-200506bfabe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:12.484805 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d643ee-b660-4017-b936-200506bfabe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:12.485627 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d643ee-b660-4017-b936-200506bfabe7 None admin] RBAC: Adding query filter params (role.id=43e0afe364894278be44a97662ca6f8e, scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc, user.id=6693dd1ea26049c1ac8460faf1bc9b63) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:12.485937 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d643ee-b660-4017-b936-200506bfabe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:12.487355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d643ee-b660-4017-b936-200506bfabe7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:12.493023 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 634/1287] 10.222.0.66 () {56 vars in 1374 bytes} [Fri Jul 15 20:27:12 2022] GET /identity/v3/role_assignments?user.id=6693dd1ea26049c1ac8460faf1bc9b63&scope.project.id=52dd45fcba114e3f8ff40d8b954ee5cc&role.id=43e0afe364894278be44a97662ca6f8e => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:14.511074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a09ff5-58c4-4a58-acbd-f7df7a7bbe9f None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:14.511598 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a09ff5-58c4-4a58-acbd-f7df7a7bbe9f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:14.511700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a09ff5-58c4-4a58-acbd-f7df7a7bbe9f None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:14.513154 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 654/1288] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:27:14.518140 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccd3ee-3f7a-4fca-873b-4c790136461a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:14.518577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccd3ee-3f7a-4fca-873b-4c790136461a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:14.518701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccd3ee-3f7a-4fca-873b-4c790136461a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:14.535047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-21ccd3ee-3f7a-4fca-873b-4c790136461a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:27:14.536210 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-21ccd3ee-3f7a-4fca-873b-4c790136461a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:27:14.565754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:14.602043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 635/1289] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:27:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:27:14.624478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a09ff5-58c4-4a58-acbd-f7df7a7bbe9f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:14.722209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a09ff5-58c4-4a58-acbd-f7df7a7bbe9f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:14.732897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:14.755647 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4a7b7-4704-4c90-ad4a-2a0aa0f5def4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:14.756462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4a7b7-4704-4c90-ad4a-2a0aa0f5def4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:14.756752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4a7b7-4704-4c90-ad4a-2a0aa0f5def4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:14.757029 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4a7b7-4704-4c90-ad4a-2a0aa0f5def4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:14.757682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4a7b7-4704-4c90-ad4a-2a0aa0f5def4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:14.759071 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4a7b7-4704-4c90-ad4a-2a0aa0f5def4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c6d4a7b7-4704-4c90-ad4a-2a0aa0f5def4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:14.771182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:14.772486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:27:14.773582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 655/1290] 10.222.0.66 () {56 vars in 1117 bytes} [Fri Jul 15 20:27:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:14.778848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccd3ee-3f7a-4fca-873b-4c790136461a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:14.876443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccd3ee-3f7a-4fca-873b-4c790136461a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:14.910228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717378d-63a0-4e70-bb06-99a2196840db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:14.910882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717378d-63a0-4e70-bb06-99a2196840db None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:14.911169 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717378d-63a0-4e70-bb06-99a2196840db None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:14.911447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717378d-63a0-4e70-bb06-99a2196840db None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:14.912431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717378d-63a0-4e70-bb06-99a2196840db None admin] RBAC: Adding query filter params (name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:14.912747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717378d-63a0-4e70-bb06-99a2196840db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:14.914120 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717378d-63a0-4e70-bb06-99a2196840db None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:14.919103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 636/1291] 10.222.0.66 () {56 vars in 1116 bytes} [Fri Jul 15 20:27:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:14.924890 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4a7b7-4704-4c90-ad4a-2a0aa0f5def4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:15.027949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4a7b7-4704-4c90-ad4a-2a0aa0f5def4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:15.060813 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710646d-ed24-44b2-8445-31d7813014ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:15.061468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710646d-ed24-44b2-8445-31d7813014ce None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:15.061754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710646d-ed24-44b2-8445-31d7813014ce None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:15.062032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710646d-ed24-44b2-8445-31d7813014ce None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:15.062727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710646d-ed24-44b2-8445-31d7813014ce None admin] RBAC: Adding query filter params (type=placement) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:15.063035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710646d-ed24-44b2-8445-31d7813014ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:15.064433 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710646d-ed24-44b2-8445-31d7813014ce None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:15.068784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 656/1292] 10.222.0.66 () {56 vars in 1116 bytes} [Fri Jul 15 20:27:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:17.065793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d3f0-beec-449f-b48e-d0e5806986a9 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:17.066341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d3f0-beec-449f-b48e-d0e5806986a9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:17.066341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d3f0-beec-449f-b48e-d0e5806986a9 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:17.067703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 637/1293] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:27:17.072790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96330672-1f0a-443d-8e62-d203d98bb368 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:17.073174 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96330672-1f0a-443d-8e62-d203d98bb368 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:17.073359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96330672-1f0a-443d-8e62-d203d98bb368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:17.090495 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-96330672-1f0a-443d-8e62-d203d98bb368 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:27:17.092315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-96330672-1f0a-443d-8e62-d203d98bb368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:27:17.120883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:17.158090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 657/1294] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:27:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:27:17.180441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0d3f0-beec-449f-b48e-d0e5806986a9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:17.216494 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:17.295035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0d3f0-beec-449f-b48e-d0e5806986a9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:17.328496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e5df9-970e-4e62-8935-3d1aec7bcb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:17.329028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5df9-970e-4e62-8935-3d1aec7bcb90 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:17.329315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5df9-970e-4e62-8935-3d1aec7bcb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:17.329596 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5df9-970e-4e62-8935-3d1aec7bcb90 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:17.330329 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e5df9-970e-4e62-8935-3d1aec7bcb90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:17.331694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e5df9-970e-4e62-8935-3d1aec7bcb90 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:17.344381 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 638/1295] 10.222.0.66 () {60 vars in 1141 bytes} [Fri Jul 15 20:27:17 2022] POST /identity/v3/services => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:27:19.352618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1924c-428f-43cd-ab03-a78bdca08b3c None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:19.353161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1924c-428f-43cd-ab03-a78bdca08b3c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:19.353161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1924c-428f-43cd-ab03-a78bdca08b3c None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:19.354551 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 658/1296] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:27:19.359894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a15ec-9746-4b9e-a3ae-3e4a398e9a10 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:19.360309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a15ec-9746-4b9e-a3ae-3e4a398e9a10 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:19.360490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a15ec-9746-4b9e-a3ae-3e4a398e9a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:19.377231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ad4a15ec-9746-4b9e-a3ae-3e4a398e9a10 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:27:19.378406 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ad4a15ec-9746-4b9e-a3ae-3e4a398e9a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:27:19.449024 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 639/1297] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:27:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:27:19.472231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1924c-428f-43cd-ab03-a78bdca08b3c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:19.570734 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1924c-428f-43cd-ab03-a78bdca08b3c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:19.603581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914d4b-0d85-493c-a01c-819f36e90eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:19.604304 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914d4b-0d85-493c-a01c-819f36e90eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:19.604618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914d4b-0d85-493c-a01c-819f36e90eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:19.604897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914d4b-0d85-493c-a01c-819f36e90eb5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:19.605550 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86914d4b-0d85-493c-a01c-819f36e90eb5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:19.607097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86914d4b-0d85-493c-a01c-819f36e90eb5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-86914d4b-0d85-493c-a01c-819f36e90eb5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:19.618674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:19.619862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:27:19.621009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 659/1298] 10.222.0.66 () {56 vars in 1117 bytes} [Fri Jul 15 20:27:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:19.626672 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a15ec-9746-4b9e-a3ae-3e4a398e9a10 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:19.644971 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:19.723952 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a15ec-9746-4b9e-a3ae-3e4a398e9a10 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:19.757682 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004c982-52c8-4f30-8250-70c067564353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:19.758335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004c982-52c8-4f30-8250-70c067564353 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:19.758621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004c982-52c8-4f30-8250-70c067564353 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:19.758894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004c982-52c8-4f30-8250-70c067564353 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:19.759592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004c982-52c8-4f30-8250-70c067564353 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:19.759899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004c982-52c8-4f30-8250-70c067564353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:19.761282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004c982-52c8-4f30-8250-70c067564353 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:19.766261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 640/1299] 10.222.0.66 () {56 vars in 1116 bytes} [Fri Jul 15 20:27:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:19.772064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914d4b-0d85-493c-a01c-819f36e90eb5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:19.804691 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:19.871685 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914d4b-0d85-493c-a01c-819f36e90eb5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:19.904083 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466f703-62e3-4add-b4e3-7f472e0613d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:19.904759 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466f703-62e3-4add-b4e3-7f472e0613d4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:19.905044 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466f703-62e3-4add-b4e3-7f472e0613d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:19.905318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466f703-62e3-4add-b4e3-7f472e0613d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:19.906101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466f703-62e3-4add-b4e3-7f472e0613d4 None admin] RBAC: Adding query filter params (interface=public, service_id=c35307c368164dc0a4672c330bf9f830, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:19.906410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466f703-62e3-4add-b4e3-7f472e0613d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:19.907769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466f703-62e3-4add-b4e3-7f472e0613d4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:19.912918 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 660/1300] 10.222.0.66 () {56 vars in 1251 bytes} [Fri Jul 15 20:27:19 2022] GET /identity/v3/endpoints?service_id=c35307c368164dc0a4672c330bf9f830&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:19.919099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004c982-52c8-4f30-8250-70c067564353 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:20.001240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:20.019376 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004c982-52c8-4f30-8250-70c067564353 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:20.052969 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ebf26-c637-4440-be3f-f4688743d58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:20.053622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ebf26-c637-4440-be3f-f4688743d58c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:20.053909 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ebf26-c637-4440-be3f-f4688743d58c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:20.054190 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ebf26-c637-4440-be3f-f4688743d58c None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:20.054866 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ebf26-c637-4440-be3f-f4688743d58c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:20.056230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ebf26-c637-4440-be3f-f4688743d58c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:20.063758 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 641/1301] 10.222.0.66 () {56 vars in 1087 bytes} [Fri Jul 15 20:27:19 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:27:22.047979 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704f2a5-02b4-4cd6-85d7-c7b8287cc72b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:22.048544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704f2a5-02b4-4cd6-85d7-c7b8287cc72b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:22.048655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704f2a5-02b4-4cd6-85d7-c7b8287cc72b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:22.049943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 661/1302] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:27:22.054954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf986848-0b79-443c-ba44-ec113bc643c5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:22.055317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf986848-0b79-443c-ba44-ec113bc643c5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:22.055501 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf986848-0b79-443c-ba44-ec113bc643c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:22.072368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cf986848-0b79-443c-ba44-ec113bc643c5 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:27:22.073566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cf986848-0b79-443c-ba44-ec113bc643c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:27:22.137600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 642/1303] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:27:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 20:27:22.159309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704f2a5-02b4-4cd6-85d7-c7b8287cc72b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:22.252617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:22.259415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704f2a5-02b4-4cd6-85d7-c7b8287cc72b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:22.291725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a07b0-a985-49aa-aa26-0c0e8364ece2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:22.292534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a07b0-a985-49aa-aa26-0c0e8364ece2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:22.292820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a07b0-a985-49aa-aa26-0c0e8364ece2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:22.293096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a07b0-a985-49aa-aa26-0c0e8364ece2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:22.294260 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a07b0-a985-49aa-aa26-0c0e8364ece2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:22.295608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a07b0-a985-49aa-aa26-0c0e8364ece2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-292a07b0-a985-49aa-aa26-0c0e8364ece2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 20:27:22.307410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 20:27:22.308604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 20:27:22.310794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 20:27:22.310794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 15 20:27:22.310794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 20:27:22.310794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 15 20:27:22.310794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 20:27:22.310794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 20:27:22.310794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 20:27:22.310794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 15 20:27:22.310794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 20:27:22.310794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 15 20:27:22.310794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 20:27:22.310794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 20:27:22.310794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 20:27:22.310794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 15 20:27:22.311980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 662/1304] 10.222.0.66 () {56 vars in 1117 bytes} [Fri Jul 15 20:27:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 20:27:22.316957 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf986848-0b79-443c-ba44-ec113bc643c5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:22.391330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:22.414456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf986848-0b79-443c-ba44-ec113bc643c5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:22.447669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317614b8-c72a-4873-bbc5-e5c749e2e2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:22.448328 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317614b8-c72a-4873-bbc5-e5c749e2e2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:22.448641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317614b8-c72a-4873-bbc5-e5c749e2e2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:22.448921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317614b8-c72a-4873-bbc5-e5c749e2e2d1 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:22.449622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317614b8-c72a-4873-bbc5-e5c749e2e2d1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:27:22.450114 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317614b8-c72a-4873-bbc5-e5c749e2e2d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:22.451748 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317614b8-c72a-4873-bbc5-e5c749e2e2d1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:22.457578 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 643/1305] 10.222.0.66 () {56 vars in 1116 bytes} [Fri Jul 15 20:27:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:27:22.462882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a07b0-a985-49aa-aa26-0c0e8364ece2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:27:22.560221 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a07b0-a985-49aa-aa26-0c0e8364ece2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:27:22.592141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dff7a-6701-4a75-ad17-75ab82b93b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:27:22.592807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dff7a-6701-4a75-ad17-75ab82b93b49 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:27:22.593095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dff7a-6701-4a75-ad17-75ab82b93b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:27:22.593372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dff7a-6701-4a75-ad17-75ab82b93b49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:27:22.594114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dff7a-6701-4a75-ad17-75ab82b93b49 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:27:22.595462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dff7a-6701-4a75-ad17-75ab82b93b49 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:27:22.613059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 663/1306] 10.222.0.66 () {60 vars in 1144 bytes} [Fri Jul 15 20:27:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:27:32.454528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=30 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:27:32.608829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:25.575848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41048a11-6b1a-4e3e-b1fe-4d587381af96 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:25.576473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41048a11-6b1a-4e3e-b1fe-4d587381af96 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:25.576711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41048a11-6b1a-4e3e-b1fe-4d587381af96 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:25.578416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 644/1307] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:28:25.583831 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e0e19-bade-4e02-8fab-4b5cc0e6e916 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:25.584810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e0e19-bade-4e02-8fab-4b5cc0e6e916 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:25.585257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e0e19-bade-4e02-8fab-4b5cc0e6e916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:25.676812 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-369e0e19-bade-4e02-8fab-4b5cc0e6e916 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:28:25.678252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-369e0e19-bade-4e02-8fab-4b5cc0e6e916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:25.916616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 664/1308] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:28:25.979162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d139031-6e97-44f1-bb8a-cbac7355279d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:25.979635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d139031-6e97-44f1-bb8a-cbac7355279d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:25.980647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d139031-6e97-44f1-bb8a-cbac7355279d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:25.982379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 645/1309] 10.222.0.66 () {54 vars in 964 bytes} [Fri Jul 15 20:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:28:25.991805 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9b969-c9c6-47c8-b203-a0b68d171dc4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:25.992110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9b969-c9c6-47c8-b203-a0b68d171dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:25.992371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9b969-c9c6-47c8-b203-a0b68d171dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:26.072927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ccd9b969-c9c6-47c8-b203-a0b68d171dc4 None None] MFA Rules not processed for user `633e05f021544b669749f941f40cbf58`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:28:26.074406 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ccd9b969-c9c6-47c8-b203-a0b68d171dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:26.095837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:26.154193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 665/1310] 10.222.0.66 () {58 vars in 1061 bytes} [Fri Jul 15 20:28:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:28:26.163300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d139031-6e97-44f1-bb8a-cbac7355279d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:28:26.165041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2d139031-6e97-44f1-bb8a-cbac7355279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:26.278646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d139031-6e97-44f1-bb8a-cbac7355279d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:28:26.354475 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb990e-0382-4e51-b7ce-0fefc942bb09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:28:26.355720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb990e-0382-4e51-b7ce-0fefc942bb09 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:26.355997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb990e-0382-4e51-b7ce-0fefc942bb09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:26.356273 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb990e-0382-4e51-b7ce-0fefc942bb09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:26.357963 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bceb990e-0382-4e51-b7ce-0fefc942bb09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:26.414312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:26.481605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb990e-0382-4e51-b7ce-0fefc942bb09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:28:26.483058 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb990e-0382-4e51-b7ce-0fefc942bb09 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:28:26.502359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 646/1311] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:28:28.884876 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222fa83-52ab-48b3-8875-1235155fe3a1 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:28.885410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222fa83-52ab-48b3-8875-1235155fe3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:28.885410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222fa83-52ab-48b3-8875-1235155fe3a1 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:28.892652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 666/1312] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:28:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:28:28.894305 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7806853-2aaf-49e4-bfea-63ddcc6c5876 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:28.894779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7806853-2aaf-49e4-bfea-63ddcc6c5876 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:28.894877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7806853-2aaf-49e4-bfea-63ddcc6c5876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:28.984823 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f7806853-2aaf-49e4-bfea-63ddcc6c5876 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:28:28.986064 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f7806853-2aaf-49e4-bfea-63ddcc6c5876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:29.104435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 647/1313] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:28:29.142312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222fa83-52ab-48b3-8875-1235155fe3a1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:28:29.143900 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e222fa83-52ab-48b3-8875-1235155fe3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:29.260277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222fa83-52ab-48b3-8875-1235155fe3a1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:28:29.335401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:29.338780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3359534-b58d-443f-83be-1dbc4a16801e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:28:29.340466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3359534-b58d-443f-83be-1dbc4a16801e service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:29.344565 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3359534-b58d-443f-83be-1dbc4a16801e service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:29.345300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3359534-b58d-443f-83be-1dbc4a16801e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:29.347592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a3359534-b58d-443f-83be-1dbc4a16801e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:29.479131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3359534-b58d-443f-83be-1dbc4a16801e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:28:29.481605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3359534-b58d-443f-83be-1dbc4a16801e service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:28:29.501834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 667/1314] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:28:31.872761 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e306d3f-07ce-413b-a37d-26c2592413df None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:31.873289 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e306d3f-07ce-413b-a37d-26c2592413df None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:31.873289 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e306d3f-07ce-413b-a37d-26c2592413df None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:31.874614 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 648/1315] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:28:31.879911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043b34c-cd74-453b-bb81-ece2da97483a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:31.880308 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043b34c-cd74-453b-bb81-ece2da97483a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:31.880490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043b34c-cd74-453b-bb81-ece2da97483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:31.943028 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b043b34c-cd74-453b-bb81-ece2da97483a None None] MFA Rules not processed for user `b4aad040a05d4df4a45e2326d9581c12`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:28:31.944241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b043b34c-cd74-453b-bb81-ece2da97483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:31.994491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:32.038726 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 668/1316] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:28:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:28:32.078618 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e306d3f-07ce-413b-a37d-26c2592413df None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:28:32.080176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2e306d3f-07ce-413b-a37d-26c2592413df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:32.090560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:32.186836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e306d3f-07ce-413b-a37d-26c2592413df None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:28:32.258260 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ca9a6-88a0-4924-b75d-8bbe4ea52f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:28:32.258913 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ca9a6-88a0-4924-b75d-8bbe4ea52f29 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:32.259199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ca9a6-88a0-4924-b75d-8bbe4ea52f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:32.259478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ca9a6-88a0-4924-b75d-8bbe4ea52f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:32.261163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aa9ca9a6-88a0-4924-b75d-8bbe4ea52f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:32.323319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:32.370342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ca9a6-88a0-4924-b75d-8bbe4ea52f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:28:32.372497 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ca9a6-88a0-4924-b75d-8bbe4ea52f29 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:28:32.391240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 649/1317] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:28:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:28:34.963966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6cd0-f677-405c-b323-aa730168ce44 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:34.964557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6cd0-f677-405c-b323-aa730168ce44 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:34.964688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6cd0-f677-405c-b323-aa730168ce44 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:34.966091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 669/1318] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:28:34.971302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6a9d8-8699-4be7-a374-589963f11dfc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:34.971710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6a9d8-8699-4be7-a374-589963f11dfc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:34.971854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6a9d8-8699-4be7-a374-589963f11dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:35.038035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b2d6a9d8-8699-4be7-a374-589963f11dfc None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:28:35.039499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b2d6a9d8-8699-4be7-a374-589963f11dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:35.133540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 650/1319] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:28:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:28:35.173161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de6cd0-f677-405c-b323-aa730168ce44 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:28:35.174669 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-89de6cd0-f677-405c-b323-aa730168ce44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:35.276524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de6cd0-f677-405c-b323-aa730168ce44 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:28:35.359155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddcf66-bdd3-4557-93aa-8f043bc994dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:28:35.359799 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddcf66-bdd3-4557-93aa-8f043bc994dc service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:35.360081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddcf66-bdd3-4557-93aa-8f043bc994dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:35.360353 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddcf66-bdd3-4557-93aa-8f043bc994dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:35.362016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e2ddcf66-bdd3-4557-93aa-8f043bc994dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:35.369220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:35.470684 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddcf66-bdd3-4557-93aa-8f043bc994dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:28:35.472126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddcf66-bdd3-4557-93aa-8f043bc994dc service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:28:35.491165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 670/1320] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:28:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:28:38.178811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f787d-d3e8-464d-9ddc-90432f9dd567 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:38.179344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f787d-d3e8-464d-9ddc-90432f9dd567 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:38.179469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f787d-d3e8-464d-9ddc-90432f9dd567 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:38.180775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 651/1321] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:28:38.186468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913f687-a2e6-4bdf-ae1b-7822a9130685 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:38.186846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913f687-a2e6-4bdf-ae1b-7822a9130685 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:38.187145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913f687-a2e6-4bdf-ae1b-7822a9130685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:38.252657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1913f687-a2e6-4bdf-ae1b-7822a9130685 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:28:38.253872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1913f687-a2e6-4bdf-ae1b-7822a9130685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:38.312026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:38.356173 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 671/1322] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:28:38.395103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f787d-d3e8-464d-9ddc-90432f9dd567 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:28:38.396715 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-992f787d-d3e8-464d-9ddc-90432f9dd567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:38.418894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:38.514437 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f787d-d3e8-464d-9ddc-90432f9dd567 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:28:38.591138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5a947-2d0f-4c3c-9f7f-e7cce32d23ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:28:38.591792 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5a947-2d0f-4c3c-9f7f-e7cce32d23ab service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:38.592076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5a947-2d0f-4c3c-9f7f-e7cce32d23ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:38.592352 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5a947-2d0f-4c3c-9f7f-e7cce32d23ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:38.594035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-62f5a947-2d0f-4c3c-9f7f-e7cce32d23ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:38.669125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:38.708330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5a947-2d0f-4c3c-9f7f-e7cce32d23ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:28:38.709739 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5a947-2d0f-4c3c-9f7f-e7cce32d23ab service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:28:38.728243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 652/1323] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:28:40.792313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748bb9d-aaa4-4d6c-823f-dd0e4d3d44d9 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:40.792844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748bb9d-aaa4-4d6c-823f-dd0e4d3d44d9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:40.792844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748bb9d-aaa4-4d6c-823f-dd0e4d3d44d9 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:40.794233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 672/1324] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:28:40.799527 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211a363-5400-4f77-8639-0ce6a68d6c98 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:40.799922 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211a363-5400-4f77-8639-0ce6a68d6c98 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:40.800209 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211a363-5400-4f77-8639-0ce6a68d6c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:40.866101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9211a363-5400-4f77-8639-0ce6a68d6c98 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:28:40.867211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9211a363-5400-4f77-8639-0ce6a68d6c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:40.966784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 653/1325] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:28:41.001673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748bb9d-aaa4-4d6c-823f-dd0e4d3d44d9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:28:41.003208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0748bb9d-aaa4-4d6c-823f-dd0e4d3d44d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:41.108641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748bb9d-aaa4-4d6c-823f-dd0e4d3d44d9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:28:41.184419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990c9b1-0b28-47f1-ac57-bb1e46751641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:28:41.185065 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c9b1-0b28-47f1-ac57-bb1e46751641 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:41.185665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c9b1-0b28-47f1-ac57-bb1e46751641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:41.185952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c9b1-0b28-47f1-ac57-bb1e46751641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:41.187925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f990c9b1-0b28-47f1-ac57-bb1e46751641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:41.205554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:41.304466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990c9b1-0b28-47f1-ac57-bb1e46751641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:28:41.305906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990c9b1-0b28-47f1-ac57-bb1e46751641 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:28:41.325359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 673/1326] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:28:43.417009 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8f664-3e7e-41ff-b7d6-afc58f120a24 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:43.418157 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8f664-3e7e-41ff-b7d6-afc58f120a24 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:43.418157 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8f664-3e7e-41ff-b7d6-afc58f120a24 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:43.419683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 654/1327] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:28:43.424824 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d320-9f65-4039-afeb-70a5ece59e51 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:43.425250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d320-9f65-4039-afeb-70a5ece59e51 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:43.425541 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d320-9f65-4039-afeb-70a5ece59e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:43.492626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-acc3d320-9f65-4039-afeb-70a5ece59e51 None None] MFA Rules not processed for user `b4aad040a05d4df4a45e2326d9581c12`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:28:43.493851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-acc3d320-9f65-4039-afeb-70a5ece59e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:43.564248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:43.598072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 674/1328] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:28:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:28:43.638887 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8f664-3e7e-41ff-b7d6-afc58f120a24 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:28:43.640482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-45e8f664-3e7e-41ff-b7d6-afc58f120a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:43.674767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:43.749596 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8f664-3e7e-41ff-b7d6-afc58f120a24 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:28:43.826348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffab0dc-4a15-4166-9439-3d45f1588036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:28:43.826924 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffab0dc-4a15-4166-9439-3d45f1588036 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:43.827209 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffab0dc-4a15-4166-9439-3d45f1588036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:43.827492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffab0dc-4a15-4166-9439-3d45f1588036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:43.829195 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0ffab0dc-4a15-4166-9439-3d45f1588036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:43.909388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:43.942409 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffab0dc-4a15-4166-9439-3d45f1588036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:28:43.943871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffab0dc-4a15-4166-9439-3d45f1588036 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:28:43.961868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 655/1329] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:28:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:28:46.294115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2939e-9295-41fa-bd30-1dd05911f562 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:46.294712 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2939e-9295-41fa-bd30-1dd05911f562 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:46.294712 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2939e-9295-41fa-bd30-1dd05911f562 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:46.296054 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 675/1330] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:28:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:28:46.301489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334f794-83eb-4dad-b06c-505e270824fd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:46.301967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334f794-83eb-4dad-b06c-505e270824fd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:46.302062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334f794-83eb-4dad-b06c-505e270824fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:46.369084 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a334f794-83eb-4dad-b06c-505e270824fd None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:28:46.370388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a334f794-83eb-4dad-b06c-505e270824fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:46.477641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 656/1331] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:28:46.514742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2939e-9295-41fa-bd30-1dd05911f562 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:28:46.516301 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5fe2939e-9295-41fa-bd30-1dd05911f562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:46.646897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2939e-9295-41fa-bd30-1dd05911f562 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:28:46.740260 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a02329-47ef-4892-b110-0f633f0f1f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:28:46.740983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a02329-47ef-4892-b110-0f633f0f1f0e service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:46.741328 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a02329-47ef-4892-b110-0f633f0f1f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:46.741648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a02329-47ef-4892-b110-0f633f0f1f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:46.743379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-23a02329-47ef-4892-b110-0f633f0f1f0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:46.776458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:46.865756 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a02329-47ef-4892-b110-0f633f0f1f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:28:46.867208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a02329-47ef-4892-b110-0f633f0f1f0e service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:28:46.887838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 676/1332] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:28:48.956780 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1904d3-7ba0-4415-9842-faf7a947e79a None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:48.957334 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1904d3-7ba0-4415-9842-faf7a947e79a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:48.957334 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1904d3-7ba0-4415-9842-faf7a947e79a None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:48.958715 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 657/1333] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:28:48.963883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21039c27-c269-4ec8-b227-153c009457a4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:48.964274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21039c27-c269-4ec8-b227-153c009457a4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:48.964474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21039c27-c269-4ec8-b227-153c009457a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:49.028536 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-21039c27-c269-4ec8-b227-153c009457a4 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:28:49.029764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-21039c27-c269-4ec8-b227-153c009457a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:49.107313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:49.130695 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 677/1334] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:28:49.170369 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1904d3-7ba0-4415-9842-faf7a947e79a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:28:49.171895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4c1904d3-7ba0-4415-9842-faf7a947e79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:49.211936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:49.275940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1904d3-7ba0-4415-9842-faf7a947e79a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:28:49.348645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615aaf19-7138-4df1-a32c-5353e0682631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:28:49.349289 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615aaf19-7138-4df1-a32c-5353e0682631 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:49.349575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615aaf19-7138-4df1-a32c-5353e0682631 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:49.349856 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615aaf19-7138-4df1-a32c-5353e0682631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:49.351492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-615aaf19-7138-4df1-a32c-5353e0682631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:49.447904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:49.473996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615aaf19-7138-4df1-a32c-5353e0682631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:28:49.475458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615aaf19-7138-4df1-a32c-5353e0682631 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:28:49.494776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 658/1335] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:28:51.804333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13180c79-931d-4a17-b8de-06bee1038818 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:51.804911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13180c79-931d-4a17-b8de-06bee1038818 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:51.804911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13180c79-931d-4a17-b8de-06bee1038818 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:51.806239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 678/1336] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:28:51.812875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affdaff-9379-435e-aed3-554a1de66f1a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:51.813292 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affdaff-9379-435e-aed3-554a1de66f1a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:51.813445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affdaff-9379-435e-aed3-554a1de66f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:51.877152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4affdaff-9379-435e-aed3-554a1de66f1a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:28:51.878356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4affdaff-9379-435e-aed3-554a1de66f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:51.975497 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 659/1337] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:28:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:28:52.012549 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13180c79-931d-4a17-b8de-06bee1038818 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:28:52.014108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-13180c79-931d-4a17-b8de-06bee1038818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:52.119964 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13180c79-931d-4a17-b8de-06bee1038818 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:28:52.194655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6179f-189c-45b7-871a-c9d360c73b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:28:52.195323 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6179f-189c-45b7-871a-c9d360c73b0c service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:52.195653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6179f-189c-45b7-871a-c9d360c73b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:52.195975 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6179f-189c-45b7-871a-c9d360c73b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:52.197843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1ad6179f-189c-45b7-871a-c9d360c73b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:52.237674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:52.311888 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6179f-189c-45b7-871a-c9d360c73b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:28:52.313389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6179f-189c-45b7-871a-c9d360c73b0c service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:28:52.331419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 679/1338] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:28:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:28:56.285654 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b04ed1-2fb9-464f-80d8-e1bac90039d0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:56.286147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b04ed1-2fb9-464f-80d8-e1bac90039d0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:56.286147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b04ed1-2fb9-464f-80d8-e1bac90039d0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:56.287545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 660/1339] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:28:56.293183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9663b-15cb-4c03-b902-abd566d39cf8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:56.293585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9663b-15cb-4c03-b902-abd566d39cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:56.293894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9663b-15cb-4c03-b902-abd566d39cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:56.361307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-61e9663b-15cb-4c03-b902-abd566d39cf8 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:28:56.362518 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-61e9663b-15cb-4c03-b902-abd566d39cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:56.452593 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:56.465408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 680/1340] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:28:56.505937 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b04ed1-2fb9-464f-80d8-e1bac90039d0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:28:56.507559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-89b04ed1-2fb9-464f-80d8-e1bac90039d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:56.557391 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:56.613719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b04ed1-2fb9-464f-80d8-e1bac90039d0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:28:56.686666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c9246-d4b2-4ad8-aca4-2641fd1d1c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:28:56.687308 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c9246-d4b2-4ad8-aca4-2641fd1d1c71 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:56.687588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c9246-d4b2-4ad8-aca4-2641fd1d1c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:56.687856 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c9246-d4b2-4ad8-aca4-2641fd1d1c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:56.690059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bf3c9246-d4b2-4ad8-aca4-2641fd1d1c71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:56.780804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:56.798310 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c9246-d4b2-4ad8-aca4-2641fd1d1c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:28:56.799767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c9246-d4b2-4ad8-aca4-2641fd1d1c71 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:28:56.819671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 661/1341] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:28:59.497069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9f071-b82b-44bd-a716-d570dc70a77f None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:59.497591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9f071-b82b-44bd-a716-d570dc70a77f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:59.497682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9f071-b82b-44bd-a716-d570dc70a77f None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:59.499029 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 681/1342] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:28:59.504972 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79c41-fa9c-4a28-90bd-17bff757c305 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:59.505527 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79c41-fa9c-4a28-90bd-17bff757c305 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:59.505527 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79c41-fa9c-4a28-90bd-17bff757c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:59.576906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-06a79c41-fa9c-4a28-90bd-17bff757c305 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:28:59.578185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-06a79c41-fa9c-4a28-90bd-17bff757c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:59.678306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 662/1343] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:28:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:28:59.730852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2230c00-f021-4cab-a179-3e8bc10c9557 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:59.731148 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2230c00-f021-4cab-a179-3e8bc10c9557 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:59.731431 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2230c00-f021-4cab-a179-3e8bc10c9557 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:59.732865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 682/1344] 10.222.0.66 () {54 vars in 964 bytes} [Fri Jul 15 20:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:28:59.738806 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379530f-850c-4376-9e93-d5c2bef03d4b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:28:59.739170 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379530f-850c-4376-9e93-d5c2bef03d4b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:28:59.739513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379530f-850c-4376-9e93-d5c2bef03d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:28:59.806068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:28:59.814698 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3379530f-850c-4376-9e93-d5c2bef03d4b None None] MFA Rules not processed for user `633e05f021544b669749f941f40cbf58`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:28:59.815920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3379530f-850c-4376-9e93-d5c2bef03d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:28:59.900839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 663/1345] 10.222.0.66 () {58 vars in 1061 bytes} [Fri Jul 15 20:28:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:28:59.910513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2230c00-f021-4cab-a179-3e8bc10c9557 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:28:59.912048 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d2230c00-f021-4cab-a179-3e8bc10c9557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:00.033282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2230c00-f021-4cab-a179-3e8bc10c9557 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:00.106918 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f68a59-643c-4992-99e6-7f5c4ec158d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:00.107571 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f68a59-643c-4992-99e6-7f5c4ec158d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:00.107853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f68a59-643c-4992-99e6-7f5c4ec158d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:00.108131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f68a59-643c-4992-99e6-7f5c4ec158d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:00.109790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e7f68a59-643c-4992-99e6-7f5c4ec158d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:00.153664 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:00.227522 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f68a59-643c-4992-99e6-7f5c4ec158d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:00.229005 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f68a59-643c-4992-99e6-7f5c4ec158d5 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:00.249111 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 683/1346] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:28:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:29:05.093774 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db1a1a-3734-475f-8d96-8a03391d06e9 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:05.094279 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db1a1a-3734-475f-8d96-8a03391d06e9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:05.094412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db1a1a-3734-475f-8d96-8a03391d06e9 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:05.095710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 664/1347] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:05.100906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233dbe-485b-499f-9f84-87c549d3231e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:05.101307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233dbe-485b-499f-9f84-87c549d3231e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:05.101469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233dbe-485b-499f-9f84-87c549d3231e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:05.174770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-35233dbe-485b-499f-9f84-87c549d3231e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:05.175991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-35233dbe-485b-499f-9f84-87c549d3231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:05.275220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:05.277937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 684/1348] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:29:05.316694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db1a1a-3734-475f-8d96-8a03391d06e9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:05.318243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f1db1a1a-3734-475f-8d96-8a03391d06e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:05.423133 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db1a1a-3734-475f-8d96-8a03391d06e9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:05.473376 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:05.501517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fe58e-6ed8-464d-8294-1739179417f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:05.502180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fe58e-6ed8-464d-8294-1739179417f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:05.502470 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fe58e-6ed8-464d-8294-1739179417f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:05.502748 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fe58e-6ed8-464d-8294-1739179417f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:05.504420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-775fe58e-6ed8-464d-8294-1739179417f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:05.625286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fe58e-6ed8-464d-8294-1739179417f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:05.626741 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fe58e-6ed8-464d-8294-1739179417f5 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:05.644984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 665/1349] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:29:10.546952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b0533-acc2-4a00-b2de-23ecdf27abf6 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:10.546952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b0533-acc2-4a00-b2de-23ecdf27abf6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:10.546952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b0533-acc2-4a00-b2de-23ecdf27abf6 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:10.546952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 685/1350] 10.222.0.66 () {54 vars in 921 bytes} [Fri Jul 15 20:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:10.552700 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab709b7-181c-4152-a66d-0307459dfa66 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:10.553105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab709b7-181c-4152-a66d-0307459dfa66 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:10.553284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab709b7-181c-4152-a66d-0307459dfa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:10.632437 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-eab709b7-181c-4152-a66d-0307459dfa66 None None] MFA Rules not processed for user `6693dd1ea26049c1ac8460faf1bc9b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:10.633547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eab709b7-181c-4152-a66d-0307459dfa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:10.653521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:10.763139 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 666/1351] 10.222.0.66 () {58 vars in 1018 bytes} [Fri Jul 15 20:29:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:29:14.801576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3a7cb-8d10-4a22-91d0-78b119116086 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:14.802111 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3a7cb-8d10-4a22-91d0-78b119116086 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:14.802518 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3a7cb-8d10-4a22-91d0-78b119116086 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:14.804026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 686/1352] 10.222.0.66 () {54 vars in 921 bytes} [Fri Jul 15 20:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:14.809616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393f8a-1b81-44f9-98ca-3d1a56537532 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:14.810043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393f8a-1b81-44f9-98ca-3d1a56537532 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:14.810190 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393f8a-1b81-44f9-98ca-3d1a56537532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:14.892416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f5393f8a-1b81-44f9-98ca-3d1a56537532 None None] MFA Rules not processed for user `6693dd1ea26049c1ac8460faf1bc9b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:14.893646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f5393f8a-1b81-44f9-98ca-3d1a56537532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:14.970731 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:15.011793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 667/1353] 10.222.0.66 () {58 vars in 1018 bytes} [Fri Jul 15 20:29:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:16.506202 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ff192-cd05-4a90-abbb-726312ed4e01 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:16.506775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ff192-cd05-4a90-abbb-726312ed4e01 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:16.506775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ff192-cd05-4a90-abbb-726312ed4e01 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:16.508147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 687/1354] 10.222.0.66 () {54 vars in 921 bytes} [Fri Jul 15 20:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:16.514427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d300-e046-41ed-bbd7-9672ffc64f90 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:16.514891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d300-e046-41ed-bbd7-9672ffc64f90 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:16.514997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d300-e046-41ed-bbd7-9672ffc64f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:16.594990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-af55d300-e046-41ed-bbd7-9672ffc64f90 None None] MFA Rules not processed for user `6693dd1ea26049c1ac8460faf1bc9b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:16.596184 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-af55d300-e046-41ed-bbd7-9672ffc64f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:16.703046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 668/1355] 10.222.0.66 () {58 vars in 1018 bytes} [Fri Jul 15 20:29:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:20.215783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129268bf-c198-4b29-a686-6b3a93f8b5a4 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:20.217152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129268bf-c198-4b29-a686-6b3a93f8b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:20.217437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129268bf-c198-4b29-a686-6b3a93f8b5a4 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:20.219337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 688/1356] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:20.226036 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c11d8-7b15-4eaf-bf6a-f1f13c6ae286 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:20.226973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c11d8-7b15-4eaf-bf6a-f1f13c6ae286 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:20.227461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c11d8-7b15-4eaf-bf6a-f1f13c6ae286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:20.276719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:20.311124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-041c11d8-7b15-4eaf-bf6a-f1f13c6ae286 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:20.312307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-041c11d8-7b15-4eaf-bf6a-f1f13c6ae286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:20.417874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 669/1357] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:20.475109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d872394-4d2e-46de-9b09-3b1ac083af61 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:20.475661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d872394-4d2e-46de-9b09-3b1ac083af61 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:20.476226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d872394-4d2e-46de-9b09-3b1ac083af61 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:20.479069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 689/1358] 10.222.0.66 () {54 vars in 961 bytes} [Fri Jul 15 20:29:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:20.489255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d141120-fbf4-4174-94a7-c5a5e6a80298 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:20.489782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d141120-fbf4-4174-94a7-c5a5e6a80298 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:20.490251 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d141120-fbf4-4174-94a7-c5a5e6a80298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:20.583324 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0d141120-fbf4-4174-94a7-c5a5e6a80298 None None] MFA Rules not processed for user `b042da9298894712a0a29787a343bf85`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:20.584504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0d141120-fbf4-4174-94a7-c5a5e6a80298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:20.639791 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:20.714088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 670/1359] 10.222.0.66 () {58 vars in 1058 bytes} [Fri Jul 15 20:29:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:29:20.722644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d872394-4d2e-46de-9b09-3b1ac083af61 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:20.724163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4d872394-4d2e-46de-9b09-3b1ac083af61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:20.883837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d872394-4d2e-46de-9b09-3b1ac083af61 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:20.974298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:21.007898 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20304a-0fb5-44eb-9293-cbe6122705e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:21.008579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20304a-0fb5-44eb-9293-cbe6122705e7 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:21.008865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20304a-0fb5-44eb-9293-cbe6122705e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:21.009135 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20304a-0fb5-44eb-9293-cbe6122705e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:21.010759 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2f20304a-0fb5-44eb-9293-cbe6122705e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:21.106609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20304a-0fb5-44eb-9293-cbe6122705e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:21.108590 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20304a-0fb5-44eb-9293-cbe6122705e7 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:21.128313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 690/1360] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:29:23.354218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47e8d9-1a7f-4bb3-bb8c-8bda654d5af0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:23.354777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47e8d9-1a7f-4bb3-bb8c-8bda654d5af0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:23.355709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47e8d9-1a7f-4bb3-bb8c-8bda654d5af0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:23.357389 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 671/1361] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:23.362712 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db036d-a59a-4e77-b9e6-d37659c20c40 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:23.363163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db036d-a59a-4e77-b9e6-d37659c20c40 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:23.363257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db036d-a59a-4e77-b9e6-d37659c20c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:23.434419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-04db036d-a59a-4e77-b9e6-d37659c20c40 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:23.435775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-04db036d-a59a-4e77-b9e6-d37659c20c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:23.486754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:23.569816 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 691/1362] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:23.617447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47e8d9-1a7f-4bb3-bb8c-8bda654d5af0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:23.619015 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bf47e8d9-1a7f-4bb3-bb8c-8bda654d5af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:23.815722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47e8d9-1a7f-4bb3-bb8c-8bda654d5af0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:23.827031 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:23.935414 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231cb4f-0d5b-4a0f-b4de-b8d64e584b07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:23.936184 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231cb4f-0d5b-4a0f-b4de-b8d64e584b07 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:23.936567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231cb4f-0d5b-4a0f-b4de-b8d64e584b07 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:23.936894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231cb4f-0d5b-4a0f-b4de-b8d64e584b07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:23.938605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9231cb4f-0d5b-4a0f-b4de-b8d64e584b07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:24.030720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231cb4f-0d5b-4a0f-b4de-b8d64e584b07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:24.032545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231cb4f-0d5b-4a0f-b4de-b8d64e584b07 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:24.052089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 672/1363] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:29:26.418977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e1445-4529-4249-b7c3-e1b3046bba2d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:26.419592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e1445-4529-4249-b7c3-e1b3046bba2d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:26.419592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e1445-4529-4249-b7c3-e1b3046bba2d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:26.421333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 692/1364] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:26.426561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8141-845e-4e66-aec1-750d1604f197 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:26.426962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8141-845e-4e66-aec1-750d1604f197 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:26.427128 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8141-845e-4e66-aec1-750d1604f197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:26.448493 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:26.502130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-014f8141-845e-4e66-aec1-750d1604f197 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:26.503336 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-014f8141-845e-4e66-aec1-750d1604f197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:26.605863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 673/1365] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:26.654308 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc963c-07f3-4bbe-8a0f-980c03508454 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:26.654603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc963c-07f3-4bbe-8a0f-980c03508454 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:26.654937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc963c-07f3-4bbe-8a0f-980c03508454 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:26.656487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 693/1366] 10.222.0.66 () {54 vars in 961 bytes} [Fri Jul 15 20:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:26.663165 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b32312-5fb3-4df3-bbae-6df3cc760a66 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:26.663381 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b32312-5fb3-4df3-bbae-6df3cc760a66 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:26.663633 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b32312-5fb3-4df3-bbae-6df3cc760a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:26.743803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-73b32312-5fb3-4df3-bbae-6df3cc760a66 None None] MFA Rules not processed for user `b042da9298894712a0a29787a343bf85`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:26.745955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-73b32312-5fb3-4df3-bbae-6df3cc760a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:26.784454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:26.880122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 674/1367] 10.222.0.66 () {58 vars in 1058 bytes} [Fri Jul 15 20:29:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:26.889285 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc963c-07f3-4bbe-8a0f-980c03508454 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:26.890950 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-46cc963c-07f3-4bbe-8a0f-980c03508454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:27.051379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc963c-07f3-4bbe-8a0f-980c03508454 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:27.073187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:27.174053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540f40f-4d8a-489f-92c9-fef672e8cc69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:27.174716 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540f40f-4d8a-489f-92c9-fef672e8cc69 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:27.175002 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540f40f-4d8a-489f-92c9-fef672e8cc69 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:27.175281 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540f40f-4d8a-489f-92c9-fef672e8cc69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:27.177039 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e540f40f-4d8a-489f-92c9-fef672e8cc69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:27.271512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540f40f-4d8a-489f-92c9-fef672e8cc69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:27.273153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540f40f-4d8a-489f-92c9-fef672e8cc69 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:27.293102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 694/1368] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:29:28.256532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de0e2f-07e9-4acb-a56a-475b0c31f2c6 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:28.257078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de0e2f-07e9-4acb-a56a-475b0c31f2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:28.257078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de0e2f-07e9-4acb-a56a-475b0c31f2c6 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:28.258485 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 675/1369] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:28.263556 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf053731-f899-4f7c-bcfe-b35961646b7f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:28.263985 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf053731-f899-4f7c-bcfe-b35961646b7f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:28.264154 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf053731-f899-4f7c-bcfe-b35961646b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:28.296148 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:28.332776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cf053731-f899-4f7c-bcfe-b35961646b7f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:28.333981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cf053731-f899-4f7c-bcfe-b35961646b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:28.447976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 695/1370] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:28.788082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d67fdb-c146-45e3-9418-4a4042fdb1bb None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:28.788516 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d67fdb-c146-45e3-9418-4a4042fdb1bb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:28.788888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d67fdb-c146-45e3-9418-4a4042fdb1bb None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:28.790864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 676/1371] 10.222.0.66 () {54 vars in 963 bytes} [Fri Jul 15 20:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:28.796608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3edcb-8ce1-4a7b-a64a-cf64e991a4f2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:28.796908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3edcb-8ce1-4a7b-a64a-cf64e991a4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:28.797375 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3edcb-8ce1-4a7b-a64a-cf64e991a4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:28.878167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-93a3edcb-8ce1-4a7b-a64a-cf64e991a4f2 None None] MFA Rules not processed for user `1d4739b31f6647d89132f79f3f811d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:28.879527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-93a3edcb-8ce1-4a7b-a64a-cf64e991a4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:28.929484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:28.967893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 696/1372] 10.222.0.66 () {58 vars in 1060 bytes} [Fri Jul 15 20:29:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:28.975928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d67fdb-c146-45e3-9418-4a4042fdb1bb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:28.977723 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-60d67fdb-c146-45e3-9418-4a4042fdb1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:29.087018 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d67fdb-c146-45e3-9418-4a4042fdb1bb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:29.129408 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:29.168642 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63c814-6310-4b65-bb19-25ec2a5d3dcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:29.169391 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63c814-6310-4b65-bb19-25ec2a5d3dcd service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:29.169742 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63c814-6310-4b65-bb19-25ec2a5d3dcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:29.170087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63c814-6310-4b65-bb19-25ec2a5d3dcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:29.171945 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1e63c814-6310-4b65-bb19-25ec2a5d3dcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:29.308799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63c814-6310-4b65-bb19-25ec2a5d3dcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:29.310271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63c814-6310-4b65-bb19-25ec2a5d3dcd service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:29.334044 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 677/1373] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:29:29.393605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc48b6-a98a-4b7b-8f3f-369d4b98e881 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:29.394015 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc48b6-a98a-4b7b-8f3f-369d4b98e881 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:29.394178 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc48b6-a98a-4b7b-8f3f-369d4b98e881 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:29.395892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 697/1374] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:29.401215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29517a2-c284-4109-9597-f39c1bfb0d91 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:29.401563 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29517a2-c284-4109-9597-f39c1bfb0d91 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:29.401847 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29517a2-c284-4109-9597-f39c1bfb0d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:29.483469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c29517a2-c284-4109-9597-f39c1bfb0d91 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:29.485111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c29517a2-c284-4109-9597-f39c1bfb0d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:29.511472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:29.608509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 678/1375] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:29.644855 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc48b6-a98a-4b7b-8f3f-369d4b98e881 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:29.646392 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-53fc48b6-a98a-4b7b-8f3f-369d4b98e881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:29.794694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc48b6-a98a-4b7b-8f3f-369d4b98e881 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:29.847081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:29.911061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa08892-3640-4111-a00b-258a9f125333 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:29.911723 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa08892-3640-4111-a00b-258a9f125333 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:29.912010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa08892-3640-4111-a00b-258a9f125333 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:29.912289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa08892-3640-4111-a00b-258a9f125333 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:29.913971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6aa08892-3640-4111-a00b-258a9f125333 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:30.006188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa08892-3640-4111-a00b-258a9f125333 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:30.007827 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa08892-3640-4111-a00b-258a9f125333 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:30.028374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 698/1376] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:29:32.059023 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0c023-be90-4139-8918-101e82a46320 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:32.059536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0c023-be90-4139-8918-101e82a46320 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:32.059536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0c023-be90-4139-8918-101e82a46320 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:32.060911 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 679/1377] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:32.066144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc8948-7665-4d99-885c-7c39e9b74031 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:32.066574 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc8948-7665-4d99-885c-7c39e9b74031 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:32.066706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc8948-7665-4d99-885c-7c39e9b74031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:32.139262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f1dc8948-7665-4d99-885c-7c39e9b74031 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:32.140501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f1dc8948-7665-4d99-885c-7c39e9b74031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:32.147195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:32.244116 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 699/1378] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:32.292918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0c023-be90-4139-8918-101e82a46320 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:32.294352 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6dc0c023-be90-4139-8918-101e82a46320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:32.457882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0c023-be90-4139-8918-101e82a46320 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:32.461643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:32.579867 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269958b4-451c-4d5f-88df-04dd2f898aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:32.580556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269958b4-451c-4d5f-88df-04dd2f898aae service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:32.580842 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269958b4-451c-4d5f-88df-04dd2f898aae service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:32.581115 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269958b4-451c-4d5f-88df-04dd2f898aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:32.582760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-269958b4-451c-4d5f-88df-04dd2f898aae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:32.684192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269958b4-451c-4d5f-88df-04dd2f898aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:32.684359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269958b4-451c-4d5f-88df-04dd2f898aae service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:32.712420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 680/1379] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:29:34.820894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d20987-24d3-421b-93e9-e6ad6e38787c None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:34.821432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d20987-24d3-421b-93e9-e6ad6e38787c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:34.821432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d20987-24d3-421b-93e9-e6ad6e38787c None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:34.822907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 700/1380] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:34.829004 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda88ba-eec2-4a28-ab48-27a6348f0312 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:34.829518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda88ba-eec2-4a28-ab48-27a6348f0312 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:34.829613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda88ba-eec2-4a28-ab48-27a6348f0312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:34.840825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:34.907433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9fda88ba-eec2-4a28-ab48-27a6348f0312 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:34.908668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9fda88ba-eec2-4a28-ab48-27a6348f0312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:35.013574 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 681/1381] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:35.058925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d20987-24d3-421b-93e9-e6ad6e38787c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:35.060689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b6d20987-24d3-421b-93e9-e6ad6e38787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:35.222459 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:35.235370 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d20987-24d3-421b-93e9-e6ad6e38787c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:35.354385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa75c7-b125-4b9f-bd82-786b3a58f160 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:35.355614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa75c7-b125-4b9f-bd82-786b3a58f160 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:35.356095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa75c7-b125-4b9f-bd82-786b3a58f160 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:35.356336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa75c7-b125-4b9f-bd82-786b3a58f160 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:35.358115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6cfa75c7-b125-4b9f-bd82-786b3a58f160 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:35.460167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa75c7-b125-4b9f-bd82-786b3a58f160 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:35.461522 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa75c7-b125-4b9f-bd82-786b3a58f160 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:35.473874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:35.484310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 701/1382] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:29:37.601855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe76701-5d79-4d25-bf18-0d05d7f102a0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:37.602706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe76701-5d79-4d25-bf18-0d05d7f102a0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:37.602706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe76701-5d79-4d25-bf18-0d05d7f102a0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:37.603766 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 682/1383] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:37.611311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe68f-5a18-4623-8496-80e39270da6d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:37.612008 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe68f-5a18-4623-8496-80e39270da6d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:37.612336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe68f-5a18-4623-8496-80e39270da6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:37.709689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-afffe68f-5a18-4623-8496-80e39270da6d None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:37.711727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-afffe68f-5a18-4623-8496-80e39270da6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:37.826316 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 702/1384] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:37.871150 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe76701-5d79-4d25-bf18-0d05d7f102a0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:37.872604 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dfe76701-5d79-4d25-bf18-0d05d7f102a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:37.981529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:38.071813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe76701-5d79-4d25-bf18-0d05d7f102a0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:38.217055 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609f2e1-e47c-4385-9955-84a3704c5c89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:38.218239 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609f2e1-e47c-4385-9955-84a3704c5c89 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:38.218727 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609f2e1-e47c-4385-9955-84a3704c5c89 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:38.219274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609f2e1-e47c-4385-9955-84a3704c5c89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:38.222385 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4609f2e1-e47c-4385-9955-84a3704c5c89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:38.278739 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:38.346074 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609f2e1-e47c-4385-9955-84a3704c5c89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:38.349079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609f2e1-e47c-4385-9955-84a3704c5c89 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:38.382113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 683/1385] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:29:40.402740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347ca6a-2400-48e8-8655-e146a9399f07 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:40.403369 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347ca6a-2400-48e8-8655-e146a9399f07 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:40.403369 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347ca6a-2400-48e8-8655-e146a9399f07 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:40.404946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 703/1386] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:40.409997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bb1fe-8c2a-44b0-bfb3-f1e94b56b2c9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:40.410461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bb1fe-8c2a-44b0-bfb3-f1e94b56b2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:40.410611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bb1fe-8c2a-44b0-bfb3-f1e94b56b2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:40.481956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2c2bb1fe-8c2a-44b0-bfb3-f1e94b56b2c9 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:40.483187 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2c2bb1fe-8c2a-44b0-bfb3-f1e94b56b2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:40.588177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 684/1387] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:40.633288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347ca6a-2400-48e8-8655-e146a9399f07 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:40.634856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1347ca6a-2400-48e8-8655-e146a9399f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:40.717977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:40.798362 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347ca6a-2400-48e8-8655-e146a9399f07 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:40.922447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9d668-f0fc-4b81-bf14-51d3510fce12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:40.923145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9d668-f0fc-4b81-bf14-51d3510fce12 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:40.923400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9d668-f0fc-4b81-bf14-51d3510fce12 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:40.923676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9d668-f0fc-4b81-bf14-51d3510fce12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:40.925360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e9e9d668-f0fc-4b81-bf14-51d3510fce12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:40.963921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:41.022669 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9d668-f0fc-4b81-bf14-51d3510fce12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:41.024359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9d668-f0fc-4b81-bf14-51d3510fce12 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:41.046407 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 704/1388] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:29:43.399561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231d951-f409-413c-af40-31ae0e57d6d5 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:43.400192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231d951-f409-413c-af40-31ae0e57d6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:43.400192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231d951-f409-413c-af40-31ae0e57d6d5 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:43.401613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 685/1389] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:43.406687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cbb72-ed03-4b21-bbf3-06df8e2c5e9a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:43.407141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cbb72-ed03-4b21-bbf3-06df8e2c5e9a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:43.407263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cbb72-ed03-4b21-bbf3-06df8e2c5e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:43.475053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-df5cbb72-ed03-4b21-bbf3-06df8e2c5e9a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:43.476250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-df5cbb72-ed03-4b21-bbf3-06df8e2c5e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:43.589965 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 705/1390] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:43.633746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231d951-f409-413c-af40-31ae0e57d6d5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:43.635338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1231d951-f409-413c-af40-31ae0e57d6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:43.668713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:43.783136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231d951-f409-413c-af40-31ae0e57d6d5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:43.883558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:43.896421 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84a4b5-6a30-4585-aa77-f40ca9d8cd72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:43.897059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84a4b5-6a30-4585-aa77-f40ca9d8cd72 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:43.897343 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84a4b5-6a30-4585-aa77-f40ca9d8cd72 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:43.897615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84a4b5-6a30-4585-aa77-f40ca9d8cd72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:43.899229 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-be84a4b5-6a30-4585-aa77-f40ca9d8cd72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:43.989113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84a4b5-6a30-4585-aa77-f40ca9d8cd72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:43.990762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84a4b5-6a30-4585-aa77-f40ca9d8cd72 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:44.008838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 686/1391] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:29:44.416420 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ac2da-e56d-4c52-ac8f-009e62bb3207 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:44.416420 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ac2da-e56d-4c52-ac8f-009e62bb3207 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:44.416420 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ac2da-e56d-4c52-ac8f-009e62bb3207 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:44.417864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 706/1392] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:44.424432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c630b95-a328-4026-ab1d-d56ebbc5ab8f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:44.424432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c630b95-a328-4026-ab1d-d56ebbc5ab8f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:44.424432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c630b95-a328-4026-ab1d-d56ebbc5ab8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:44.501999 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1c630b95-a328-4026-ab1d-d56ebbc5ab8f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:44.503251 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1c630b95-a328-4026-ab1d-d56ebbc5ab8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:44.566407 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:44.610278 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 687/1393] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:44.668611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55806070-a179-4460-ace1-be8298efe221 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:44.668900 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55806070-a179-4460-ace1-be8298efe221 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:44.669266 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55806070-a179-4460-ace1-be8298efe221 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:44.670660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 707/1394] 10.222.0.66 () {54 vars in 960 bytes} [Fri Jul 15 20:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:44.675556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e136d4b-af49-4ec9-a4e8-fb3720178411 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:44.675848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e136d4b-af49-4ec9-a4e8-fb3720178411 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:44.676125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e136d4b-af49-4ec9-a4e8-fb3720178411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:44.753401 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7e136d4b-af49-4ec9-a4e8-fb3720178411 None None] MFA Rules not processed for user `93958c7dad0540b296b316169932d474`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:44.754621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7e136d4b-af49-4ec9-a4e8-fb3720178411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:44.842371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 688/1395] 10.222.0.66 () {58 vars in 1057 bytes} [Fri Jul 15 20:29:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:44.850239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55806070-a179-4460-ace1-be8298efe221 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:44.851879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-55806070-a179-4460-ace1-be8298efe221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:44.866427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:44.956339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55806070-a179-4460-ace1-be8298efe221 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:45.028812 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aabe5-6759-447b-9afb-602551f10af5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93958c7dad0540b296b316169932d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:45.029465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aabe5-6759-447b-9afb-602551f10af5 service glance] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:45.029754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aabe5-6759-447b-9afb-602551f10af5 service glance] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:45.030032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aabe5-6759-447b-9afb-602551f10af5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:45.031660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-981aabe5-6759-447b-9afb-602551f10af5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:45.104644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:45.147597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981aabe5-6759-447b-9afb-602551f10af5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:45.149130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981aabe5-6759-447b-9afb-602551f10af5 service glance] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:45.168653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 708/1396] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:29:45.888423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd1e8d-4fe3-46f7-be9b-1cb99efe50d6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:45.888934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd1e8d-4fe3-46f7-be9b-1cb99efe50d6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:45.889048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd1e8d-4fe3-46f7-be9b-1cb99efe50d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:45.956962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-28bd1e8d-4fe3-46f7-be9b-1cb99efe50d6 None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:45.958176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-28bd1e8d-4fe3-46f7-be9b-1cb99efe50d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:45.967306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:46.049669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 689/1397] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:29:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:46.055110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b479122-cbba-4b69-8d70-921a15c616d8 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:46.055628 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b479122-cbba-4b69-8d70-921a15c616d8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:46.055783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b479122-cbba-4b69-8d70-921a15c616d8 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:46.057462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 709/1398] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:46.063772 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5925a2f-4459-4d44-a496-580d605662a3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:46.064062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5925a2f-4459-4d44-a496-580d605662a3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:46.064341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5925a2f-4459-4d44-a496-580d605662a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:46.093887 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038378-02ff-4354-917c-21cf20733f6e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:46.094339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038378-02ff-4354-917c-21cf20733f6e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:46.094630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038378-02ff-4354-917c-21cf20733f6e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:46.096346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 710/1399] 10.222.0.66 () {54 vars in 942 bytes} [Fri Jul 15 20:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:46.106583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb897-e25a-4b30-b519-5ee4e2f8f7c5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:46.106941 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb897-e25a-4b30-b519-5ee4e2f8f7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:46.107288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb897-e25a-4b30-b519-5ee4e2f8f7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:46.134224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e5925a2f-4459-4d44-a496-580d605662a3 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:46.135426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e5925a2f-4459-4d44-a496-580d605662a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:46.182394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-40cbb897-e25a-4b30-b519-5ee4e2f8f7c5 None None] MFA Rules not processed for user `4eed1d3c16354c8c9af8c01cb541c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:46.184242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-40cbb897-e25a-4b30-b519-5ee4e2f8f7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:46.239252 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 690/1400] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:46.285738 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5925a2f-4459-4d44-a496-580d605662a3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:46.286941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e5925a2f-4459-4d44-a496-580d605662a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:46.289842 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:46.310833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 711/1401] 10.222.0.66 () {58 vars in 1039 bytes} [Fri Jul 15 20:29:46 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:29:46.321824 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbb897-e25a-4b30-b519-5ee4e2f8f7c5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:46.329777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:46.336111 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbb897-e25a-4b30-b519-5ee4e2f8f7c5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:46.430143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5925a2f-4459-4d44-a496-580d605662a3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:46.459903 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7ce93-edd7-40ed-b6b6-fe9e23b35ac9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:46.461035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7ce93-edd7-40ed-b6b6-fe9e23b35ac9 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:46.461716 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7ce93-edd7-40ed-b6b6-fe9e23b35ac9 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:46.461817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7ce93-edd7-40ed-b6b6-fe9e23b35ac9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:46.463641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-eeb7ce93-edd7-40ed-b6b6-fe9e23b35ac9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:46.556921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7ce93-edd7-40ed-b6b6-fe9e23b35ac9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:46.559067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7ce93-edd7-40ed-b6b6-fe9e23b35ac9 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:46.565167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:46.568114 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a0d38-8c3c-47e3-a7b6-a0ef9393c25d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:46.568810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a0d38-8c3c-47e3-a7b6-a0ef9393c25d service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:46.569349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a0d38-8c3c-47e3-a7b6-a0ef9393c25d service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:46.569882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a0d38-8c3c-47e3-a7b6-a0ef9393c25d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:46.571630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 712/1402] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:29:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 20:29:46.571822 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ac7a0d38-8c3c-47e3-a7b6-a0ef9393c25d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:46.704431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a0d38-8c3c-47e3-a7b6-a0ef9393c25d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:46.707763 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a0d38-8c3c-47e3-a7b6-a0ef9393c25d service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:46.744700 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 691/1403] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:29:48.859542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7390b-45fa-4bea-983a-951389573cae None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:48.860090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7390b-45fa-4bea-983a-951389573cae None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:48.860090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7390b-45fa-4bea-983a-951389573cae None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:48.861585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 713/1404] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:48.866975 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71fe8a-e401-423b-b233-2233cde8d68d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:48.867434 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71fe8a-e401-423b-b233-2233cde8d68d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:48.867532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71fe8a-e401-423b-b233-2233cde8d68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:48.937938 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cc71fe8a-e401-423b-b233-2233cde8d68d None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:48.939165 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cc71fe8a-e401-423b-b233-2233cde8d68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:49.016123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:49.052459 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 692/1405] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:49.097923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7390b-45fa-4bea-983a-951389573cae None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:49.099728 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-31e7390b-45fa-4bea-983a-951389573cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:49.140514 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:49.270171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7390b-45fa-4bea-983a-951389573cae None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:49.383321 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:49.398788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e0d5b-490e-4450-a9b9-440ebcdbbd23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:49.399472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e0d5b-490e-4450-a9b9-440ebcdbbd23 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:49.399760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e0d5b-490e-4450-a9b9-440ebcdbbd23 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:49.400041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e0d5b-490e-4450-a9b9-440ebcdbbd23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:49.402484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-aa3e0d5b-490e-4450-a9b9-440ebcdbbd23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:49.510067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e0d5b-490e-4450-a9b9-440ebcdbbd23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:49.511730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e0d5b-490e-4450-a9b9-440ebcdbbd23 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:49.532095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 714/1406] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:29:51.619849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6351dc8-3c32-4d2b-8044-8219efd2fe7d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:51.621038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6351dc8-3c32-4d2b-8044-8219efd2fe7d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:51.621038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6351dc8-3c32-4d2b-8044-8219efd2fe7d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:51.622519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 693/1407] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:29:51.627714 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d3232-a3f2-4c5b-8c76-5f1386ba7311 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:51.628132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d3232-a3f2-4c5b-8c76-5f1386ba7311 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:51.628286 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d3232-a3f2-4c5b-8c76-5f1386ba7311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:51.696950 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-dc4d3232-a3f2-4c5b-8c76-5f1386ba7311 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:29:51.698227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dc4d3232-a3f2-4c5b-8c76-5f1386ba7311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:51.765512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:51.833135 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 715/1408] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:29:51.889777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6351dc8-3c32-4d2b-8044-8219efd2fe7d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:29:51.891356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e6351dc8-3c32-4d2b-8044-8219efd2fe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:52.108954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6351dc8-3c32-4d2b-8044-8219efd2fe7d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:29:52.170694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:52.235173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6ac83-5b18-49e7-be6f-b92733325a2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:29:52.235819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ac83-5b18-49e7-be6f-b92733325a2b service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:29:52.236100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ac83-5b18-49e7-be6f-b92733325a2b service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:29:52.236373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ac83-5b18-49e7-be6f-b92733325a2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:29:52.238087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-64f6ac83-5b18-49e7-be6f-b92733325a2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:29:52.334971 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6ac83-5b18-49e7-be6f-b92733325a2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:29:52.336603 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6ac83-5b18-49e7-be6f-b92733325a2b service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:29:52.355778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 694/1409] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:01.830518 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=14 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:02.353572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=73 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:08.895758 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072d7b0-4b4d-43fb-bee0-25bb439389ee None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:08.896259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072d7b0-4b4d-43fb-bee0-25bb439389ee None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:08.896259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072d7b0-4b4d-43fb-bee0-25bb439389ee None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:08.897688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 716/1410] 10.222.0.66 () {54 vars in 918 bytes} [Fri Jul 15 20:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:08.903803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d66da5-c5db-4a52-97f4-8cd952858092 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:08.904537 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d66da5-c5db-4a52-97f4-8cd952858092 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:08.904665 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d66da5-c5db-4a52-97f4-8cd952858092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:08.978838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f6d66da5-c5db-4a52-97f4-8cd952858092 None None] MFA Rules not processed for user `6693dd1ea26049c1ac8460faf1bc9b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:08.980580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f6d66da5-c5db-4a52-97f4-8cd952858092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:09.084197 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 695/1411] 10.222.0.66 () {58 vars in 1015 bytes} [Fri Jul 15 20:30:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:09.098769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3b612-f52f-4754-a404-d385d36521ca None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:09.099123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3b612-f52f-4754-a404-d385d36521ca None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:09.099376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3b612-f52f-4754-a404-d385d36521ca None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:09.100777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 717/1412] 10.222.0.66 () {54 vars in 918 bytes} [Fri Jul 15 20:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:30:09.105960 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdb5e0-fbe2-4bcf-b1ef-ab3a085140cb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:09.106249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdb5e0-fbe2-4bcf-b1ef-ab3a085140cb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:09.106530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdb5e0-fbe2-4bcf-b1ef-ab3a085140cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:09.177458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:09.180450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b9cdb5e0-fbe2-4bcf-b1ef-ab3a085140cb None None] MFA Rules not processed for user `b042da9298894712a0a29787a343bf85`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:09.182247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b9cdb5e0-fbe2-4bcf-b1ef-ab3a085140cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:09.298103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 696/1413] 10.222.0.66 () {58 vars in 1015 bytes} [Fri Jul 15 20:30:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:11.855687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595522-007d-4d98-b494-323aa7e869d7 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:11.856226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595522-007d-4d98-b494-323aa7e869d7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:11.856226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595522-007d-4d98-b494-323aa7e869d7 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:11.857658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:11.863019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd713b-8808-4d8a-b522-b3c71d1c2c3a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:11.863402 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd713b-8808-4d8a-b522-b3c71d1c2c3a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:11.863587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd713b-8808-4d8a-b522-b3c71d1c2c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:11.931295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e6dd713b-8808-4d8a-b522-b3c71d1c2c3a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:11.933253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e6dd713b-8808-4d8a-b522-b3c71d1c2c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:11.991711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:12.038047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:12.084052 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12595522-007d-4d98-b494-323aa7e869d7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:12.085680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-12595522-007d-4d98-b494-323aa7e869d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:12.235743 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12595522-007d-4d98-b494-323aa7e869d7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:12.312843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:12.355422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3b89b-addf-4b2f-a0e8-24b6c1f2cdce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:12.356077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3b89b-addf-4b2f-a0e8-24b6c1f2cdce service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:12.356366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3b89b-addf-4b2f-a0e8-24b6c1f2cdce service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:12.356674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3b89b-addf-4b2f-a0e8-24b6c1f2cdce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:12.358320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-afb3b89b-addf-4b2f-a0e8-24b6c1f2cdce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:12.460155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3b89b-addf-4b2f-a0e8-24b6c1f2cdce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:12.461828 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3b89b-addf-4b2f-a0e8-24b6c1f2cdce service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:12.481541 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 719/1416] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:13.393357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03872787-9839-489b-8596-85fa9d8b2128 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:13.393986 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03872787-9839-489b-8596-85fa9d8b2128 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:13.393986 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03872787-9839-489b-8596-85fa9d8b2128 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:13.395281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:13.400125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e533b-4d49-4aa2-afc2-d5db5f7b62af None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:13.400610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e533b-4d49-4aa2-afc2-d5db5f7b62af None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:13.400738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e533b-4d49-4aa2-afc2-d5db5f7b62af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:13.478027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fb7e533b-4d49-4aa2-afc2-d5db5f7b62af None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:13.479257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fb7e533b-4d49-4aa2-afc2-d5db5f7b62af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:13.506395 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:13.577066 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:13.728196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03872787-9839-489b-8596-85fa9d8b2128 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:13.729744 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-03872787-9839-489b-8596-85fa9d8b2128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:13.987914 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03872787-9839-489b-8596-85fa9d8b2128 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:14.027126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:14.099670 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531bd1f-b694-452b-beb4-1bb6be811e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:14.100315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531bd1f-b694-452b-beb4-1bb6be811e43 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:14.100626 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531bd1f-b694-452b-beb4-1bb6be811e43 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:14.100905 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531bd1f-b694-452b-beb4-1bb6be811e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:14.102536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7531bd1f-b694-452b-beb4-1bb6be811e43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:14.190479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531bd1f-b694-452b-beb4-1bb6be811e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:14.192073 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531bd1f-b694-452b-beb4-1bb6be811e43 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:14.209590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 699/1419] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:15.093965 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6078c-759d-4b65-a0f7-2627ba223e59 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:15.094518 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6078c-759d-4b65-a0f7-2627ba223e59 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:15.094625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6078c-759d-4b65-a0f7-2627ba223e59 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:15.095936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:15.101218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fab9e-6702-40e7-85cc-05a07c4f6b6a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:15.101606 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fab9e-6702-40e7-85cc-05a07c4f6b6a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:15.101785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fab9e-6702-40e7-85cc-05a07c4f6b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:15.155787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:15.178820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ab0fab9e-6702-40e7-85cc-05a07c4f6b6a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:15.180034 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ab0fab9e-6702-40e7-85cc-05a07c4f6b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:15.277807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:15.430770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6078c-759d-4b65-a0f7-2627ba223e59 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:15.432310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-86b6078c-759d-4b65-a0f7-2627ba223e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:15.578163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6078c-759d-4b65-a0f7-2627ba223e59 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:15.590510 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:15.703502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee968af-5a9c-4ac6-821b-d7a52c6866b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:15.704093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee968af-5a9c-4ac6-821b-d7a52c6866b8 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:15.704373 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee968af-5a9c-4ac6-821b-d7a52c6866b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:15.704674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee968af-5a9c-4ac6-821b-d7a52c6866b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:15.706312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9ee968af-5a9c-4ac6-821b-d7a52c6866b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:15.794340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee968af-5a9c-4ac6-821b-d7a52c6866b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:15.795938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee968af-5a9c-4ac6-821b-d7a52c6866b8 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:15.814685 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 722/1422] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:16.691085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d194a12-c111-4ad7-90de-50700b721c81 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:16.691620 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d194a12-c111-4ad7-90de-50700b721c81 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:16.691620 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d194a12-c111-4ad7-90de-50700b721c81 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:16.693164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:16.698591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ab2ae-5033-4a9e-83f0-4ddcff50f2d9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:16.699041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ab2ae-5033-4a9e-83f0-4ddcff50f2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:16.699329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ab2ae-5033-4a9e-83f0-4ddcff50f2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:16.718502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:16.775662 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-474ab2ae-5033-4a9e-83f0-4ddcff50f2d9 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:16.776960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-474ab2ae-5033-4a9e-83f0-4ddcff50f2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:16.873572 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:17.025282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d194a12-c111-4ad7-90de-50700b721c81 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:17.026772 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5d194a12-c111-4ad7-90de-50700b721c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:17.136747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:17.172650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d194a12-c111-4ad7-90de-50700b721c81 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:17.283951 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfac7fc-5e9a-477d-b1fe-b4960f8e7930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:17.284689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfac7fc-5e9a-477d-b1fe-b4960f8e7930 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:17.284975 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfac7fc-5e9a-477d-b1fe-b4960f8e7930 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:17.285256 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfac7fc-5e9a-477d-b1fe-b4960f8e7930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:17.286946 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7cfac7fc-5e9a-477d-b1fe-b4960f8e7930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:17.363553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:17.378476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfac7fc-5e9a-477d-b1fe-b4960f8e7930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:17.380098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfac7fc-5e9a-477d-b1fe-b4960f8e7930 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:17.398266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 702/1425] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:18.281688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf4168-69dc-42a1-887c-847943eedb2b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:18.282262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf4168-69dc-42a1-887c-847943eedb2b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:18.282262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf4168-69dc-42a1-887c-847943eedb2b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:18.283661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:18.288671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51870cf9-7fde-436d-a9d9-99b22312e9aa None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:18.289048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51870cf9-7fde-436d-a9d9-99b22312e9aa None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:18.289233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51870cf9-7fde-436d-a9d9-99b22312e9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:18.362070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-51870cf9-7fde-436d-a9d9-99b22312e9aa None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:18.363262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-51870cf9-7fde-436d-a9d9-99b22312e9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:18.463270 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:18.617130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf4168-69dc-42a1-887c-847943eedb2b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:18.618568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bfcf4168-69dc-42a1-887c-847943eedb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:18.701912 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:18.763540 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf4168-69dc-42a1-887c-847943eedb2b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:18.875253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b87a5a-b64c-47d3-8938-813201c455ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:18.875846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b87a5a-b64c-47d3-8938-813201c455ef service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:18.876128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b87a5a-b64c-47d3-8938-813201c455ef service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:18.876428 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b87a5a-b64c-47d3-8938-813201c455ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:18.878088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-74b87a5a-b64c-47d3-8938-813201c455ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:18.926781 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:18.968847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b87a5a-b64c-47d3-8938-813201c455ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:18.970459 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b87a5a-b64c-47d3-8938-813201c455ef service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:18.989039 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 725/1428] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:19.796198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f00919-162b-497e-a8c9-8522a8babbf5 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:19.796771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f00919-162b-497e-a8c9-8522a8babbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:19.796771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f00919-162b-497e-a8c9-8522a8babbf5 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:19.798088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:19.802906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce106167-35f9-4ac4-b807-3874f8ebdd69 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:19.803290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce106167-35f9-4ac4-b807-3874f8ebdd69 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:19.803463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce106167-35f9-4ac4-b807-3874f8ebdd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:19.881368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ce106167-35f9-4ac4-b807-3874f8ebdd69 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:19.882571 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ce106167-35f9-4ac4-b807-3874f8ebdd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:19.978930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:20.131620 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f00919-162b-497e-a8c9-8522a8babbf5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:20.133082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-44f00919-162b-497e-a8c9-8522a8babbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:20.181857 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:20.277600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f00919-162b-497e-a8c9-8522a8babbf5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:20.388849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db19002-ed1e-4bf7-a978-16da60b54255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:20.389424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db19002-ed1e-4bf7-a978-16da60b54255 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:20.389710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db19002-ed1e-4bf7-a978-16da60b54255 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:20.389982 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db19002-ed1e-4bf7-a978-16da60b54255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:20.391596 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0db19002-ed1e-4bf7-a978-16da60b54255 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:20.398473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:20.481468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db19002-ed1e-4bf7-a978-16da60b54255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:20.483064 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db19002-ed1e-4bf7-a978-16da60b54255 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:20.502131 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 705/1431] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:21.319553 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d763b-c795-4f29-ac6d-6424cb191a90 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:21.320129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d763b-c795-4f29-ac6d-6424cb191a90 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:21.320129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d763b-c795-4f29-ac6d-6424cb191a90 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:21.321567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:21.326684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee28d9-3503-44c9-b117-bca0833ce6fa None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:21.327082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee28d9-3503-44c9-b117-bca0833ce6fa None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:21.327277 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee28d9-3503-44c9-b117-bca0833ce6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:21.404071 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1eee28d9-3503-44c9-b117-bca0833ce6fa None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:21.405641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1eee28d9-3503-44c9-b117-bca0833ce6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:21.474733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:21.504148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:30:21.655073 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d763b-c795-4f29-ac6d-6424cb191a90 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:21.656768 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ee4d763b-c795-4f29-ac6d-6424cb191a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:21.675186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:21.804929 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d763b-c795-4f29-ac6d-6424cb191a90 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:21.893731 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:21.920846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee1869-285b-4b1a-a87a-cdf130b59ebc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:21.921565 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee1869-285b-4b1a-a87a-cdf130b59ebc service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:21.921859 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee1869-285b-4b1a-a87a-cdf130b59ebc service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:21.922140 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee1869-285b-4b1a-a87a-cdf130b59ebc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:21.923818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2aee1869-285b-4b1a-a87a-cdf130b59ebc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:22.012253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee1869-285b-4b1a-a87a-cdf130b59ebc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:22.014173 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee1869-285b-4b1a-a87a-cdf130b59ebc service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:22.032249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 728/1434] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:22.853560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60614ee-4de1-4ef1-9661-a8aa19b5dd2b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:22.854098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60614ee-4de1-4ef1-9661-a8aa19b5dd2b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:22.854098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60614ee-4de1-4ef1-9661-a8aa19b5dd2b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:22.855569 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:22.860700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97553f-3df8-4ad0-a99e-cf1174271de3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:22.861085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97553f-3df8-4ad0-a99e-cf1174271de3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:22.861253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97553f-3df8-4ad0-a99e-cf1174271de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:23.052295 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ec97553f-3df8-4ad0-a99e-cf1174271de3 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:23.053554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ec97553f-3df8-4ad0-a99e-cf1174271de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:23.096315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:23.151201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:23.306647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60614ee-4de1-4ef1-9661-a8aa19b5dd2b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:23.309293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e60614ee-4de1-4ef1-9661-a8aa19b5dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:23.456238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60614ee-4de1-4ef1-9661-a8aa19b5dd2b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:23.510435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:23.569588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8de501-5d4b-49ff-b350-23731e6284ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:23.570245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8de501-5d4b-49ff-b350-23731e6284ed service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:23.570530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8de501-5d4b-49ff-b350-23731e6284ed service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:23.570810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8de501-5d4b-49ff-b350-23731e6284ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:23.572481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bb8de501-5d4b-49ff-b350-23731e6284ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:23.670324 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8de501-5d4b-49ff-b350-23731e6284ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:23.671940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8de501-5d4b-49ff-b350-23731e6284ed service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:23.690403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 708/1437] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:24.505777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a19aec-e9ea-43e4-adb8-9d94a7e15702 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:24.506236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a19aec-e9ea-43e4-adb8-9d94a7e15702 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:24.506373 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a19aec-e9ea-43e4-adb8-9d94a7e15702 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:24.507758 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:24.512796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d38f40-f74c-4d43-808b-ef7ec1200acd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:24.513209 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d38f40-f74c-4d43-808b-ef7ec1200acd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:24.513362 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d38f40-f74c-4d43-808b-ef7ec1200acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:24.587525 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-42d38f40-f74c-4d43-808b-ef7ec1200acd None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:24.589306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-42d38f40-f74c-4d43-808b-ef7ec1200acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:24.591321 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:24.688566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:24.841159 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a19aec-e9ea-43e4-adb8-9d94a7e15702 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:24.842813 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-56a19aec-e9ea-43e4-adb8-9d94a7e15702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:24.989193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a19aec-e9ea-43e4-adb8-9d94a7e15702 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:25.018546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:25.104555 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde4db9-ab0f-40dd-a59c-19661d69f19b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:25.105095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde4db9-ab0f-40dd-a59c-19661d69f19b service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:25.105385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde4db9-ab0f-40dd-a59c-19661d69f19b service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:25.105665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde4db9-ab0f-40dd-a59c-19661d69f19b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:25.107360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bfde4db9-ab0f-40dd-a59c-19661d69f19b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:25.195586 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde4db9-ab0f-40dd-a59c-19661d69f19b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:25.197219 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde4db9-ab0f-40dd-a59c-19661d69f19b service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:25.215793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 731/1440] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:27.149069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3a439-8c78-4ef9-ad9a-b65b2071ebad None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:27.149589 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3a439-8c78-4ef9-ad9a-b65b2071ebad None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:27.149701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3a439-8c78-4ef9-ad9a-b65b2071ebad None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:27.151714 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:27.157749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96345f6a-1a17-4c3f-bee4-2f7f32403e0c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:27.158213 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96345f6a-1a17-4c3f-bee4-2f7f32403e0c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:27.158320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96345f6a-1a17-4c3f-bee4-2f7f32403e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:27.202578 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:27.229167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-96345f6a-1a17-4c3f-bee4-2f7f32403e0c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:27.230378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-96345f6a-1a17-4c3f-bee4-2f7f32403e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:27.335619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:27.376041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3a439-8c78-4ef9-ad9a-b65b2071ebad None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:27.377627 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-36f3a439-8c78-4ef9-ad9a-b65b2071ebad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:27.492157 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3a439-8c78-4ef9-ad9a-b65b2071ebad None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:27.525737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:27.567922 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99c79e-4c65-4676-a991-eeac6389b281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:27.568655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99c79e-4c65-4676-a991-eeac6389b281 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:27.568891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99c79e-4c65-4676-a991-eeac6389b281 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:27.569164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99c79e-4c65-4676-a991-eeac6389b281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:27.570801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9a99c79e-4c65-4676-a991-eeac6389b281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:27.684257 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99c79e-4c65-4676-a991-eeac6389b281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:27.685740 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99c79e-4c65-4676-a991-eeac6389b281 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:27.704819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 711/1443] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:29.886839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27e983-8aa1-4433-bdb6-eb67fc90b274 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:29.887352 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27e983-8aa1-4433-bdb6-eb67fc90b274 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:29.887352 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27e983-8aa1-4433-bdb6-eb67fc90b274 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:29.888814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:29.894511 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4119672-e2d7-4bdd-9cc7-4d961ef0422a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:29.894936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4119672-e2d7-4bdd-9cc7-4d961ef0422a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:29.895071 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4119672-e2d7-4bdd-9cc7-4d961ef0422a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:29.964500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b4119672-e2d7-4bdd-9cc7-4d961ef0422a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:29.966761 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b4119672-e2d7-4bdd-9cc7-4d961ef0422a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:29.982038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:30.074036 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:30.112763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27e983-8aa1-4433-bdb6-eb67fc90b274 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:30.114327 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7b27e983-8aa1-4433-bdb6-eb67fc90b274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:30.231234 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27e983-8aa1-4433-bdb6-eb67fc90b274 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:30.243770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:30.311638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aec177-32c6-47e9-9804-400fd576376d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:30.312296 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec177-32c6-47e9-9804-400fd576376d service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:30.312611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec177-32c6-47e9-9804-400fd576376d service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:30.312890 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec177-32c6-47e9-9804-400fd576376d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:30.314536 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-64aec177-32c6-47e9-9804-400fd576376d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:30.432911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aec177-32c6-47e9-9804-400fd576376d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:30.434346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aec177-32c6-47e9-9804-400fd576376d service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:30.456209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 734/1446] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:32.803912 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56155b8f-d837-421b-8664-918af9f02aff None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:32.804449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56155b8f-d837-421b-8664-918af9f02aff None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:32.804449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56155b8f-d837-421b-8664-918af9f02aff None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:32.805928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:32.811869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b0680-c3fb-48bb-b2d1-ba4eb321ced3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:32.812295 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b0680-c3fb-48bb-b2d1-ba4eb321ced3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:32.812461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b0680-c3fb-48bb-b2d1-ba4eb321ced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:32.863689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:32.882772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7e8b0680-c3fb-48bb-b2d1-ba4eb321ced3 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:32.883988 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7e8b0680-c3fb-48bb-b2d1-ba4eb321ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:32.992547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:33.039338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56155b8f-d837-421b-8664-918af9f02aff None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:33.039338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-56155b8f-d837-421b-8664-918af9f02aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:33.148356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56155b8f-d837-421b-8664-918af9f02aff None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:33.189968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:33.225575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2c725-0d00-4d5b-b9a9-94381e0f61fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:33.226221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2c725-0d00-4d5b-b9a9-94381e0f61fd service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:33.226505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2c725-0d00-4d5b-b9a9-94381e0f61fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:33.226777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2c725-0d00-4d5b-b9a9-94381e0f61fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:33.228419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f0a2c725-0d00-4d5b-b9a9-94381e0f61fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:33.343223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2c725-0d00-4d5b-b9a9-94381e0f61fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:33.344721 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2c725-0d00-4d5b-b9a9-94381e0f61fd service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:33.363944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 714/1449] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:35.598876 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c625a-4248-426c-b2eb-512657a3473a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:35.599376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c625a-4248-426c-b2eb-512657a3473a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:35.599489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c625a-4248-426c-b2eb-512657a3473a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:35.600909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:35.607145 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce041-4c12-4cee-a06b-30b129a13480 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:35.607578 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce041-4c12-4cee-a06b-30b129a13480 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:35.607707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce041-4c12-4cee-a06b-30b129a13480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:35.676495 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-552ce041-4c12-4cee-a06b-30b129a13480 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:35.677707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-552ce041-4c12-4cee-a06b-30b129a13480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:35.698870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:35.774895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:35.814118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c625a-4248-426c-b2eb-512657a3473a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:35.815636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-eb7c625a-4248-426c-b2eb-512657a3473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:35.919843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c625a-4248-426c-b2eb-512657a3473a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:35.941267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:36.005381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df4f3a-04dc-4291-88ff-4efc58c24d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:36.006066 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df4f3a-04dc-4291-88ff-4efc58c24d35 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:36.006354 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df4f3a-04dc-4291-88ff-4efc58c24d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:36.006631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df4f3a-04dc-4291-88ff-4efc58c24d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:36.008337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e9df4f3a-04dc-4291-88ff-4efc58c24d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:36.120377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df4f3a-04dc-4291-88ff-4efc58c24d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:36.121788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df4f3a-04dc-4291-88ff-4efc58c24d35 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:36.141139 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 737/1452] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:30:38.239223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80b2cb-6117-4d59-84cd-7ebeff2c280b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:38.239791 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80b2cb-6117-4d59-84cd-7ebeff2c280b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:38.239791 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80b2cb-6117-4d59-84cd-7ebeff2c280b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:38.241211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:38.246708 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71618cba-f137-40d5-b571-0e037ba440f7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:38.247153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71618cba-f137-40d5-b571-0e037ba440f7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:38.247258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71618cba-f137-40d5-b571-0e037ba440f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:38.310955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:38.315256 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-71618cba-f137-40d5-b571-0e037ba440f7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:38.317119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-71618cba-f137-40d5-b571-0e037ba440f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:38.413773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:30:38.454384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80b2cb-6117-4d59-84cd-7ebeff2c280b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:38.455979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fe80b2cb-6117-4d59-84cd-7ebeff2c280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:38.558780 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80b2cb-6117-4d59-84cd-7ebeff2c280b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:38.606941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:38.631502 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab275697-e0a0-408c-9408-3fb87be61d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:38.632139 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab275697-e0a0-408c-9408-3fb87be61d69 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:38.632439 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab275697-e0a0-408c-9408-3fb87be61d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:38.632717 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab275697-e0a0-408c-9408-3fb87be61d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:38.634333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ab275697-e0a0-408c-9408-3fb87be61d69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:38.738727 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab275697-e0a0-408c-9408-3fb87be61d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:38.740155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab275697-e0a0-408c-9408-3fb87be61d69 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:38.758502 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 717/1455] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:40.807838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39533a-c713-42d6-a086-2c0a81571b1e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:40.808338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39533a-c713-42d6-a086-2c0a81571b1e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:40.808338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39533a-c713-42d6-a086-2c0a81571b1e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:40.809734 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:30:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:40.815288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1c49c-7cc9-4682-af64-82b404d52312 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:40.815713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1c49c-7cc9-4682-af64-82b404d52312 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:40.815840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1c49c-7cc9-4682-af64-82b404d52312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:40.878811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-59b1c49c-7cc9-4682-af64-82b404d52312 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:40.879998 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-59b1c49c-7cc9-4682-af64-82b404d52312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:40.908707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:40.977522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:41.016755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39533a-c713-42d6-a086-2c0a81571b1e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:41.018324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9d39533a-c713-42d6-a086-2c0a81571b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:41.121771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39533a-c713-42d6-a086-2c0a81571b1e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:41.149382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:41.195693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df72ee7-df5b-4b40-a62b-ff4e64c0f8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:41.196499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df72ee7-df5b-4b40-a62b-ff4e64c0f8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:41.196780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df72ee7-df5b-4b40-a62b-ff4e64c0f8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:41.197059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df72ee7-df5b-4b40-a62b-ff4e64c0f8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:41.199316 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3df72ee7-df5b-4b40-a62b-ff4e64c0f8c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:41.309537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df72ee7-df5b-4b40-a62b-ff4e64c0f8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:41.310985 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df72ee7-df5b-4b40-a62b-ff4e64c0f8c1 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:41.329492 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 740/1458] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:43.421725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae31f8-64e2-4a22-9e94-a7739d1fa5e2 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:43.422396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae31f8-64e2-4a22-9e94-a7739d1fa5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:43.422396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae31f8-64e2-4a22-9e94-a7739d1fa5e2 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:43.423662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:43.428962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeecc11-b9dc-4f7a-9748-331c056e441d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:43.429391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeecc11-b9dc-4f7a-9748-331c056e441d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:43.429529 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeecc11-b9dc-4f7a-9748-331c056e441d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:43.495519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-daeecc11-b9dc-4f7a-9748-331c056e441d None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:43.496761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-daeecc11-b9dc-4f7a-9748-331c056e441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:43.504971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:43.595958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:43.633786 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae31f8-64e2-4a22-9e94-a7739d1fa5e2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:43.635330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7cae31f8-64e2-4a22-9e94-a7739d1fa5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:43.736707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae31f8-64e2-4a22-9e94-a7739d1fa5e2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:43.790414 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:43.809453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4b40a-6303-470f-bd3f-7766e56142df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:43.810100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4b40a-6303-470f-bd3f-7766e56142df service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:43.810381 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4b40a-6303-470f-bd3f-7766e56142df service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:43.810654 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4b40a-6303-470f-bd3f-7766e56142df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:43.812291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-48e4b40a-6303-470f-bd3f-7766e56142df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:43.919621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4b40a-6303-470f-bd3f-7766e56142df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:43.921098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4b40a-6303-470f-bd3f-7766e56142df service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:43.939265 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 720/1461] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:45.989072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fa62f-209c-440e-80ed-8d3d0c84a35d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:45.989946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fa62f-209c-440e-80ed-8d3d0c84a35d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:45.989946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fa62f-209c-440e-80ed-8d3d0c84a35d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:45.991042 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:45.997578 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad87f-0bf0-4fd4-aee0-a392e799edb7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:45.998154 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad87f-0bf0-4fd4-aee0-a392e799edb7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:45.998154 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad87f-0bf0-4fd4-aee0-a392e799edb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:46.063114 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b09ad87f-0bf0-4fd4-aee0-a392e799edb7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:46.064307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b09ad87f-0bf0-4fd4-aee0-a392e799edb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:46.103573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:46.170801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:46.210613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fa62f-209c-440e-80ed-8d3d0c84a35d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:46.212124 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b35fa62f-209c-440e-80ed-8d3d0c84a35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:46.325414 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fa62f-209c-440e-80ed-8d3d0c84a35d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:46.373015 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:46.417344 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02df0c-52ab-4843-befd-df05616fb20e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:46.418006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02df0c-52ab-4843-befd-df05616fb20e service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:46.418283 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02df0c-52ab-4843-befd-df05616fb20e service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:46.418555 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02df0c-52ab-4843-befd-df05616fb20e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:46.420357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1d02df0c-52ab-4843-befd-df05616fb20e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:46.543189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02df0c-52ab-4843-befd-df05616fb20e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:46.544802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02df0c-52ab-4843-befd-df05616fb20e service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:46.564017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 743/1464] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:48.643000 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579938a-d1c4-4d1a-921d-0736a57b7a71 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:48.643552 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579938a-d1c4-4d1a-921d-0736a57b7a71 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:48.643552 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579938a-d1c4-4d1a-921d-0736a57b7a71 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:48.645008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:48.650188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f0262-dd10-4aef-8cda-f61191865121 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:48.650678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f0262-dd10-4aef-8cda-f61191865121 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:48.650810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f0262-dd10-4aef-8cda-f61191865121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:48.715166 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-239f0262-dd10-4aef-8cda-f61191865121 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:48.716298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-239f0262-dd10-4aef-8cda-f61191865121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:48.734469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:48.815699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:30:48.851734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579938a-d1c4-4d1a-921d-0736a57b7a71 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:48.853295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6579938a-d1c4-4d1a-921d-0736a57b7a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:48.955719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579938a-d1c4-4d1a-921d-0736a57b7a71 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:49.022041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:49.029802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588aae86-74a5-492e-9438-4d718729e710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:49.030449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aae86-74a5-492e-9438-4d718729e710 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:49.030737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aae86-74a5-492e-9438-4d718729e710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:49.031020 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aae86-74a5-492e-9438-4d718729e710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:49.032694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-588aae86-74a5-492e-9438-4d718729e710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:49.140527 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588aae86-74a5-492e-9438-4d718729e710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:49.141986 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588aae86-74a5-492e-9438-4d718729e710 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:49.160530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 723/1467] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:51.231752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e92c8-66e2-4d99-90b0-f5e5b6606b78 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:51.232291 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e92c8-66e2-4d99-90b0-f5e5b6606b78 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:51.232452 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e92c8-66e2-4d99-90b0-f5e5b6606b78 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:51.233742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:30:51.239253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9ea70-9ed0-4b2f-bf01-8e20b0350f73 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:51.239682 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9ea70-9ed0-4b2f-bf01-8e20b0350f73 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:51.239849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9ea70-9ed0-4b2f-bf01-8e20b0350f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:51.304569 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1da9ea70-9ed0-4b2f-bf01-8e20b0350f73 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:30:51.305770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1da9ea70-9ed0-4b2f-bf01-8e20b0350f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:51.353117 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:51.401444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:30:51.444471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e92c8-66e2-4d99-90b0-f5e5b6606b78 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:30:51.446200 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d19e92c8-66e2-4d99-90b0-f5e5b6606b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:51.548319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e92c8-66e2-4d99-90b0-f5e5b6606b78 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:30:51.594999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:51.625220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f2637-7595-4efd-a1b0-f68da21438ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:30:51.625866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f2637-7595-4efd-a1b0-f68da21438ac service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:30:51.626149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f2637-7595-4efd-a1b0-f68da21438ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:30:51.626425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f2637-7595-4efd-a1b0-f68da21438ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:30:51.628078 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-aa0f2637-7595-4efd-a1b0-f68da21438ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:30:51.735419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f2637-7595-4efd-a1b0-f68da21438ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:30:51.737599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f2637-7595-4efd-a1b0-f68da21438ac service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:30:51.755651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 746/1470] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:30:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:31:01.399345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=22 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:01.753384 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=66 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:11.315531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305f454-650c-48ac-bd5c-883ec3df7e81 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:11.316072 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305f454-650c-48ac-bd5c-883ec3df7e81 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:11.316072 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305f454-650c-48ac-bd5c-883ec3df7e81 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:11.317896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 725/1471] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:31:11.323160 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5ed8c-82eb-4f0b-9102-c6ef8967d8b5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:11.323589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5ed8c-82eb-4f0b-9102-c6ef8967d8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:11.323720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5ed8c-82eb-4f0b-9102-c6ef8967d8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:11.387685 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-46f5ed8c-82eb-4f0b-9102-c6ef8967d8b5 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:31:11.388927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-46f5ed8c-82eb-4f0b-9102-c6ef8967d8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:11.486021 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 747/1472] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:31:11.534214 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff54839-9e2c-4013-8ff2-414ba48b244a None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:11.534508 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff54839-9e2c-4013-8ff2-414ba48b244a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:11.534792 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff54839-9e2c-4013-8ff2-414ba48b244a None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:11.536156 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 726/1473] 10.222.0.66 () {54 vars in 960 bytes} [Fri Jul 15 20:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:31:11.541764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aed6fc-3184-40b4-8114-4230c245043e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:11.542057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aed6fc-3184-40b4-8114-4230c245043e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:11.542358 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aed6fc-3184-40b4-8114-4230c245043e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:11.616319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-17aed6fc-3184-40b4-8114-4230c245043e None None] MFA Rules not processed for user `93958c7dad0540b296b316169932d474`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:31:11.617488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-17aed6fc-3184-40b4-8114-4230c245043e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:11.638010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:11.696713 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 748/1474] 10.222.0.66 () {58 vars in 1057 bytes} [Fri Jul 15 20:31:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:31:11.704110 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff54839-9e2c-4013-8ff2-414ba48b244a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:31:11.705643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7ff54839-9e2c-4013-8ff2-414ba48b244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:11.809644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff54839-9e2c-4013-8ff2-414ba48b244a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:31:11.880865 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db103ec-7037-47c7-804e-11a5f24e4094 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93958c7dad0540b296b316169932d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:31:11.881429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db103ec-7037-47c7-804e-11a5f24e4094 service glance] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:11.881708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db103ec-7037-47c7-804e-11a5f24e4094 service glance] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:11.881981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db103ec-7037-47c7-804e-11a5f24e4094 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:11.883600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0db103ec-7037-47c7-804e-11a5f24e4094 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:11.937621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:11.990955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db103ec-7037-47c7-804e-11a5f24e4094 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:31:11.992407 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db103ec-7037-47c7-804e-11a5f24e4094 service glance] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:31:12.010671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 727/1475] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:31:14.134280 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d049f-b39b-4549-a872-fd824bb10fd2 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:14.135478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d049f-b39b-4549-a872-fd824bb10fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:14.135478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d049f-b39b-4549-a872-fd824bb10fd2 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:14.136896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 749/1476] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:31:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:31:14.142180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acea7b-882e-434e-a049-26397dabb8d3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:14.142608 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acea7b-882e-434e-a049-26397dabb8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:14.142739 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acea7b-882e-434e-a049-26397dabb8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:14.205984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-01acea7b-882e-434e-a049-26397dabb8d3 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:31:14.207176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-01acea7b-882e-434e-a049-26397dabb8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:14.302468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 728/1477] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:31:14.326310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d049f-b39b-4549-a872-fd824bb10fd2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:31:14.327834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-842d049f-b39b-4549-a872-fd824bb10fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:14.454600 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d049f-b39b-4549-a872-fd824bb10fd2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:31:14.505169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:14.549866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c3b57-ce2c-4e7a-bfe9-d4f7fb4bc880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:31:14.550525 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c3b57-ce2c-4e7a-bfe9-d4f7fb4bc880 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:14.550814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c3b57-ce2c-4e7a-bfe9-d4f7fb4bc880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:14.551094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c3b57-ce2c-4e7a-bfe9-d4f7fb4bc880 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:14.551823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c3b57-ce2c-4e7a-bfe9-d4f7fb4bc880 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:31:14.553568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: WARNING py.warnings [None req-345c3b57-ce2c-4e7a-bfe9-d4f7fb4bc880 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:31:14.553568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: warnings.warn(msg) Jul 15 20:31:14.553568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: Jul 15 20:31:14.554713 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c3b57-ce2c-4e7a-bfe9-d4f7fb4bc880 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:31:14.574426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 750/1478] 10.222.0.66 () {56 vars in 1108 bytes} [Fri Jul 15 20:31:14 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:31:16.623317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4220c6-5623-452c-bfaa-0bec1788f15f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:16.623869 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4220c6-5623-452c-bfaa-0bec1788f15f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:16.623869 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4220c6-5623-452c-bfaa-0bec1788f15f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:16.625280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 729/1479] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:31:16.630511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065db0c5-a4f2-48ec-bb59-22c21a2f3721 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:16.630904 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065db0c5-a4f2-48ec-bb59-22c21a2f3721 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:16.631089 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065db0c5-a4f2-48ec-bb59-22c21a2f3721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:16.697467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-065db0c5-a4f2-48ec-bb59-22c21a2f3721 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:31:16.698691 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-065db0c5-a4f2-48ec-bb59-22c21a2f3721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:16.797510 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 751/1480] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:31:16.840174 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4220c6-5623-452c-bfaa-0bec1788f15f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:31:16.841814 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0d4220c6-5623-452c-bfaa-0bec1788f15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:16.851567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:16.990040 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4220c6-5623-452c-bfaa-0bec1788f15f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:31:17.071626 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:17.105865 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bfc77-0d06-4974-b69c-1d9c8f4d04ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:31:17.106508 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bfc77-0d06-4974-b69c-1d9c8f4d04ca service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:17.106789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bfc77-0d06-4974-b69c-1d9c8f4d04ca service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:17.107063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bfc77-0d06-4974-b69c-1d9c8f4d04ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:17.108744 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0a0bfc77-0d06-4974-b69c-1d9c8f4d04ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:17.199046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bfc77-0d06-4974-b69c-1d9c8f4d04ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:31:17.200677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bfc77-0d06-4974-b69c-1d9c8f4d04ca service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:31:17.220125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 730/1481] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:31:19.439882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f696d4f-0824-4419-b9fd-7679e92f2abd None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:19.440465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f696d4f-0824-4419-b9fd-7679e92f2abd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:19.440629 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f696d4f-0824-4419-b9fd-7679e92f2abd None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:19.442039 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 752/1482] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:31:19.448029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d32137-a906-4125-937c-ce24521aa703 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:19.448480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d32137-a906-4125-937c-ce24521aa703 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:19.448593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d32137-a906-4125-937c-ce24521aa703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:19.513147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b6d32137-a906-4125-937c-ce24521aa703 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:31:19.514366 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b6d32137-a906-4125-937c-ce24521aa703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:19.560712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:19.610658 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 731/1483] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:31:19.646932 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f696d4f-0824-4419-b9fd-7679e92f2abd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:31:19.648469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2f696d4f-0824-4419-b9fd-7679e92f2abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:19.673088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:19.755232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f696d4f-0824-4419-b9fd-7679e92f2abd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:31:19.829491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a26488-6813-4497-a4e9-bd5df71eac2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:31:19.830138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a26488-6813-4497-a4e9-bd5df71eac2d service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:19.830423 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a26488-6813-4497-a4e9-bd5df71eac2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:19.830702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a26488-6813-4497-a4e9-bd5df71eac2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:19.832365 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-10a26488-6813-4497-a4e9-bd5df71eac2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:19.905233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:19.940297 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a26488-6813-4497-a4e9-bd5df71eac2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:31:19.941767 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a26488-6813-4497-a4e9-bd5df71eac2d service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:31:19.961009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 753/1484] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:31:22.037583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced27346-1c4a-4670-a87a-b282cf22beb2 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:22.037970 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced27346-1c4a-4670-a87a-b282cf22beb2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:22.038256 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced27346-1c4a-4670-a87a-b282cf22beb2 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:22.039733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 732/1485] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:31:22.046108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097716-32c3-4b76-9930-b27baf70db48 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:22.046576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097716-32c3-4b76-9930-b27baf70db48 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:22.046676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097716-32c3-4b76-9930-b27baf70db48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:22.112493 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-31097716-32c3-4b76-9930-b27baf70db48 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:31:22.113701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-31097716-32c3-4b76-9930-b27baf70db48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:22.221196 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 754/1486] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:31:22.260471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced27346-1c4a-4670-a87a-b282cf22beb2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:31:22.262029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ced27346-1c4a-4670-a87a-b282cf22beb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:22.365006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced27346-1c4a-4670-a87a-b282cf22beb2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:31:22.436234 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:22.438217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749337b7-c247-4ac7-9707-bad8bfbaa74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:31:22.439051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749337b7-c247-4ac7-9707-bad8bfbaa74c service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:22.439599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749337b7-c247-4ac7-9707-bad8bfbaa74c service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:22.439923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749337b7-c247-4ac7-9707-bad8bfbaa74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:22.442033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-749337b7-c247-4ac7-9707-bad8bfbaa74c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:22.549515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749337b7-c247-4ac7-9707-bad8bfbaa74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:31:22.550951 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749337b7-c247-4ac7-9707-bad8bfbaa74c service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:31:22.573782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 733/1487] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:31:24.768573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97403443-4abc-45c5-a401-99083ae6aa14 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:24.769126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97403443-4abc-45c5-a401-99083ae6aa14 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:24.769221 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97403443-4abc-45c5-a401-99083ae6aa14 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:24.770546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 755/1488] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:31:24.776458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4826744-54eb-4c1a-ab1d-0e0688381840 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:24.776851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4826744-54eb-4c1a-ab1d-0e0688381840 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:24.777011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4826744-54eb-4c1a-ab1d-0e0688381840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:24.841694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a4826744-54eb-4c1a-ab1d-0e0688381840 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:31:24.842811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a4826744-54eb-4c1a-ab1d-0e0688381840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:24.895235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:24.938914 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 734/1489] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:31:24.978916 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97403443-4abc-45c5-a401-99083ae6aa14 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:31:24.980472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-97403443-4abc-45c5-a401-99083ae6aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:25.021582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:25.091916 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97403443-4abc-45c5-a401-99083ae6aa14 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:31:25.165521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692973-3b44-48a9-816b-79fc67623444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:31:25.166897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692973-3b44-48a9-816b-79fc67623444 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:25.167186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692973-3b44-48a9-816b-79fc67623444 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:25.167464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692973-3b44-48a9-816b-79fc67623444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:25.169138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-46692973-3b44-48a9-816b-79fc67623444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:25.251288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:25.282034 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46692973-3b44-48a9-816b-79fc67623444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:31:25.283483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46692973-3b44-48a9-816b-79fc67623444 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:31:25.302479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 756/1490] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:31:27.574090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6834513-7b09-41b5-8529-9872c22d95ce None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:27.574577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6834513-7b09-41b5-8529-9872c22d95ce None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:27.574691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6834513-7b09-41b5-8529-9872c22d95ce None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:27.576027 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 735/1491] 10.222.0.66 () {54 vars in 926 bytes} [Fri Jul 15 20:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:31:27.581445 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf61b6a-8cac-4e06-a08b-26025495ce98 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:27.581871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf61b6a-8cac-4e06-a08b-26025495ce98 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:27.582003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf61b6a-8cac-4e06-a08b-26025495ce98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:27.645795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9bf61b6a-8cac-4e06-a08b-26025495ce98 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:31:27.646988 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9bf61b6a-8cac-4e06-a08b-26025495ce98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:27.742547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 757/1492] 10.222.0.66 () {58 vars in 1023 bytes} [Fri Jul 15 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:31:27.782332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6834513-7b09-41b5-8529-9872c22d95ce None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:31:27.783962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d6834513-7b09-41b5-8529-9872c22d95ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:27.888522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6834513-7b09-41b5-8529-9872c22d95ce None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:31:27.960439 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9c11e-4608-4e6f-8dea-552b4ae5f837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:31:27.961084 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c11e-4608-4e6f-8dea-552b4ae5f837 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:31:27.961368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c11e-4608-4e6f-8dea-552b4ae5f837 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:31:27.961645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c11e-4608-4e6f-8dea-552b4ae5f837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:31:27.964020 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-82e9c11e-4608-4e6f-8dea-552b4ae5f837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:31:27.972876 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:28.071490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9c11e-4608-4e6f-8dea-552b4ae5f837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:31:28.073424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9c11e-4608-4e6f-8dea-552b4ae5f837 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:31:28.091079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 736/1493] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:31:37.740727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=82 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:38.088887 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=50 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:32:55.166241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7cf05-211e-4fc6-b287-c2ead1e9c302 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:55.166848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7cf05-211e-4fc6-b287-c2ead1e9c302 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:55.166848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7cf05-211e-4fc6-b287-c2ead1e9c302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:55.240950 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ccd7cf05-211e-4fc6-b287-c2ead1e9c302 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:32:55.242678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ccd7cf05-211e-4fc6-b287-c2ead1e9c302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:55.336544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 758/1494] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:32:55.345152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00490-44be-4a4b-a3de-400f688bb2a7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:55.345648 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00490-44be-4a4b-a3de-400f688bb2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:55.345776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00490-44be-4a4b-a3de-400f688bb2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:55.420129 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-dfc00490-44be-4a4b-a3de-400f688bb2a7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:32:55.421345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dfc00490-44be-4a4b-a3de-400f688bb2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:55.515230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 737/1495] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:32:55.519952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7cf05-211e-4fc6-b287-c2ead1e9c302 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:32:55.521195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ccd7cf05-211e-4fc6-b287-c2ead1e9c302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:55.532966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7cf05-211e-4fc6-b287-c2ead1e9c302 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:32:55.594327 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:32:55.630304 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964e361-2013-4576-af6e-e768e46c0b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:32:55.630975 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e361-2013-4576-af6e-e768e46c0b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:55.631261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e361-2013-4576-af6e-e768e46c0b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:55.631538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e361-2013-4576-af6e-e768e46c0b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:55.632302 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964e361-2013-4576-af6e-e768e46c0b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:32:55.632791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964e361-2013-4576-af6e-e768e46c0b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:32:55.633841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: WARNING py.warnings [None req-a964e361-2013-4576-af6e-e768e46c0b00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:32:55.633841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: warnings.warn(msg) Jul 15 20:32:55.633841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: Jul 15 20:32:55.634730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964e361-2013-4576-af6e-e768e46c0b00 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:32:55.645878 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 759/1496] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:32:55.654215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00490-44be-4a4b-a3de-400f688bb2a7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:32:55.663301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00490-44be-4a4b-a3de-400f688bb2a7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:32:55.723689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:32:55.759117 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b4b11-270d-4526-bbeb-cd0b155342d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:32:55.759784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4b11-270d-4526-bbeb-cd0b155342d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:55.760071 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4b11-270d-4526-bbeb-cd0b155342d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:55.760351 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4b11-270d-4526-bbeb-cd0b155342d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:55.761080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b4b11-270d-4526-bbeb-cd0b155342d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:32:55.762812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: WARNING py.warnings [None req-b87b4b11-270d-4526-bbeb-cd0b155342d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:32:55.762812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: warnings.warn(msg) Jul 15 20:32:55.762812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: Jul 15 20:32:55.764015 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b4b11-270d-4526-bbeb-cd0b155342d7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:32:55.818142 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 738/1497] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:32:55 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:32:55.822776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964e361-2013-4576-af6e-e768e46c0b00 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:32:55.824272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a964e361-2013-4576-af6e-e768e46c0b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:55.858365 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964e361-2013-4576-af6e-e768e46c0b00 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:32:55.953621 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ac81b-0947-47a0-863c-08fb5af5652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:32:55.954303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ac81b-0947-47a0-863c-08fb5af5652d admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:55.954593 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ac81b-0947-47a0-863c-08fb5af5652d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:55.954876 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ac81b-0947-47a0-863c-08fb5af5652d admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:55.955585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ac81b-0947-47a0-863c-08fb5af5652d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:32:55.956641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: WARNING py.warnings [None req-0f1ac81b-0947-47a0-863c-08fb5af5652d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:32:55.956641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: warnings.warn(msg) Jul 15 20:32:55.956641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: Jul 15 20:32:55.957871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ac81b-0947-47a0-863c-08fb5af5652d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:32:56.001105 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 760/1498] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:32:55 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:32:56.004509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b4b11-270d-4526-bbeb-cd0b155342d7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:32:56.006054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b87b4b11-270d-4526-bbeb-cd0b155342d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:56.069603 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b4b11-270d-4526-bbeb-cd0b155342d7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:32:56.152179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:32:56.163320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728bb43-8408-4362-af36-bb9db810a51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:32:56.164580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728bb43-8408-4362-af36-bb9db810a51b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:56.164839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728bb43-8408-4362-af36-bb9db810a51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:56.165111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728bb43-8408-4362-af36-bb9db810a51b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:56.165821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728bb43-8408-4362-af36-bb9db810a51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:32:56.166825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: WARNING py.warnings [None req-9728bb43-8408-4362-af36-bb9db810a51b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:32:56.166825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: warnings.warn(msg) Jul 15 20:32:56.166825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: Jul 15 20:32:56.167961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728bb43-8408-4362-af36-bb9db810a51b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:32:56.180169 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 739/1499] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:32:56.184176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ac81b-0947-47a0-863c-08fb5af5652d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:32:56.185818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0f1ac81b-0947-47a0-863c-08fb5af5652d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:56.198168 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ac81b-0947-47a0-863c-08fb5af5652d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:32:56.225027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:32:56.298093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a1e5b-d1a3-4702-ac27-b5c0f8782c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:32:56.298763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a1e5b-d1a3-4702-ac27-b5c0f8782c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:56.299053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a1e5b-d1a3-4702-ac27-b5c0f8782c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:56.299332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a1e5b-d1a3-4702-ac27-b5c0f8782c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:56.300053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a1e5b-d1a3-4702-ac27-b5c0f8782c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:32:56.301113 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: WARNING py.warnings [None req-d77a1e5b-d1a3-4702-ac27-b5c0f8782c81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:32:56.301113 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: warnings.warn(msg) Jul 15 20:32:56.301113 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: Jul 15 20:32:56.302002 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a1e5b-d1a3-4702-ac27-b5c0f8782c81 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:32:56.314188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 761/1500] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:32:56.318389 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728bb43-8408-4362-af36-bb9db810a51b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:32:56.320595 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9728bb43-8408-4362-af36-bb9db810a51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:56.355491 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728bb43-8408-4362-af36-bb9db810a51b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:32:56.450843 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e9396-3bf6-40dd-9ce3-12550d74de7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:32:56.451647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e9396-3bf6-40dd-9ce3-12550d74de7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:56.451940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e9396-3bf6-40dd-9ce3-12550d74de7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:56.452214 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e9396-3bf6-40dd-9ce3-12550d74de7b admin admin] PATH_INFO: `/v3/projects/16caebc1d73d43af97cf276febf0b025/users/435e99bbfa68499599e2f91e3d0a3e9b/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:56.474944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e9396-3bf6-40dd-9ce3-12550d74de7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=16caebc1d73d43af97cf276febf0b025, user_id=435e99bbfa68499599e2f91e3d0a3e9b, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:32:56.475986 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: WARNING py.warnings [None req-514e9396-3bf6-40dd-9ce3-12550d74de7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:32:56.475986 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: warnings.warn(msg) Jul 15 20:32:56.475986 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: Jul 15 20:32:56.477966 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e9396-3bf6-40dd-9ce3-12550d74de7b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:32:56.502371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 740/1501] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:32:56 2022] PUT /identity/v3/projects/16caebc1d73d43af97cf276febf0b025/users/435e99bbfa68499599e2f91e3d0a3e9b/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:32:56.515343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f686-ba8a-4ef5-a400-6fda9526fd95 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:56.515639 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f686-ba8a-4ef5-a400-6fda9526fd95 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:56.515920 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f686-ba8a-4ef5-a400-6fda9526fd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:56.571645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5bc0f686-ba8a-4ef5-a400-6fda9526fd95 None None] MFA Rules not processed for user `435e99bbfa68499599e2f91e3d0a3e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:32:56.572883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5bc0f686-ba8a-4ef5-a400-6fda9526fd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:56.651484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 762/1502] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:32:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:32:56.667442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27273-6b3b-4f9f-b09b-d231dc9774da None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:56.667735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27273-6b3b-4f9f-b09b-d231dc9774da None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:56.668012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27273-6b3b-4f9f-b09b-d231dc9774da None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:56.669397 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 741/1503] 10.222.0.66 () {54 vars in 963 bytes} [Fri Jul 15 20:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:32:56.674222 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5b75d-ed89-48de-96c2-8461a0d8b067 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:56.674517 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5b75d-ed89-48de-96c2-8461a0d8b067 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:56.674799 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5b75d-ed89-48de-96c2-8461a0d8b067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:56.707699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:32:56.751608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-98e5b75d-ed89-48de-96c2-8461a0d8b067 None None] MFA Rules not processed for user `1d4739b31f6647d89132f79f3f811d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:32:56.752921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-98e5b75d-ed89-48de-96c2-8461a0d8b067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:56.829253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 763/1504] 10.222.0.66 () {58 vars in 1060 bytes} [Fri Jul 15 20:32:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:32:56.837240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec27273-6b3b-4f9f-b09b-d231dc9774da None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:32:56.838738 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eec27273-6b3b-4f9f-b09b-d231dc9774da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:56.888104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:32:56.942314 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec27273-6b3b-4f9f-b09b-d231dc9774da None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:32:57.020142 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee53ac-5a50-4adb-920d-a79e7a039c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:32:57.020743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee53ac-5a50-4adb-920d-a79e7a039c93 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:57.021030 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee53ac-5a50-4adb-920d-a79e7a039c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:57.021309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee53ac-5a50-4adb-920d-a79e7a039c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:57.023009 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f1ee53ac-5a50-4adb-920d-a79e7a039c93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:57.120581 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee53ac-5a50-4adb-920d-a79e7a039c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:32:57.122024 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee53ac-5a50-4adb-920d-a79e7a039c93 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:32:57.125523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:32:57.140232 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 742/1505] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:32:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:32:57.184153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070d971-2ecc-438e-8bcf-62aae98351a9 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:57.184473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070d971-2ecc-438e-8bcf-62aae98351a9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:57.184973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070d971-2ecc-438e-8bcf-62aae98351a9 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:57.186082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 764/1506] 10.222.0.66 () {52 vars in 829 bytes} [Fri Jul 15 20:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:32:57.189565 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee53ac-5a50-4adb-920d-a79e7a039c93 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:32:57.190802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f1ee53ac-5a50-4adb-920d-a79e7a039c93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:57.294000 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee53ac-5a50-4adb-920d-a79e7a039c93 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:32:57.389449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:32:57.390316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:57.390597 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:57.390872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] PATH_INFO: `/v3/users/435e99bbfa68499599e2f91e3d0a3e9b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:57.403184 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435e99bbfa68499599e2f91e3d0a3e9b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:32:57.404242 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: WARNING py.warnings [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:32:57.404242 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: warnings.warn(msg) Jul 15 20:32:57.404242 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: Jul 15 20:32:57.405509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:32:57.415073 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:32:57.471939 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435e99bbfa68499599e2f91e3d0a3e9b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:32:57.493340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435e99bbfa68499599e2f91e3d0a3e9b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:32:57.493814 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435e99bbfa68499599e2f91e3d0a3e9b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:32:57.505517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435e99bbfa68499599e2f91e3d0a3e9b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:32:57.506050 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435e99bbfa68499599e2f91e3d0a3e9b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:32:57.521282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 743/1507] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:32:57 2022] DELETE /identity/v3/users/435e99bbfa68499599e2f91e3d0a3e9b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:32:57.525915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21290-09c1-4718-832b-73f2ee6738fc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:57.526211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21290-09c1-4718-832b-73f2ee6738fc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:57.526491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21290-09c1-4718-832b-73f2ee6738fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:57.582697 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b6b21290-09c1-4718-832b-73f2ee6738fc None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:32:57.583833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b6b21290-09c1-4718-832b-73f2ee6738fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:57.657758 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:32:57.671368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 765/1508] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:32:57.681610 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:32:57.682994 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:57.782192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0ae8-77f8-4ad7-8a13-ac58ceb09777 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:32:57.841823 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:32:57.862119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a16f1-7a27-4c0e-92c0-92113a5b8b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:32:57.862775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a16f1-7a27-4c0e-92c0-92113a5b8b9a service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:57.863060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a16f1-7a27-4c0e-92c0-92113a5b8b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:57.863340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a16f1-7a27-4c0e-92c0-92113a5b8b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:57.865016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c10a16f1-7a27-4c0e-92c0-92113a5b8b9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:57.973699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a16f1-7a27-4c0e-92c0-92113a5b8b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:32:57.975158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a16f1-7a27-4c0e-92c0-92113a5b8b9a service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:32:57.996079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 744/1509] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:32:58.357791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21290-09c1-4718-832b-73f2ee6738fc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:32:58.359141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b6b21290-09c1-4718-832b-73f2ee6738fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:32:58.372055 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21290-09c1-4718-832b-73f2ee6738fc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:32:58.469658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969814c3-57a9-4cce-9667-02eff371cd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:32:58.470525 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969814c3-57a9-4cce-9667-02eff371cd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:32:58.470806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969814c3-57a9-4cce-9667-02eff371cd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:32:58.471080 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969814c3-57a9-4cce-9667-02eff371cd59 admin admin] PATH_INFO: `/v3/projects/16caebc1d73d43af97cf276febf0b025` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:32:58.481399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969814c3-57a9-4cce-9667-02eff371cd59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16caebc1d73d43af97cf276febf0b025)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:32:58.482426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: WARNING py.warnings [None req-969814c3-57a9-4cce-9667-02eff371cd59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:32:58.482426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: warnings.warn(msg) Jul 15 20:32:58.482426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: Jul 15 20:32:58.483628 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969814c3-57a9-4cce-9667-02eff371cd59 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:32:58.540356 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-969814c3-57a9-4cce-9667-02eff371cd59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16caebc1d73d43af97cf276febf0b025', 'request_id': 'req-969814c3-57a9-4cce-9667-02eff371cd59'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:32:58.553580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-969814c3-57a9-4cce-9667-02eff371cd59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16caebc1d73d43af97cf276febf0b025', 'request_id': 'req-969814c3-57a9-4cce-9667-02eff371cd59'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:32:58.560211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-969814c3-57a9-4cce-9667-02eff371cd59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16caebc1d73d43af97cf276febf0b025', 'request_id': 'req-969814c3-57a9-4cce-9667-02eff371cd59'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:32:58.586289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-969814c3-57a9-4cce-9667-02eff371cd59 admin admin] The token cache is being invalidate because project 16caebc1d73d43af97cf276febf0b025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:32:58.586575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-969814c3-57a9-4cce-9667-02eff371cd59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:32:58.587003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-969814c3-57a9-4cce-9667-02eff371cd59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:32:58.588475 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 766/1510] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:32:58 2022] DELETE /identity/v3/projects/16caebc1d73d43af97cf276febf0b025 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:33:07.993767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=62 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:33:08.584231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:34:38.045963 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53546c-91f7-4dd1-bb92-cc88fdefd22e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:38.046513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53546c-91f7-4dd1-bb92-cc88fdefd22e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:38.046513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53546c-91f7-4dd1-bb92-cc88fdefd22e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:38.047859 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:34:38.053052 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6264b-ca0b-4dbd-97fc-b5774962bc3e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:38.053455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6264b-ca0b-4dbd-97fc-b5774962bc3e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:38.053614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6264b-ca0b-4dbd-97fc-b5774962bc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:38.146063 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-75e6264b-ca0b-4dbd-97fc-b5774962bc3e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:34:38.147276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-75e6264b-ca0b-4dbd-97fc-b5774962bc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:34:38.253764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:34:38.414625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53546c-91f7-4dd1-bb92-cc88fdefd22e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:34:38.416849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2c53546c-91f7-4dd1-bb92-cc88fdefd22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:34:38.536941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53546c-91f7-4dd1-bb92-cc88fdefd22e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:34:38.543213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217faf43-0b30-4802-b1f7-d3ab5497c29a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:34:38.543857 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217faf43-0b30-4802-b1f7-d3ab5497c29a service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:38.544140 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217faf43-0b30-4802-b1f7-d3ab5497c29a service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:38.544509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217faf43-0b30-4802-b1f7-d3ab5497c29a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:38.552486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217faf43-0b30-4802-b1f7-d3ab5497c29a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:34:38.554806 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217faf43-0b30-4802-b1f7-d3ab5497c29a service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:34:38.564573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 746/1513] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:34:39.393504 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533fda0-dda8-4e10-926e-4b158ca70dc1 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:39.394042 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533fda0-dda8-4e10-926e-4b158ca70dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:39.394143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533fda0-dda8-4e10-926e-4b158ca70dc1 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:39.395456 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 768/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:34:39.400947 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7d75b-8535-43e1-9817-fd376b3df51d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:39.401382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7d75b-8535-43e1-9817-fd376b3df51d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:39.401490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7d75b-8535-43e1-9817-fd376b3df51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:39.419652 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a0a7d75b-8535-43e1-9817-fd376b3df51d None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:34:39.420880 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a0a7d75b-8535-43e1-9817-fd376b3df51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:34:39.429309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 747/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:34:39.586062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533fda0-dda8-4e10-926e-4b158ca70dc1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:34:39.601201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533fda0-dda8-4e10-926e-4b158ca70dc1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:34:39.607153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd4ecd-7924-4bb1-bc44-dd48e50df86d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:34:39.607792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4ecd-7924-4bb1-bc44-dd48e50df86d service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:39.608072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4ecd-7924-4bb1-bc44-dd48e50df86d service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:39.608345 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4ecd-7924-4bb1-bc44-dd48e50df86d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:39.617816 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd4ecd-7924-4bb1-bc44-dd48e50df86d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:34:39.619513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd4ecd-7924-4bb1-bc44-dd48e50df86d service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:34:39.629392 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 769/1516] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:34:40.167922 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba559e-dae1-4c25-b449-86fcdc5b4fa9 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:40.168207 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba559e-dae1-4c25-b449-86fcdc5b4fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:40.168513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba559e-dae1-4c25-b449-86fcdc5b4fa9 None None] PATH_INFO: `/v3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:40.169814 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 748/1517] 10.222.0.64 () {54 vars in 925 bytes} [Fri Jul 15 20:34:40 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:34:40.184083 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bb24c-afd1-422e-9095-7eaf4f92ed38 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:40.184375 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bb24c-afd1-422e-9095-7eaf4f92ed38 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:40.184709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bb24c-afd1-422e-9095-7eaf4f92ed38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:40.241033 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f28bb24c-afd1-422e-9095-7eaf4f92ed38 None None] MFA Rules not processed for user `6693dd1ea26049c1ac8460faf1bc9b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:34:40.242821 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f28bb24c-afd1-422e-9095-7eaf4f92ed38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:34:40.259240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:34:40.314624 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 770/1518] 10.222.0.64 () {58 vars in 1015 bytes} [Fri Jul 15 20:34:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:34:44.251666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c39db5-d4fd-48f7-aae9-efc00ac4bca7 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:44.252121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c39db5-d4fd-48f7-aae9-efc00ac4bca7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:44.252221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c39db5-d4fd-48f7-aae9-efc00ac4bca7 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:44.253627 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 749/1519] 10.222.0.66 () {54 vars in 960 bytes} [Fri Jul 15 20:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:34:44.259321 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a914c9-c8fe-473f-8523-2e38436c84ec None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:44.259789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a914c9-c8fe-473f-8523-2e38436c84ec None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:44.259894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a914c9-c8fe-473f-8523-2e38436c84ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:44.278686 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-41a914c9-c8fe-473f-8523-2e38436c84ec None None] MFA Rules not processed for user `6693dd1ea26049c1ac8460faf1bc9b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:34:44.279891 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-41a914c9-c8fe-473f-8523-2e38436c84ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:34:44.288495 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 771/1520] 10.222.0.66 () {58 vars in 1057 bytes} [Fri Jul 15 20:34:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:34:44.297014 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c39db5-d4fd-48f7-aae9-efc00ac4bca7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:34:44.310957 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c39db5-d4fd-48f7-aae9-efc00ac4bca7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:34:44.315892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60352cc5-e8e0-4366-b95b-f504decea229 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6693dd1ea26049c1ac8460faf1bc9b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:34:44.316569 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352cc5-e8e0-4366-b95b-f504decea229 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:44.316885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352cc5-e8e0-4366-b95b-f504decea229 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:44.317163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352cc5-e8e0-4366-b95b-f504decea229 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:44.325498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352cc5-e8e0-4366-b95b-f504decea229 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:34:44.327084 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352cc5-e8e0-4366-b95b-f504decea229 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:34:44.337247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 750/1521] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:34:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:34:50.900473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9808b0-aab8-4de5-9808-b8bc2c273c21 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:50.901009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9808b0-aab8-4de5-9808-b8bc2c273c21 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:50.901124 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9808b0-aab8-4de5-9808-b8bc2c273c21 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:50.902502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:34:50.907316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee5476-f9a7-44ea-9274-17d3cf51375b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:50.907753 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee5476-f9a7-44ea-9274-17d3cf51375b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:50.907871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee5476-f9a7-44ea-9274-17d3cf51375b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:50.926458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-96ee5476-f9a7-44ea-9274-17d3cf51375b None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:34:50.927651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-96ee5476-f9a7-44ea-9274-17d3cf51375b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:34:50.935598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:34:51.088360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9808b0-aab8-4de5-9808-b8bc2c273c21 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:34:51.104014 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9808b0-aab8-4de5-9808-b8bc2c273c21 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:34:51.109459 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc20fdd-b7db-448f-8366-072adb9ad41a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:34:51.110100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc20fdd-b7db-448f-8366-072adb9ad41a service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:51.110390 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc20fdd-b7db-448f-8366-072adb9ad41a service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:51.110673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc20fdd-b7db-448f-8366-072adb9ad41a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:51.119258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc20fdd-b7db-448f-8366-072adb9ad41a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:34:51.120889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc20fdd-b7db-448f-8366-072adb9ad41a service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:34:51.130208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 773/1524] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:34:51.966857 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5882bf-bf1e-4751-89ad-4586c75ad941 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:51.967419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5882bf-bf1e-4751-89ad-4586c75ad941 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:51.967419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5882bf-bf1e-4751-89ad-4586c75ad941 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:51.968829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 20:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:34:51.973556 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f5f3-afdf-4e76-a576-a41ba513bd06 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:51.974010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f5f3-afdf-4e76-a576-a41ba513bd06 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:51.974118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f5f3-afdf-4e76-a576-a41ba513bd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:51.993248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7436f5f3-afdf-4e76-a576-a41ba513bd06 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:34:51.994449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7436f5f3-afdf-4e76-a576-a41ba513bd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:34:52.002392 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 20:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:34:52.153656 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5882bf-bf1e-4751-89ad-4586c75ad941 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:34:52.168295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5882bf-bf1e-4751-89ad-4586c75ad941 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:34:52.173593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6fd04-e421-4838-b217-cb31510c90c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:34:52.174227 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6fd04-e421-4838-b217-cb31510c90c3 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:52.174509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6fd04-e421-4838-b217-cb31510c90c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:52.174785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6fd04-e421-4838-b217-cb31510c90c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:52.183388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6fd04-e421-4838-b217-cb31510c90c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:34:52.185006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6fd04-e421-4838-b217-cb31510c90c3 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:34:52.194447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 753/1527] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:34:56.235830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17fda-3112-4d5c-bcbd-ce6ed559f1f5 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:56.236349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17fda-3112-4d5c-bcbd-ce6ed559f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:56.236349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17fda-3112-4d5c-bcbd-ce6ed559f1f5 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:56.237722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:34:56.243632 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2e79a-f989-4fa8-8087-0b2a71c58367 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:56.244038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2e79a-f989-4fa8-8087-0b2a71c58367 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:56.244195 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2e79a-f989-4fa8-8087-0b2a71c58367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:56.265772 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e1e2e79a-f989-4fa8-8087-0b2a71c58367 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:34:56.266976 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e1e2e79a-f989-4fa8-8087-0b2a71c58367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:34:56.275377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:34:56.314094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a17fda-3112-4d5c-bcbd-ce6ed559f1f5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:34:56.315791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-37a17fda-3112-4d5c-bcbd-ce6ed559f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:34:56.396540 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a17fda-3112-4d5c-bcbd-ce6ed559f1f5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:34:56.400214 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510539b-051b-4e25-9eb1-67818188ed55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:34:56.400892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510539b-051b-4e25-9eb1-67818188ed55 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:56.401179 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510539b-051b-4e25-9eb1-67818188ed55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:56.401461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510539b-051b-4e25-9eb1-67818188ed55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:56.410275 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510539b-051b-4e25-9eb1-67818188ed55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:34:56.411699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510539b-051b-4e25-9eb1-67818188ed55 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:34:56.421712 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 776/1530] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:34:58.408211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b038d8-61b9-4559-b385-7074bffe77ed None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:58.408808 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b038d8-61b9-4559-b385-7074bffe77ed None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:58.408808 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b038d8-61b9-4559-b385-7074bffe77ed None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:58.410211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:34:58.416027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc7d53-2448-4a0f-9a94-cbfee6ac4a6a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:58.416482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc7d53-2448-4a0f-9a94-cbfee6ac4a6a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:58.416638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc7d53-2448-4a0f-9a94-cbfee6ac4a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:58.435720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4cdc7d53-2448-4a0f-9a94-cbfee6ac4a6a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:34:58.436966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4cdc7d53-2448-4a0f-9a94-cbfee6ac4a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:34:58.445112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:34:58.482167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b038d8-61b9-4559-b385-7074bffe77ed None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:34:58.492941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b038d8-61b9-4559-b385-7074bffe77ed None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:34:58.496370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7eb98-d525-4fc4-b070-a9ef9933a097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:34:58.497019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7eb98-d525-4fc4-b070-a9ef9933a097 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:34:58.497302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7eb98-d525-4fc4-b070-a9ef9933a097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:34:58.497577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7eb98-d525-4fc4-b070-a9ef9933a097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:34:58.506347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7eb98-d525-4fc4-b070-a9ef9933a097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:34:58.508130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7eb98-d525-4fc4-b070-a9ef9933a097 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:34:58.517816 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 756/1533] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:35:02.107432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6f41e-6ba8-4e89-bfe0-62d209795447 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:35:02.107991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6f41e-6ba8-4e89-bfe0-62d209795447 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:35:02.107991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6f41e-6ba8-4e89-bfe0-62d209795447 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:35:02.109422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:35:02.114891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a30ca-f063-49f6-bdfc-29b9f38f6bab None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:35:02.115314 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a30ca-f063-49f6-bdfc-29b9f38f6bab None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:35:02.115509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a30ca-f063-49f6-bdfc-29b9f38f6bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:35:02.135700 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ae1a30ca-f063-49f6-bdfc-29b9f38f6bab None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:35:02.136943 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ae1a30ca-f063-49f6-bdfc-29b9f38f6bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:35:02.144805 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:35:02.459665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6f41e-6ba8-4e89-bfe0-62d209795447 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:35:02.461398 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-87c6f41e-6ba8-4e89-bfe0-62d209795447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:35:02.527540 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:35:02.541893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6f41e-6ba8-4e89-bfe0-62d209795447 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:35:02.545735 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3928923-62d0-4a72-b773-bf3810cddc95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:35:02.546382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928923-62d0-4a72-b773-bf3810cddc95 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:35:02.546674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928923-62d0-4a72-b773-bf3810cddc95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:35:02.546956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928923-62d0-4a72-b773-bf3810cddc95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:35:02.557316 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3928923-62d0-4a72-b773-bf3810cddc95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:35:02.559326 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3928923-62d0-4a72-b773-bf3810cddc95 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:35:02.570332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 779/1536] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:35:04.619036 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de7f7-a846-4931-8388-1082292f5299 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:35:04.619601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de7f7-a846-4931-8388-1082292f5299 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:35:04.619601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de7f7-a846-4931-8388-1082292f5299 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:35:04.621040 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 20:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:35:04.626169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402c507-d265-4003-8a4a-37ae9a1a9b95 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:35:04.626575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402c507-d265-4003-8a4a-37ae9a1a9b95 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:35:04.626832 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402c507-d265-4003-8a4a-37ae9a1a9b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:35:04.644608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6402c507-d265-4003-8a4a-37ae9a1a9b95 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:35:04.645820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6402c507-d265-4003-8a4a-37ae9a1a9b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:35:04.654148 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 20:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:35:04.957811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539de7f7-a846-4931-8388-1082292f5299 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:35:04.959511 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-539de7f7-a846-4931-8388-1082292f5299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:35:04.972924 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539de7f7-a846-4931-8388-1082292f5299 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:35:04.976726 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c645b54-12f0-4584-88e5-c8fcd2de8a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:35:04.977373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c645b54-12f0-4584-88e5-c8fcd2de8a08 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:35:04.977659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c645b54-12f0-4584-88e5-c8fcd2de8a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:35:04.977938 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c645b54-12f0-4584-88e5-c8fcd2de8a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:35:04.987136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c645b54-12f0-4584-88e5-c8fcd2de8a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:35:04.988601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c645b54-12f0-4584-88e5-c8fcd2de8a08 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:35:04.998285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 759/1539] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:35:14.639608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=11 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:35:14.994101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:35.447244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce1a58-2d5a-4d6e-bf56-7fed3c35a644 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.449296 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce1a58-2d5a-4d6e-bf56-7fed3c35a644 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.449296 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce1a58-2d5a-4d6e-bf56-7fed3c35a644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.482870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b5ce1a58-2d5a-4d6e-bf56-7fed3c35a644 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:35.484138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b5ce1a58-2d5a-4d6e-bf56-7fed3c35a644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:35.495835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 781/1540] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:35.506342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495e71-792b-41c3-9c7a-dbfc3ce12d97 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.506948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495e71-792b-41c3-9c7a-dbfc3ce12d97 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.506948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495e71-792b-41c3-9c7a-dbfc3ce12d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.545871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d3495e71-792b-41c3-9c7a-dbfc3ce12d97 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:35.547465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d3495e71-792b-41c3-9c7a-dbfc3ce12d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:35.562498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 760/1541] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:35.567612 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce1a58-2d5a-4d6e-bf56-7fed3c35a644 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:35.582396 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce1a58-2d5a-4d6e-bf56-7fed3c35a644 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:35.592671 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c9af5-1813-477a-9d92-f6417eeda608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:35.593620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c9af5-1813-477a-9d92-f6417eeda608 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.594101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c9af5-1813-477a-9d92-f6417eeda608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.594582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c9af5-1813-477a-9d92-f6417eeda608 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.595501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c9af5-1813-477a-9d92-f6417eeda608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:35.596001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c9af5-1813-477a-9d92-f6417eeda608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:35.598729 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c9af5-1813-477a-9d92-f6417eeda608 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:35.615772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 782/1542] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:35.624099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3495e71-792b-41c3-9c7a-dbfc3ce12d97 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:35.635666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3495e71-792b-41c3-9c7a-dbfc3ce12d97 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:35.646858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cf2b9-7f23-43f8-93f0-0d8e68c3e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:35.647540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cf2b9-7f23-43f8-93f0-0d8e68c3e536 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.647829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cf2b9-7f23-43f8-93f0-0d8e68c3e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.648111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cf2b9-7f23-43f8-93f0-0d8e68c3e536 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.648851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91cf2b9-7f23-43f8-93f0-0d8e68c3e536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:35.654366 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91cf2b9-7f23-43f8-93f0-0d8e68c3e536 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:35.656117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb722d1-42ea-4cc5-a9ba-1ddaab1e5bf7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.656649 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb722d1-42ea-4cc5-a9ba-1ddaab1e5bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.657147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb722d1-42ea-4cc5-a9ba-1ddaab1e5bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.685750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1fb722d1-42ea-4cc5-a9ba-1ddaab1e5bf7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:35.694489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1fb722d1-42ea-4cc5-a9ba-1ddaab1e5bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:35.713130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 761/1543] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:35 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:35.717162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 783/1544] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:35.718769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb722d1-42ea-4cc5-a9ba-1ddaab1e5bf7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:35.719783 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d4a15-0c59-4e3b-be04-5dd897e6d5b7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.720077 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d4a15-0c59-4e3b-be04-5dd897e6d5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.720361 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d4a15-0c59-4e3b-be04-5dd897e6d5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.742511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb722d1-42ea-4cc5-a9ba-1ddaab1e5bf7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:35.763791 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7f5d4a15-0c59-4e3b-be04-5dd897e6d5b7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:35.765038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7f5d4a15-0c59-4e3b-be04-5dd897e6d5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:35.878270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ba3d7-46ce-4d2d-917d-4bdc2e064638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:35.879050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ba3d7-46ce-4d2d-917d-4bdc2e064638 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.879326 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ba3d7-46ce-4d2d-917d-4bdc2e064638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.879706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ba3d7-46ce-4d2d-917d-4bdc2e064638 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.880424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ba3d7-46ce-4d2d-917d-4bdc2e064638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:35.884987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ba3d7-46ce-4d2d-917d-4bdc2e064638 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:35.897466 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 762/1545] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:35.899266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2af23-4828-4b8a-82a1-2e2b2f9108bb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.899875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2af23-4828-4b8a-82a1-2e2b2f9108bb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.900338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2af23-4828-4b8a-82a1-2e2b2f9108bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.921936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5cb2af23-4828-4b8a-82a1-2e2b2f9108bb None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:35.923595 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5cb2af23-4828-4b8a-82a1-2e2b2f9108bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:35.924523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 784/1546] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:35 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:35.926688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd14cc-1752-4e0e-a10c-bee46e892453 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.927141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd14cc-1752-4e0e-a10c-bee46e892453 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.927586 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd14cc-1752-4e0e-a10c-bee46e892453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.935100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 763/1547] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:35.936868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936e9d1-f03f-4fd6-85a1-7b888091f7a9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.937358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936e9d1-f03f-4fd6-85a1-7b888091f7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.937816 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936e9d1-f03f-4fd6-85a1-7b888091f7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.950224 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b2dd14cc-1752-4e0e-a10c-bee46e892453 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:35.951446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b2dd14cc-1752-4e0e-a10c-bee46e892453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:35.960496 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 785/1548] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:35.965233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a1013-c6c2-4cf7-ac77-d715a1701ddb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.965233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a1013-c6c2-4cf7-ac77-d715a1701ddb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.965233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a1013-c6c2-4cf7-ac77-d715a1701ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.965562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8936e9d1-f03f-4fd6-85a1-7b888091f7a9 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:35.965562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8936e9d1-f03f-4fd6-85a1-7b888091f7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:35.974839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 764/1549] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:35.977662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c6c4-e7f1-45b9-b90b-3a9cf938d668 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:35.978134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c6c4-e7f1-45b9-b90b-3a9cf938d668 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:35.978573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c6c4-e7f1-45b9-b90b-3a9cf938d668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:35.988770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3c3a1013-c6c2-4cf7-ac77-d715a1701ddb None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:35.990245 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3c3a1013-c6c2-4cf7-ac77-d715a1701ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:35.998077 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4860c6c4-e7f1-45b9-b90b-3a9cf938d668 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:35.998953 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 786/1550] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:36.000187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad23d5-958e-4466-bdb1-05a27f40cf87 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.000552 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad23d5-958e-4466-bdb1-05a27f40cf87 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.000836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad23d5-958e-4466-bdb1-05a27f40cf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.002747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4860c6c4-e7f1-45b9-b90b-3a9cf938d668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:36.012261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 765/1551] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:36.013194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860c6c4-e7f1-45b9-b90b-3a9cf938d668 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.020078 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cdad23d5-958e-4466-bdb1-05a27f40cf87 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:36.021313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cdad23d5-958e-4466-bdb1-05a27f40cf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:36.024192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860c6c4-e7f1-45b9-b90b-3a9cf938d668 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.028889 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fafa9d-365f-4596-bd3b-ea6d11d5c02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.029277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 787/1552] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:36.029547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fafa9d-365f-4596-bd3b-ea6d11d5c02f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.029833 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fafa9d-365f-4596-bd3b-ea6d11d5c02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.030050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad23d5-958e-4466-bdb1-05a27f40cf87 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.030169 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fafa9d-365f-4596-bd3b-ea6d11d5c02f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.031002 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fafa9d-365f-4596-bd3b-ea6d11d5c02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.032641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fafa9d-365f-4596-bd3b-ea6d11d5c02f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.041488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad23d5-958e-4466-bdb1-05a27f40cf87 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.043965 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 766/1553] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:36.045241 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065a41-ca14-45d8-8d0f-fa40f8b43bcc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.045534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065a41-ca14-45d8-8d0f-fa40f8b43bcc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.045820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065a41-ca14-45d8-8d0f-fa40f8b43bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.046669 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca2aba-290b-4261-8db3-839ad5f105ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.047573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca2aba-290b-4261-8db3-839ad5f105ed admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.047896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca2aba-290b-4261-8db3-839ad5f105ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.048175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca2aba-290b-4261-8db3-839ad5f105ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.048934 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca2aba-290b-4261-8db3-839ad5f105ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:36.049239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca2aba-290b-4261-8db3-839ad5f105ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.051416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca2aba-290b-4261-8db3-839ad5f105ed admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.071555 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 788/1554] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:36.071751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9f065a41-ca14-45d8-8d0f-fa40f8b43bcc None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:36.071842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c3ff1-b5b1-4092-899f-4c69dd73a4c0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.071842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c3ff1-b5b1-4092-899f-4c69dd73a4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.071842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c3ff1-b5b1-4092-899f-4c69dd73a4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.072091 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9f065a41-ca14-45d8-8d0f-fa40f8b43bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:36.077964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 767/1555] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:36.078819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715da39d-ca61-42d2-90af-c1f4c296ad97 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.079111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715da39d-ca61-42d2-90af-c1f4c296ad97 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.079389 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715da39d-ca61-42d2-90af-c1f4c296ad97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.088175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-145c3ff1-b5b1-4092-899f-4c69dd73a4c0 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:36.089414 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-145c3ff1-b5b1-4092-899f-4c69dd73a4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:36.097123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-715da39d-ca61-42d2-90af-c1f4c296ad97 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:36.097347 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 789/1556] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:36.098570 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edb6e9-7ff1-4c60-a32a-df3bc8b9ccb9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.098715 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-715da39d-ca61-42d2-90af-c1f4c296ad97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:36.098945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edb6e9-7ff1-4c60-a32a-df3bc8b9ccb9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.099155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edb6e9-7ff1-4c60-a32a-df3bc8b9ccb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.107041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 768/1557] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:36.107835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715da39d-ca61-42d2-90af-c1f4c296ad97 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.117902 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715da39d-ca61-42d2-90af-c1f4c296ad97 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.118057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c7edb6e9-7ff1-4c60-a32a-df3bc8b9ccb9 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:36.119093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c7edb6e9-7ff1-4c60-a32a-df3bc8b9ccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:36.122519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3ab19-f88c-4dc3-8187-505b1c8b3c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.123130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3ab19-f88c-4dc3-8187-505b1c8b3c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.123419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3ab19-f88c-4dc3-8187-505b1c8b3c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.123697 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3ab19-f88c-4dc3-8187-505b1c8b3c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.124430 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3ab19-f88c-4dc3-8187-505b1c8b3c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:36.124744 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3ab19-f88c-4dc3-8187-505b1c8b3c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.125754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: WARNING py.warnings [None req-5aa3ab19-f88c-4dc3-8187-505b1c8b3c55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:36:36.125754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: warnings.warn(msg) Jul 15 20:36:36.125754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: Jul 15 20:36:36.126661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3ab19-f88c-4dc3-8187-505b1c8b3c55 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.127483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 790/1558] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:36.129335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224ebf2-954a-4f7a-9e1c-cf18967fc6bd None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.129620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224ebf2-954a-4f7a-9e1c-cf18967fc6bd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.129904 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224ebf2-954a-4f7a-9e1c-cf18967fc6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.149367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 769/1559] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:36.149367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3ab19-f88c-4dc3-8187-505b1c8b3c55 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.149671 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e224ebf2-954a-4f7a-9e1c-cf18967fc6bd None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:36.149671 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e224ebf2-954a-4f7a-9e1c-cf18967fc6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:36.154722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3ab19-f88c-4dc3-8187-505b1c8b3c55 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.157344 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 791/1560] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:36.158104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224ebf2-954a-4f7a-9e1c-cf18967fc6bd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.162622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093cc2d-2554-4bfe-88b1-61ce4f28c5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.163287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093cc2d-2554-4bfe-88b1-61ce4f28c5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.163600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093cc2d-2554-4bfe-88b1-61ce4f28c5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.163881 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093cc2d-2554-4bfe-88b1-61ce4f28c5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.164631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093cc2d-2554-4bfe-88b1-61ce4f28c5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.166232 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093cc2d-2554-4bfe-88b1-61ce4f28c5b5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.168096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224ebf2-954a-4f7a-9e1c-cf18967fc6bd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.172724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469451a5-4497-4d93-8470-fda9add04c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.173366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469451a5-4497-4d93-8470-fda9add04c79 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.173656 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469451a5-4497-4d93-8470-fda9add04c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.173941 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469451a5-4497-4d93-8470-fda9add04c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.174632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469451a5-4497-4d93-8470-fda9add04c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.176150 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: WARNING py.warnings [None req-469451a5-4497-4d93-8470-fda9add04c79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:36:36.176150 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: warnings.warn(msg) Jul 15 20:36:36.176150 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: Jul 15 20:36:36.177369 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469451a5-4497-4d93-8470-fda9add04c79 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.177783 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 770/1561] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:36.178569 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093cc2d-2554-4bfe-88b1-61ce4f28c5b5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.187804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093cc2d-2554-4bfe-88b1-61ce4f28c5b5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.193130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6ecbd-dc1b-4be7-803c-216a366ec075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.193766 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6ecbd-dc1b-4be7-803c-216a366ec075 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.194056 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6ecbd-dc1b-4be7-803c-216a366ec075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.194349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6ecbd-dc1b-4be7-803c-216a366ec075 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.195120 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6ecbd-dc1b-4be7-803c-216a366ec075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:36.195444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6ecbd-dc1b-4be7-803c-216a366ec075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.197211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6ecbd-dc1b-4be7-803c-216a366ec075 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.207483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 792/1562] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:36.207483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7246a2-9856-4696-afb6-622db2230b6f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.207483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7246a2-9856-4696-afb6-622db2230b6f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.207483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7246a2-9856-4696-afb6-622db2230b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.215690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 771/1563] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:36.215690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6ecbd-dc1b-4be7-803c-216a366ec075 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.226183 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6ecbd-dc1b-4be7-803c-216a366ec075 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.231602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9e7246a2-9856-4696-afb6-622db2230b6f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:36.233351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9e7246a2-9856-4696-afb6-622db2230b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:36.270735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:36.278722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:36.290699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b9b0b-e402-4bb3-b6af-75fe6818305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.291364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b9b0b-e402-4bb3-b6af-75fe6818305a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.291651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b9b0b-e402-4bb3-b6af-75fe6818305a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.291927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b9b0b-e402-4bb3-b6af-75fe6818305a admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.292958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b9b0b-e402-4bb3-b6af-75fe6818305a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:36.293268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b9b0b-e402-4bb3-b6af-75fe6818305a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.294890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b9b0b-e402-4bb3-b6af-75fe6818305a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.295895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 793/1564] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:36.296749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7246a2-9856-4696-afb6-622db2230b6f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.306400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7246a2-9856-4696-afb6-622db2230b6f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.310613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 772/1565] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:36.311094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ba4de-c93a-41ca-b071-cc48cfbcb249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.311405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b9b0b-e402-4bb3-b6af-75fe6818305a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.311753 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ba4de-c93a-41ca-b071-cc48cfbcb249 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.312044 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ba4de-c93a-41ca-b071-cc48cfbcb249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.312324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ba4de-c93a-41ca-b071-cc48cfbcb249 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.313142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ba4de-c93a-41ca-b071-cc48cfbcb249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:36.313456 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ba4de-c93a-41ca-b071-cc48cfbcb249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.315060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ba4de-c93a-41ca-b071-cc48cfbcb249 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.327066 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b9b0b-e402-4bb3-b6af-75fe6818305a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.335585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 794/1566] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:36.335585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ba4de-c93a-41ca-b071-cc48cfbcb249 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.338610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ba4de-c93a-41ca-b071-cc48cfbcb249 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.339710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff874a-a927-465f-a710-aa569556c742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.340424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff874a-a927-465f-a710-aa569556c742 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.340741 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff874a-a927-465f-a710-aa569556c742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.341019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff874a-a927-465f-a710-aa569556c742 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.341707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff874a-a927-465f-a710-aa569556c742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.343202 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c4c81-c193-431d-ac5e-5b28d8f13c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.343602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff874a-a927-465f-a710-aa569556c742 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.343840 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4c81-c193-431d-ac5e-5b28d8f13c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.344128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4c81-c193-431d-ac5e-5b28d8f13c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.344434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4c81-c193-431d-ac5e-5b28d8f13c71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.345159 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c4c81-c193-431d-ac5e-5b28d8f13c71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:36.345473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c4c81-c193-431d-ac5e-5b28d8f13c71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.347051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c4c81-c193-431d-ac5e-5b28d8f13c71 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.360564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 795/1567] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:36.361384 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c4c81-c193-431d-ac5e-5b28d8f13c71 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.372879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c4c81-c193-431d-ac5e-5b28d8f13c71 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.378108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b9442-f9cf-4bdc-90cf-c62515d20059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.379560 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b9442-f9cf-4bdc-90cf-c62515d20059 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.379888 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b9442-f9cf-4bdc-90cf-c62515d20059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.380166 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b9442-f9cf-4bdc-90cf-c62515d20059 admin admin] PATH_INFO: `/v3/projects/78a593e163e74a7b9db61133e5c22035/users/c0b5962b37b2470099436609425f7423/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.386101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 773/1568] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/projects => generated 401 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:36.386101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff874a-a927-465f-a710-aa569556c742 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.400171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b9442-f9cf-4bdc-90cf-c62515d20059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a593e163e74a7b9db61133e5c22035, user_id=c0b5962b37b2470099436609425f7423, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.401260 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: WARNING py.warnings [None req-6b1b9442-f9cf-4bdc-90cf-c62515d20059 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:36:36.401260 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: warnings.warn(msg) Jul 15 20:36:36.401260 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: Jul 15 20:36:36.403245 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b9442-f9cf-4bdc-90cf-c62515d20059 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.422937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 796/1569] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:36 2022] PUT /identity/v3/projects/78a593e163e74a7b9db61133e5c22035/users/c0b5962b37b2470099436609425f7423/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:36.427029 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b9442-f9cf-4bdc-90cf-c62515d20059 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.450423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff874a-a927-465f-a710-aa569556c742 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.489068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b9442-f9cf-4bdc-90cf-c62515d20059 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.494193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbd5eb-2723-4517-8320-bcf090f2a4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.494967 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbd5eb-2723-4517-8320-bcf090f2a4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.495329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbd5eb-2723-4517-8320-bcf090f2a4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.495682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbd5eb-2723-4517-8320-bcf090f2a4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.496473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbd5eb-2723-4517-8320-bcf090f2a4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.498481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbd5eb-2723-4517-8320-bcf090f2a4b9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.506550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95089822-4d5d-47f6-90c0-2021b8b52000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.507220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95089822-4d5d-47f6-90c0-2021b8b52000 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.507502 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95089822-4d5d-47f6-90c0-2021b8b52000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.507772 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95089822-4d5d-47f6-90c0-2021b8b52000 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.508616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95089822-4d5d-47f6-90c0-2021b8b52000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.509708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: WARNING py.warnings [None req-95089822-4d5d-47f6-90c0-2021b8b52000 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:36:36.509708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: warnings.warn(msg) Jul 15 20:36:36.509708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: Jul 15 20:36:36.510979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95089822-4d5d-47f6-90c0-2021b8b52000 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.527952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 797/1570] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:36.534137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 774/1571] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:36.534295 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbd5eb-2723-4517-8320-bcf090f2a4b9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.534395 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95089822-4d5d-47f6-90c0-2021b8b52000 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.542789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95089822-4d5d-47f6-90c0-2021b8b52000 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.589534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:36.596373 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbd5eb-2723-4517-8320-bcf090f2a4b9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.600624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e001412-d110-4bbb-8a56-8294e6bec45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.601284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e001412-d110-4bbb-8a56-8294e6bec45b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.601551 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3606d1c-1bb7-4d0a-9184-8d13fae36f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.601679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e001412-d110-4bbb-8a56-8294e6bec45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.601893 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e001412-d110-4bbb-8a56-8294e6bec45b admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.602209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3606d1c-1bb7-4d0a-9184-8d13fae36f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.602498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3606d1c-1bb7-4d0a-9184-8d13fae36f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.602601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e001412-d110-4bbb-8a56-8294e6bec45b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.602779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3606d1c-1bb7-4d0a-9184-8d13fae36f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.603532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3606d1c-1bb7-4d0a-9184-8d13fae36f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:36.603874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3606d1c-1bb7-4d0a-9184-8d13fae36f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.604815 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e001412-d110-4bbb-8a56-8294e6bec45b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.605494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3606d1c-1bb7-4d0a-9184-8d13fae36f49 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.618119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 798/1572] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:36.625611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3606d1c-1bb7-4d0a-9184-8d13fae36f49 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.629462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3606d1c-1bb7-4d0a-9184-8d13fae36f49 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.634424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509722f7-6937-4f7b-bc84-47cbeded6606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.635075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509722f7-6937-4f7b-bc84-47cbeded6606 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.635365 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509722f7-6937-4f7b-bc84-47cbeded6606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.635641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509722f7-6937-4f7b-bc84-47cbeded6606 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.636358 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509722f7-6937-4f7b-bc84-47cbeded6606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.636545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 775/1573] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:36.637352 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e001412-d110-4bbb-8a56-8294e6bec45b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.638361 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509722f7-6937-4f7b-bc84-47cbeded6606 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.654020 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:36.671870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 799/1574] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:36.671870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509722f7-6937-4f7b-bc84-47cbeded6606 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.700022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e001412-d110-4bbb-8a56-8294e6bec45b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.731478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509722f7-6937-4f7b-bc84-47cbeded6606 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.736109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3199ff-dc17-47f1-bdf1-87a75af58896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.736829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3199ff-dc17-47f1-bdf1-87a75af58896 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.737117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3199ff-dc17-47f1-bdf1-87a75af58896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.737399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3199ff-dc17-47f1-bdf1-87a75af58896 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.738112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3199ff-dc17-47f1-bdf1-87a75af58896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.740126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3199ff-dc17-47f1-bdf1-87a75af58896 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.758974 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156155a9-188c-4b65-a954-b31e7f97fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.759923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156155a9-188c-4b65-a954-b31e7f97fc37 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.760056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 800/1575] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:36.760225 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156155a9-188c-4b65-a954-b31e7f97fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.760528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156155a9-188c-4b65-a954-b31e7f97fc37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.761221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156155a9-188c-4b65-a954-b31e7f97fc37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.761393 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00850a5-b4ae-4a5c-9213-3e1c51db52b4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.761688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00850a5-b4ae-4a5c-9213-3e1c51db52b4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.761971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00850a5-b4ae-4a5c-9213-3e1c51db52b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.763158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156155a9-188c-4b65-a954-b31e7f97fc37 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.779389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d00850a5-b4ae-4a5c-9213-3e1c51db52b4 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:36.781225 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d00850a5-b4ae-4a5c-9213-3e1c51db52b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:36.790468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 801/1576] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:36.791248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00850a5-b4ae-4a5c-9213-3e1c51db52b4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.795091 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 776/1577] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/projects => generated 393 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:36.795091 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156155a9-188c-4b65-a954-b31e7f97fc37 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.802705 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00850a5-b4ae-4a5c-9213-3e1c51db52b4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.856823 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156155a9-188c-4b65-a954-b31e7f97fc37 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.860081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f6a72-3fff-4d8d-bf9e-223fc41b0462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.860807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f6a72-3fff-4d8d-bf9e-223fc41b0462 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.861114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f6a72-3fff-4d8d-bf9e-223fc41b0462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.861394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f6a72-3fff-4d8d-bf9e-223fc41b0462 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.861870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229abdb4-e224-4b3a-9002-93d09e35f194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.862090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f6a72-3fff-4d8d-bf9e-223fc41b0462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.862546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229abdb4-e224-4b3a-9002-93d09e35f194 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.862834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229abdb4-e224-4b3a-9002-93d09e35f194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.863639 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229abdb4-e224-4b3a-9002-93d09e35f194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.864438 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229abdb4-e224-4b3a-9002-93d09e35f194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.865069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f6a72-3fff-4d8d-bf9e-223fc41b0462 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.866053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229abdb4-e224-4b3a-9002-93d09e35f194 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.876189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 777/1578] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:36.876989 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229abdb4-e224-4b3a-9002-93d09e35f194 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.883624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:36.889583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 802/1579] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:36.889723 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229abdb4-e224-4b3a-9002-93d09e35f194 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.889840 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f6a72-3fff-4d8d-bf9e-223fc41b0462 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.893441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd25b5-860d-414f-bcf8-4956222bef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.894104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd25b5-860d-414f-bcf8-4956222bef63 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.894993 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd25b5-860d-414f-bcf8-4956222bef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.895280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd25b5-860d-414f-bcf8-4956222bef63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.896185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd25b5-860d-414f-bcf8-4956222bef63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.898176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd25b5-860d-414f-bcf8-4956222bef63 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.898661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f6a72-3fff-4d8d-bf9e-223fc41b0462 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.903686 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb30ddc-ef65-430d-a6dc-7705a9017656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.904599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb30ddc-ef65-430d-a6dc-7705a9017656 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.904888 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb30ddc-ef65-430d-a6dc-7705a9017656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.905170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb30ddc-ef65-430d-a6dc-7705a9017656 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.905855 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb30ddc-ef65-430d-a6dc-7705a9017656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.907813 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb30ddc-ef65-430d-a6dc-7705a9017656 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:36.924942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 778/1580] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:36.926703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd25b5-860d-414f-bcf8-4956222bef63 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.930806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 803/1581] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:36.931666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb30ddc-ef65-430d-a6dc-7705a9017656 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:36.941396 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb30ddc-ef65-430d-a6dc-7705a9017656 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.989070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:36.990946 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd25b5-860d-414f-bcf8-4956222bef63 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:36.996190 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407b0f1-81e9-4851-96ac-9ab8b1a4e9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:36.996893 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b0f1-81e9-4851-96ac-9ab8b1a4e9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:36.997176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b0f1-81e9-4851-96ac-9ab8b1a4e9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:36.997450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b0f1-81e9-4851-96ac-9ab8b1a4e9f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:36.998140 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407b0f1-81e9-4851-96ac-9ab8b1a4e9f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:36.999375 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ba62-e2d3-4994-a1f5-f46bdd8dcaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.000039 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ba62-e2d3-4994-a1f5-f46bdd8dcaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.000163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407b0f1-81e9-4851-96ac-9ab8b1a4e9f4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.000321 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ba62-e2d3-4994-a1f5-f46bdd8dcaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.000629 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ba62-e2d3-4994-a1f5-f46bdd8dcaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.001350 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816ba62-e2d3-4994-a1f5-f46bdd8dcaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.002958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816ba62-e2d3-4994-a1f5-f46bdd8dcaa3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.014795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 804/1582] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:37.015337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ba62-e2d3-4994-a1f5-f46bdd8dcaa3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.019559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 779/1583] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:36 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:37.020420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407b0f1-81e9-4851-96ac-9ab8b1a4e9f4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.028141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ba62-e2d3-4994-a1f5-f46bdd8dcaa3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.032714 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25d7b0-a616-4033-80bd-195d06694b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.033372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25d7b0-a616-4033-80bd-195d06694b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.033662 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25d7b0-a616-4033-80bd-195d06694b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.033938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25d7b0-a616-4033-80bd-195d06694b9b admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.034619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25d7b0-a616-4033-80bd-195d06694b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.037070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25d7b0-a616-4033-80bd-195d06694b9b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.057956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 805/1584] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:37 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:37.058886 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25d7b0-a616-4033-80bd-195d06694b9b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.068792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25d7b0-a616-4033-80bd-195d06694b9b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.073454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f41ea2-ae31-4366-a1fd-dedc47155d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.074114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f41ea2-ae31-4366-a1fd-dedc47155d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.074395 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f41ea2-ae31-4366-a1fd-dedc47155d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.074669 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f41ea2-ae31-4366-a1fd-dedc47155d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.075405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f41ea2-ae31-4366-a1fd-dedc47155d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.077025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f41ea2-ae31-4366-a1fd-dedc47155d49 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.077153 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407b0f1-81e9-4851-96ac-9ab8b1a4e9f4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.080849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738b202-f19c-46c1-bdc9-d013ac0cf6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.081496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738b202-f19c-46c1-bdc9-d013ac0cf6bf service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.082448 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738b202-f19c-46c1-bdc9-d013ac0cf6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.082740 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738b202-f19c-46c1-bdc9-d013ac0cf6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.087210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 806/1585] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:37.088001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f41ea2-ae31-4366-a1fd-dedc47155d49 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.095300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738b202-f19c-46c1-bdc9-d013ac0cf6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.096851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738b202-f19c-46c1-bdc9-d013ac0cf6bf service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.097993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f41ea2-ae31-4366-a1fd-dedc47155d49 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.102543 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464ba44-0c01-4eb8-b775-2f6df382e906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.103170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464ba44-0c01-4eb8-b775-2f6df382e906 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.103453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464ba44-0c01-4eb8-b775-2f6df382e906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.103737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464ba44-0c01-4eb8-b775-2f6df382e906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.104562 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464ba44-0c01-4eb8-b775-2f6df382e906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.106126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464ba44-0c01-4eb8-b775-2f6df382e906 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.107456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 780/1586] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:37.108297 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738b202-f19c-46c1-bdc9-d013ac0cf6bf service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.116922 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 807/1587] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:37.117739 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464ba44-0c01-4eb8-b775-2f6df382e906 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.118391 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738b202-f19c-46c1-bdc9-d013ac0cf6bf service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.123980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84a702-838d-4c99-8d27-a124dcc01e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.124377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84a702-838d-4c99-8d27-a124dcc01e30 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.124731 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84a702-838d-4c99-8d27-a124dcc01e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.125017 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84a702-838d-4c99-8d27-a124dcc01e30 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.125735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84a702-838d-4c99-8d27-a124dcc01e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.127702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464ba44-0c01-4eb8-b775-2f6df382e906 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.127821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84a702-838d-4c99-8d27-a124dcc01e30 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.133289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178dcef-170e-4f4a-8cf0-a6b1fe6e277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.133932 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178dcef-170e-4f4a-8cf0-a6b1fe6e277b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.134185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178dcef-170e-4f4a-8cf0-a6b1fe6e277b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.134461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178dcef-170e-4f4a-8cf0-a6b1fe6e277b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.135232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178dcef-170e-4f4a-8cf0-a6b1fe6e277b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.136931 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178dcef-170e-4f4a-8cf0-a6b1fe6e277b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.151780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 808/1588] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:37.151780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178dcef-170e-4f4a-8cf0-a6b1fe6e277b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.152749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 781/1589] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:37 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:37.153698 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84a702-838d-4c99-8d27-a124dcc01e30 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.160936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178dcef-170e-4f4a-8cf0-a6b1fe6e277b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.164384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84a702-838d-4c99-8d27-a124dcc01e30 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.165857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b83790-901e-4c9c-a2b4-88564b592146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.166586 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b83790-901e-4c9c-a2b4-88564b592146 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.166985 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b83790-901e-4c9c-a2b4-88564b592146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.167610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b83790-901e-4c9c-a2b4-88564b592146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.168497 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b83790-901e-4c9c-a2b4-88564b592146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.169852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149f8b4-3c43-46df-95b2-0030facc2722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.170156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b83790-901e-4c9c-a2b4-88564b592146 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.170763 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f8b4-3c43-46df-95b2-0030facc2722 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.171121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f8b4-3c43-46df-95b2-0030facc2722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.171501 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f8b4-3c43-46df-95b2-0030facc2722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.172341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149f8b4-3c43-46df-95b2-0030facc2722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.174060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149f8b4-3c43-46df-95b2-0030facc2722 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.182748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 809/1590] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:37.183717 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b83790-901e-4c9c-a2b4-88564b592146 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.188244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 782/1591] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:37.190936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149f8b4-3c43-46df-95b2-0030facc2722 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.195058 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b83790-901e-4c9c-a2b4-88564b592146 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.200847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c74de-62a8-4878-b03e-d9c61e725049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.201614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c74de-62a8-4878-b03e-d9c61e725049 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.201944 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c74de-62a8-4878-b03e-d9c61e725049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.202318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c74de-62a8-4878-b03e-d9c61e725049 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.203269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149f8b4-3c43-46df-95b2-0030facc2722 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.203429 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c74de-62a8-4878-b03e-d9c61e725049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.205473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c74de-62a8-4878-b03e-d9c61e725049 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.209972 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35499b24-4b9d-4dd7-bd35-6b66d03163d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.211034 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35499b24-4b9d-4dd7-bd35-6b66d03163d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.211434 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35499b24-4b9d-4dd7-bd35-6b66d03163d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.211801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35499b24-4b9d-4dd7-bd35-6b66d03163d8 admin admin] PATH_INFO: `/v3/projects/d2f12afd420d4f6bad8e80207ea64d44/users/1f231f706d2f4d3e9070105bb5981cec/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.218867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 810/1592] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:37.219799 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c74de-62a8-4878-b03e-d9c61e725049 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.230204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c74de-62a8-4878-b03e-d9c61e725049 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.231283 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35499b24-4b9d-4dd7-bd35-6b66d03163d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f12afd420d4f6bad8e80207ea64d44, user_id=1f231f706d2f4d3e9070105bb5981cec, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.234250 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35499b24-4b9d-4dd7-bd35-6b66d03163d8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.235708 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28700146-9a7f-46bf-acc8-6d66f55f8703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.236376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28700146-9a7f-46bf-acc8-6d66f55f8703 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.236693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28700146-9a7f-46bf-acc8-6d66f55f8703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.236973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28700146-9a7f-46bf-acc8-6d66f55f8703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.237697 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28700146-9a7f-46bf-acc8-6d66f55f8703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.244293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28700146-9a7f-46bf-acc8-6d66f55f8703 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.255700 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 783/1593] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:37 2022] PUT /identity/v3/projects/d2f12afd420d4f6bad8e80207ea64d44/users/1f231f706d2f4d3e9070105bb5981cec/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:37.256597 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35499b24-4b9d-4dd7-bd35-6b66d03163d8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.262012 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 811/1594] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:37.262948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28700146-9a7f-46bf-acc8-6d66f55f8703 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.273902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28700146-9a7f-46bf-acc8-6d66f55f8703 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.290956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:37.344504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35499b24-4b9d-4dd7-bd35-6b66d03163d8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.351201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd16b3-9b62-4625-9517-48898067024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.352263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd16b3-9b62-4625-9517-48898067024e admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.352605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd16b3-9b62-4625-9517-48898067024e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.352917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd16b3-9b62-4625-9517-48898067024e admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.353656 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd16b3-9b62-4625-9517-48898067024e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.354251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d2250-7f39-4efe-95e8-0d9ec57eff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.355294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd16b3-9b62-4625-9517-48898067024e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.355909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d2250-7f39-4efe-95e8-0d9ec57eff47 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.356349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d2250-7f39-4efe-95e8-0d9ec57eff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.356827 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d2250-7f39-4efe-95e8-0d9ec57eff47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.357722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d2250-7f39-4efe-95e8-0d9ec57eff47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.359502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d2250-7f39-4efe-95e8-0d9ec57eff47 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.366994 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 784/1595] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:37.371010 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd16b3-9b62-4625-9517-48898067024e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.374819 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 812/1596] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:37.375867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d2250-7f39-4efe-95e8-0d9ec57eff47 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.381409 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd16b3-9b62-4625-9517-48898067024e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.386828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6a4bf-65b3-4c93-9451-e0d1142d0ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.387003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d2250-7f39-4efe-95e8-0d9ec57eff47 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.387826 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6a4bf-65b3-4c93-9451-e0d1142d0ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.388149 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6a4bf-65b3-4c93-9451-e0d1142d0ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.388495 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6a4bf-65b3-4c93-9451-e0d1142d0ebf admin admin] PATH_INFO: `/v3/projects/f0adae0a879c440a96daf21b59b7f8f0/users/507e64cc71c441a6824b52f630191601/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.394861 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af7d72-fdd2-41d2-a25d-97ce4fc293d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.395773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7d72-fdd2-41d2-a25d-97ce4fc293d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.396154 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7d72-fdd2-41d2-a25d-97ce4fc293d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.396532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7d72-fdd2-41d2-a25d-97ce4fc293d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.397350 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af7d72-fdd2-41d2-a25d-97ce4fc293d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.399045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af7d72-fdd2-41d2-a25d-97ce4fc293d9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.407738 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6a4bf-65b3-4c93-9451-e0d1142d0ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0adae0a879c440a96daf21b59b7f8f0, user_id=507e64cc71c441a6824b52f630191601, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.411352 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 813/1597] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:37.411753 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6a4bf-65b3-4c93-9451-e0d1142d0ebf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.412107 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af7d72-fdd2-41d2-a25d-97ce4fc293d9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.423279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af7d72-fdd2-41d2-a25d-97ce4fc293d9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.428940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 785/1598] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:37 2022] PUT /identity/v3/projects/f0adae0a879c440a96daf21b59b7f8f0/users/507e64cc71c441a6824b52f630191601/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:37.430626 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b73e9-fb18-449b-b363-6d7777cbfad3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.431092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b73e9-fb18-449b-b363-6d7777cbfad3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.431531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b73e9-fb18-449b-b363-6d7777cbfad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.459329 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ba4b73e9-fb18-449b-b363-6d7777cbfad3 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:37.460899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ba4b73e9-fb18-449b-b363-6d7777cbfad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:37.485721 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:37.502476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cca71-8f51-4964-ad27-7d03ec059d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.503226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cca71-8f51-4964-ad27-7d03ec059d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.503667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cca71-8f51-4964-ad27-7d03ec059d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.504591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cca71-8f51-4964-ad27-7d03ec059d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.505923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cca71-8f51-4964-ad27-7d03ec059d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.507965 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cca71-8f51-4964-ad27-7d03ec059d8a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.521378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 814/1599] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:37.522722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cca71-8f51-4964-ad27-7d03ec059d8a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.532898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 786/1600] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:37.533832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b73e9-fb18-449b-b363-6d7777cbfad3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.545929 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cca71-8f51-4964-ad27-7d03ec059d8a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.546428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b73e9-fb18-449b-b363-6d7777cbfad3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.552162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eba597-0c1c-4b85-8301-1391c5d54755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.553029 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752026c-a0ea-454a-bc85-759795ea2ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.553299 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eba597-0c1c-4b85-8301-1391c5d54755 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.553593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eba597-0c1c-4b85-8301-1391c5d54755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.553878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eba597-0c1c-4b85-8301-1391c5d54755 admin admin] PATH_INFO: `/v3/projects/9cccac33571645499cdd9c45a311a98d/users/6086037b56e1480fbb50d0203976850a/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.554331 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752026c-a0ea-454a-bc85-759795ea2ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.554810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752026c-a0ea-454a-bc85-759795ea2ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.555289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752026c-a0ea-454a-bc85-759795ea2ffc admin admin] PATH_INFO: `/v3/projects/8f5da4060dd448e0808a0fcc3b55fd54/users/87421ecff1714c72916570cd47593cce/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.571685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eba597-0c1c-4b85-8301-1391c5d54755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cccac33571645499cdd9c45a311a98d, user_id=6086037b56e1480fbb50d0203976850a, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.573110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752026c-a0ea-454a-bc85-759795ea2ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5da4060dd448e0808a0fcc3b55fd54, user_id=87421ecff1714c72916570cd47593cce, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.574625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eba597-0c1c-4b85-8301-1391c5d54755 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.575978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752026c-a0ea-454a-bc85-759795ea2ffc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.591357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 787/1601] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:37 2022] PUT /identity/v3/projects/9cccac33571645499cdd9c45a311a98d/users/6086037b56e1480fbb50d0203976850a/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:37.591585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 815/1602] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:37 2022] PUT /identity/v3/projects/8f5da4060dd448e0808a0fcc3b55fd54/users/87421ecff1714c72916570cd47593cce/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:37.591995 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eba597-0c1c-4b85-8301-1391c5d54755 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.592417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752026c-a0ea-454a-bc85-759795ea2ffc admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.675940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752026c-a0ea-454a-bc85-759795ea2ffc admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.680704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315ff3d-c7b5-438c-8843-c51733deb533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.681603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315ff3d-c7b5-438c-8843-c51733deb533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.681889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315ff3d-c7b5-438c-8843-c51733deb533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.682165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315ff3d-c7b5-438c-8843-c51733deb533 admin admin] PATH_INFO: `/v3/projects/c1020584fa404da1a9ad11ead78d638c/users/0252063927c6497d891859b0f6d907e3/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.688315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eba597-0c1c-4b85-8301-1391c5d54755 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.698456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700585f-d33b-4189-b299-6cf908103f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.698888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700585f-d33b-4189-b299-6cf908103f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.699323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700585f-d33b-4189-b299-6cf908103f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.699622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700585f-d33b-4189-b299-6cf908103f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.699809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315ff3d-c7b5-438c-8843-c51733deb533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1020584fa404da1a9ad11ead78d638c, user_id=0252063927c6497d891859b0f6d907e3, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.700374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700585f-d33b-4189-b299-6cf908103f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.702022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700585f-d33b-4189-b299-6cf908103f24 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.702513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315ff3d-c7b5-438c-8843-c51733deb533 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.716181 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 788/1603] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:37.717734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fb00e-229d-4435-8b90-8e8004ba01f3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.718033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fb00e-229d-4435-8b90-8e8004ba01f3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.718316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fb00e-229d-4435-8b90-8e8004ba01f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.720084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 816/1604] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:37 2022] PUT /identity/v3/projects/c1020584fa404da1a9ad11ead78d638c/users/0252063927c6497d891859b0f6d907e3/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:37.721220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315ff3d-c7b5-438c-8843-c51733deb533 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.733807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:37.740906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-400fb00e-229d-4435-8b90-8e8004ba01f3 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:37.742728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-400fb00e-229d-4435-8b90-8e8004ba01f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:37.816529 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315ff3d-c7b5-438c-8843-c51733deb533 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.821221 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27034168-f541-416f-a6ba-65f4a82cba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.821392 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 789/1605] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:37.822170 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fb00e-229d-4435-8b90-8e8004ba01f3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:37.822353 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27034168-f541-416f-a6ba-65f4a82cba8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.822448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27034168-f541-416f-a6ba-65f4a82cba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.822713 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27034168-f541-416f-a6ba-65f4a82cba8e admin admin] PATH_INFO: `/v3/projects/0395d91380b34e968d7e39be3bc88b0f/users/e13d5d7068e348248387b512c55dec5e/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.824063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-400fb00e-229d-4435-8b90-8e8004ba01f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:37.845677 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27034168-f541-416f-a6ba-65f4a82cba8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0395d91380b34e968d7e39be3bc88b0f, user_id=e13d5d7068e348248387b512c55dec5e, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:37.851153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27034168-f541-416f-a6ba-65f4a82cba8e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:37.879882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 817/1606] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:37 2022] PUT /identity/v3/projects/0395d91380b34e968d7e39be3bc88b0f/users/e13d5d7068e348248387b512c55dec5e/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:37.881362 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7f807-31de-47fd-bea9-b39a9d375d59 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.881704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7f807-31de-47fd-bea9-b39a9d375d59 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.881995 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7f807-31de-47fd-bea9-b39a9d375d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:37.904076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fb00e-229d-4435-8b90-8e8004ba01f3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:37.926930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-76e7f807-31de-47fd-bea9-b39a9d375d59 None None] MFA Rules not processed for user `6086037b56e1480fbb50d0203976850a`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:37.928290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-76e7f807-31de-47fd-bea9-b39a9d375d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:37.949823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:37.975401 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee28be-5a9f-4f81-9b07-19b9e1846841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:37.976352 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee28be-5a9f-4f81-9b07-19b9e1846841 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:37.976511 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee28be-5a9f-4f81-9b07-19b9e1846841 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:37.976903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee28be-5a9f-4f81-9b07-19b9e1846841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.051267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 818/1607] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:38.052453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1003f4-8f59-4c25-ab90-c3ab4fafe76f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.052753 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1003f4-8f59-4c25-ab90-c3ab4fafe76f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.053037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1003f4-8f59-4c25-ab90-c3ab4fafe76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.059826 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee28be-5a9f-4f81-9b07-19b9e1846841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:38.062881 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee28be-5a9f-4f81-9b07-19b9e1846841 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:38.079852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 790/1608] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:38.080741 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee28be-5a9f-4f81-9b07-19b9e1846841 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:38.091029 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3d1003f4-8f59-4c25-ab90-c3ab4fafe76f None None] MFA Rules not processed for user `87421ecff1714c72916570cd47593cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:38.092658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3d1003f4-8f59-4c25-ab90-c3ab4fafe76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:38.094032 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee28be-5a9f-4f81-9b07-19b9e1846841 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:38.100314 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa01ecd-6441-4289-b4c0-0fe2a263fc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:38.101242 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa01ecd-6441-4289-b4c0-0fe2a263fc5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.101525 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa01ecd-6441-4289-b4c0-0fe2a263fc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.101799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa01ecd-6441-4289-b4c0-0fe2a263fc5e admin admin] PATH_INFO: `/v3/projects/737fb248d98f4bd3bdc65bb58e66d11a/users/85bbcdafa72344bab912f7a3518f7ae1/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.115886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:38.121884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa01ecd-6441-4289-b4c0-0fe2a263fc5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=737fb248d98f4bd3bdc65bb58e66d11a, user_id=85bbcdafa72344bab912f7a3518f7ae1, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:38.125306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa01ecd-6441-4289-b4c0-0fe2a263fc5e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:38.145050 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 791/1609] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:38 2022] PUT /identity/v3/projects/737fb248d98f4bd3bdc65bb58e66d11a/users/85bbcdafa72344bab912f7a3518f7ae1/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:38.147428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e7fc2-6010-4803-99a5-c5b6857ca24e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.148202 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e7fc2-6010-4803-99a5-c5b6857ca24e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.148727 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e7fc2-6010-4803-99a5-c5b6857ca24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.186170 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b14e7fc2-6010-4803-99a5-c5b6857ca24e None None] MFA Rules not processed for user `0252063927c6497d891859b0f6d907e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:38.187834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b14e7fc2-6010-4803-99a5-c5b6857ca24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:38.192536 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 819/1610] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:38.193635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1003f4-8f59-4c25-ab90-c3ab4fafe76f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:38.207348 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1003f4-8f59-4c25-ab90-c3ab4fafe76f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:38.276909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03953b-5824-4db7-83e3-b0051cd89fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:38.277891 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03953b-5824-4db7-83e3-b0051cd89fdd service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.278253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03953b-5824-4db7-83e3-b0051cd89fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.278602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03953b-5824-4db7-83e3-b0051cd89fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.288791 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 792/1611] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:38.290591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd4a0-7d60-409e-a11a-8cffe110f7e1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.290898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd4a0-7d60-409e-a11a-8cffe110f7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.291184 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd4a0-7d60-409e-a11a-8cffe110f7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.311925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6eacd4a0-7d60-409e-a11a-8cffe110f7e1 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:38.313334 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6eacd4a0-7d60-409e-a11a-8cffe110f7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:38.370717 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:38.375286 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03953b-5824-4db7-83e3-b0051cd89fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:38.377756 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03953b-5824-4db7-83e3-b0051cd89fdd service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:38.394103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 820/1612] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:38.395637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03953b-5824-4db7-83e3-b0051cd89fdd service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:38.409835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03953b-5824-4db7-83e3-b0051cd89fdd service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:38.412562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 793/1613] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:38.415134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5d71-017b-44ba-b885-fb08b5710d8f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.416784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5d71-017b-44ba-b885-fb08b5710d8f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.417843 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5d71-017b-44ba-b885-fb08b5710d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.421408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1b760-8c29-43e7-9a94-30411092c275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:38.422057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1b760-8c29-43e7-9a94-30411092c275 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.422340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1b760-8c29-43e7-9a94-30411092c275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.422617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1b760-8c29-43e7-9a94-30411092c275 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.423345 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1b760-8c29-43e7-9a94-30411092c275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:38.425911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1b760-8c29-43e7-9a94-30411092c275 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:38.466539 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 821/1614] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:38 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:38.467434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1b760-8c29-43e7-9a94-30411092c275 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:38.473965 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a98f5d71-017b-44ba-b885-fb08b5710d8f None None] MFA Rules not processed for user `85bbcdafa72344bab912f7a3518f7ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:38.475340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a98f5d71-017b-44ba-b885-fb08b5710d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:38.547936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1b760-8c29-43e7-9a94-30411092c275 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:38.554357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdb89c-883d-4105-8ee7-a3b202acea1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:38.555198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb89c-883d-4105-8ee7-a3b202acea1f admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.555555 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb89c-883d-4105-8ee7-a3b202acea1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.555908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb89c-883d-4105-8ee7-a3b202acea1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.557619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdb89c-883d-4105-8ee7-a3b202acea1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:38.559468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdb89c-883d-4105-8ee7-a3b202acea1f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:38.568887 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 794/1615] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:38.570257 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae573d-5405-42cc-822e-0a5b184807ba None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.570548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae573d-5405-42cc-822e-0a5b184807ba None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.570824 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae573d-5405-42cc-822e-0a5b184807ba None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.572962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 795/1616] 10.222.0.66 () {54 vars in 961 bytes} [Fri Jul 15 20:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:38.579201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae573d-5405-42cc-822e-0a5b184807ba None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:38.591517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:38.601248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 822/1617] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:38 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:38.602041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdb89c-883d-4105-8ee7-a3b202acea1f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:38.686585 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae573d-5405-42cc-822e-0a5b184807ba None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:38.721186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdb89c-883d-4105-8ee7-a3b202acea1f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:38.727560 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871faa9d-b310-45c0-a826-1a75e6a2ad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:38.728925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871faa9d-b310-45c0-a826-1a75e6a2ad87 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.729214 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871faa9d-b310-45c0-a826-1a75e6a2ad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.729538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871faa9d-b310-45c0-a826-1a75e6a2ad87 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.730247 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871faa9d-b310-45c0-a826-1a75e6a2ad87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:38.733347 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871faa9d-b310-45c0-a826-1a75e6a2ad87 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:38.757403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b12a9d-e75f-4edf-bfa8-69e7edb88c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:38.758135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b12a9d-e75f-4edf-bfa8-69e7edb88c3b service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.758385 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b12a9d-e75f-4edf-bfa8-69e7edb88c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.758661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b12a9d-e75f-4edf-bfa8-69e7edb88c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.760382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 823/1618] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:38 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:38.764566 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871faa9d-b310-45c0-a826-1a75e6a2ad87 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:38.768886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b12a9d-e75f-4edf-bfa8-69e7edb88c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:38.770834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b12a9d-e75f-4edf-bfa8-69e7edb88c3b service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:38.776153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871faa9d-b310-45c0-a826-1a75e6a2ad87 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:38.781303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb9964-16e5-4110-94a0-6ea69e5a4772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:38.782175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb9964-16e5-4110-94a0-6ea69e5a4772 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.782505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb9964-16e5-4110-94a0-6ea69e5a4772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.782731 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb9964-16e5-4110-94a0-6ea69e5a4772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.783481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb9964-16e5-4110-94a0-6ea69e5a4772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:38.784303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 796/1619] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:38.786399 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12324850-0578-4c99-984c-8f1a97c62abc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.786685 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb9964-16e5-4110-94a0-6ea69e5a4772 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:38.786810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12324850-0578-4c99-984c-8f1a97c62abc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.786976 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12324850-0578-4c99-984c-8f1a97c62abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.823163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 824/1620] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:38 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:38.823163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb9964-16e5-4110-94a0-6ea69e5a4772 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:38.838780 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-12324850-0578-4c99-984c-8f1a97c62abc None None] MFA Rules not processed for user `b042da9298894712a0a29787a343bf85`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:38.840556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-12324850-0578-4c99-984c-8f1a97c62abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:38.871296 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:38.917494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb9964-16e5-4110-94a0-6ea69e5a4772 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:38.923512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89de49-c405-440f-bb2d-6507a3b94b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:38.924527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89de49-c405-440f-bb2d-6507a3b94b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:38.924995 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89de49-c405-440f-bb2d-6507a3b94b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:38.925419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89de49-c405-440f-bb2d-6507a3b94b9b admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:38.926358 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89de49-c405-440f-bb2d-6507a3b94b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:38.928863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89de49-c405-440f-bb2d-6507a3b94b9b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:38.977151 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 797/1621] 10.222.0.66 () {58 vars in 1058 bytes} [Fri Jul 15 20:36:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:38.979286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12324850-0578-4c99-984c-8f1a97c62abc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:38.982224 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 825/1622] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:38 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:38.982224 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89de49-c405-440f-bb2d-6507a3b94b9b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:39.086468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89de49-c405-440f-bb2d-6507a3b94b9b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:39.086468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f31bb-566a-4049-b52d-482133e92f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:39.086468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f31bb-566a-4049-b52d-482133e92f18 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:39.086468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f31bb-566a-4049-b52d-482133e92f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:39.087856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f31bb-566a-4049-b52d-482133e92f18 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:39.087856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f31bb-566a-4049-b52d-482133e92f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:39.088231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12324850-0578-4c99-984c-8f1a97c62abc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:39.088526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f31bb-566a-4049-b52d-482133e92f18 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:39.088703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24979c7e-8ddf-42b4-b36e-4a5247406224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:39.088703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24979c7e-8ddf-42b4-b36e-4a5247406224 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:39.088703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24979c7e-8ddf-42b4-b36e-4a5247406224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:39.088703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24979c7e-8ddf-42b4-b36e-4a5247406224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:39.089098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24979c7e-8ddf-42b4-b36e-4a5247406224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:39.089098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24979c7e-8ddf-42b4-b36e-4a5247406224 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:39.089426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 826/1623] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:38 2022] POST /identity/v3/users => generated 288 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:39.089426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f31bb-566a-4049-b52d-482133e92f18 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:39.089581 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 798/1624] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:39.089581 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24979c7e-8ddf-42b4-b36e-4a5247406224 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:39.109046 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f31bb-566a-4049-b52d-482133e92f18 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:39.114797 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24979c7e-8ddf-42b4-b36e-4a5247406224 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:39.118315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50853a2-c3ce-402f-b32f-5ed62ec9e57b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:39.119129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50853a2-c3ce-402f-b32f-5ed62ec9e57b service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:39.119474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50853a2-c3ce-402f-b32f-5ed62ec9e57b service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:39.119904 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50853a2-c3ce-402f-b32f-5ed62ec9e57b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:39.127205 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bd1c3-1da0-46ec-adf9-d6fab17cc44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:39.128487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bd1c3-1da0-46ec-adf9-d6fab17cc44b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:39.128984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bd1c3-1da0-46ec-adf9-d6fab17cc44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:39.129474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bd1c3-1da0-46ec-adf9-d6fab17cc44b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:39.130428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bd1c3-1da0-46ec-adf9-d6fab17cc44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:39.132270 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bd1c3-1da0-46ec-adf9-d6fab17cc44b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:39.164317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 799/1625] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:39.165504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bd1c3-1da0-46ec-adf9-d6fab17cc44b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:39.185180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bd1c3-1da0-46ec-adf9-d6fab17cc44b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:39.204856 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26145ad-42df-43fa-9b96-c0301e3f94b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:39.205547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26145ad-42df-43fa-9b96-c0301e3f94b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:39.205901 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26145ad-42df-43fa-9b96-c0301e3f94b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:39.206191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26145ad-42df-43fa-9b96-c0301e3f94b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:39.207401 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26145ad-42df-43fa-9b96-c0301e3f94b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:39.209185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26145ad-42df-43fa-9b96-c0301e3f94b9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:39.220464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50853a2-c3ce-402f-b32f-5ed62ec9e57b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:39.222941 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50853a2-c3ce-402f-b32f-5ed62ec9e57b service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:39.235126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 800/1626] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:39.235126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26145ad-42df-43fa-9b96-c0301e3f94b9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:39.247021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26145ad-42df-43fa-9b96-c0301e3f94b9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:39.252934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c28cd-3b4f-496e-90c6-4ffe497d98a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:39.254923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c28cd-3b4f-496e-90c6-4ffe497d98a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:39.255282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c28cd-3b4f-496e-90c6-4ffe497d98a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:39.255918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c28cd-3b4f-496e-90c6-4ffe497d98a1 admin admin] PATH_INFO: `/v3/projects/86aa32ffa93942678396a8428a4bf7c0/users/793f2a6c6f8e4e12a6a6c2035ca27938/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:39.260618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 827/1627] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:39.264363 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50853a2-c3ce-402f-b32f-5ed62ec9e57b service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:39.273725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:39.282306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c28cd-3b4f-496e-90c6-4ffe497d98a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86aa32ffa93942678396a8428a4bf7c0, user_id=793f2a6c6f8e4e12a6a6c2035ca27938, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:39.299254 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c28cd-3b4f-496e-90c6-4ffe497d98a1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:39.309594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50853a2-c3ce-402f-b32f-5ed62ec9e57b service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:39.330415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 801/1628] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:39 2022] PUT /identity/v3/projects/86aa32ffa93942678396a8428a4bf7c0/users/793f2a6c6f8e4e12a6a6c2035ca27938/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:39.331352 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c28cd-3b4f-496e-90c6-4ffe497d98a1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:39.333132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9213a48-aaa2-4e09-ab31-57dee5b3a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:39.334054 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9213a48-aaa2-4e09-ab31-57dee5b3a7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:39.334361 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9213a48-aaa2-4e09-ab31-57dee5b3a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:39.334622 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9213a48-aaa2-4e09-ab31-57dee5b3a7ea admin admin] PATH_INFO: `/v3/projects/52e46739f49d4c4680dd5f2da9b96b31/users/f396205186bd4d35b2d0ae316303be18/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:39.390253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9213a48-aaa2-4e09-ab31-57dee5b3a7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e46739f49d4c4680dd5f2da9b96b31, user_id=f396205186bd4d35b2d0ae316303be18, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:39.392592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9213a48-aaa2-4e09-ab31-57dee5b3a7ea admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:39.441803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 828/1629] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:39 2022] PUT /identity/v3/projects/52e46739f49d4c4680dd5f2da9b96b31/users/f396205186bd4d35b2d0ae316303be18/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:39.446858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9213a48-aaa2-4e09-ab31-57dee5b3a7ea admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:39.477027 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c28cd-3b4f-496e-90c6-4ffe497d98a1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:39.603085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8970e7-2ebe-46c5-92d9-2916500a5992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:39.604140 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8970e7-2ebe-46c5-92d9-2916500a5992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:39.604544 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8970e7-2ebe-46c5-92d9-2916500a5992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:39.604925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8970e7-2ebe-46c5-92d9-2916500a5992 admin admin] PATH_INFO: `/v3/projects/7e3ea1bb8ba640afaac7a738aa7e52ad/users/41855d74928544c284fb8487e3299a97/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:39.611177 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9213a48-aaa2-4e09-ab31-57dee5b3a7ea admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:39.626374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6be05f-c0c8-4e9a-b2f0-4fc1f18ff411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:39.627249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6be05f-c0c8-4e9a-b2f0-4fc1f18ff411 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:39.627546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6be05f-c0c8-4e9a-b2f0-4fc1f18ff411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:39.627976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6be05f-c0c8-4e9a-b2f0-4fc1f18ff411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:39.628240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8970e7-2ebe-46c5-92d9-2916500a5992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3ea1bb8ba640afaac7a738aa7e52ad, user_id=41855d74928544c284fb8487e3299a97, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:39.629111 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6be05f-c0c8-4e9a-b2f0-4fc1f18ff411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:39.631128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6be05f-c0c8-4e9a-b2f0-4fc1f18ff411 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:39.634707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8970e7-2ebe-46c5-92d9-2916500a5992 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:39.661786 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 829/1630] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:39.676187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6be05f-c0c8-4e9a-b2f0-4fc1f18ff411 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:39.688141 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 802/1631] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:39 2022] PUT /identity/v3/projects/7e3ea1bb8ba640afaac7a738aa7e52ad/users/41855d74928544c284fb8487e3299a97/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:39.695414 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8970e7-2ebe-46c5-92d9-2916500a5992 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:39.718324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6be05f-c0c8-4e9a-b2f0-4fc1f18ff411 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:39.728281 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:39.847415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d018bee-3f31-48e9-8413-528c09e4eec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:39.847415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d018bee-3f31-48e9-8413-528c09e4eec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:39.847807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d018bee-3f31-48e9-8413-528c09e4eec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:39.847807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d018bee-3f31-48e9-8413-528c09e4eec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:39.848500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d018bee-3f31-48e9-8413-528c09e4eec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:39.850195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d018bee-3f31-48e9-8413-528c09e4eec7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:39.872444 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 830/1632] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:39.874410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d018bee-3f31-48e9-8413-528c09e4eec7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:39.894818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d018bee-3f31-48e9-8413-528c09e4eec7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:39.911215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e0e11-f95b-43e3-ad26-1d96408577c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:39.912562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8970e7-2ebe-46c5-92d9-2916500a5992 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:39.912987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e0e11-f95b-43e3-ad26-1d96408577c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:39.913695 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e0e11-f95b-43e3-ad26-1d96408577c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:39.914219 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e0e11-f95b-43e3-ad26-1d96408577c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:39.916218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e0e11-f95b-43e3-ad26-1d96408577c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:39.919349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e0e11-f95b-43e3-ad26-1d96408577c0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:39.926339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8334f-1b56-4a8a-add6-e6d59ce397c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:39.926339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8334f-1b56-4a8a-add6-e6d59ce397c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:39.926339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8334f-1b56-4a8a-add6-e6d59ce397c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:39.926885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8334f-1b56-4a8a-add6-e6d59ce397c0 admin admin] PATH_INFO: `/v3/projects/86aa32ffa93942678396a8428a4bf7c0/users/793f2a6c6f8e4e12a6a6c2035ca27938/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:39.934177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8334f-1b56-4a8a-add6-e6d59ce397c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86aa32ffa93942678396a8428a4bf7c0, user_id=793f2a6c6f8e4e12a6a6c2035ca27938, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:39.941750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8334f-1b56-4a8a-add6-e6d59ce397c0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:39.950802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 831/1633] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:39.951986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e0e11-f95b-43e3-ad26-1d96408577c0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:39.955337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 803/1634] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:39 2022] PUT /identity/v3/projects/86aa32ffa93942678396a8428a4bf7c0/users/793f2a6c6f8e4e12a6a6c2035ca27938/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:39.956800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01719cc8-3271-4f5c-9fb4-b9f6f6c286e6 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:39.957093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01719cc8-3271-4f5c-9fb4-b9f6f6c286e6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:39.957374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01719cc8-3271-4f5c-9fb4-b9f6f6c286e6 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:39.958658 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 804/1635] 10.222.0.66 () {54 vars in 912 bytes} [Fri Jul 15 20:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:39.965423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01719cc8-3271-4f5c-9fb4-b9f6f6c286e6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:39.983980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e0e11-f95b-43e3-ad26-1d96408577c0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:39.986934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:40.140354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01719cc8-3271-4f5c-9fb4-b9f6f6c286e6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:40.152015 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329075d-d545-4e88-ac74-76d52297af25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:40.154014 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329075d-d545-4e88-ac74-76d52297af25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:40.154296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329075d-d545-4e88-ac74-76d52297af25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:40.154575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329075d-d545-4e88-ac74-76d52297af25 admin admin] PATH_INFO: `/v3/projects/7e3ea1bb8ba640afaac7a738aa7e52ad/users/41855d74928544c284fb8487e3299a97/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:40.155477 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e442c78-97e0-48c6-9d14-a25dbddca1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:40.156380 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e442c78-97e0-48c6-9d14-a25dbddca1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:40.156678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e442c78-97e0-48c6-9d14-a25dbddca1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:40.156943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e442c78-97e0-48c6-9d14-a25dbddca1aa admin admin] PATH_INFO: `/v3/projects/52e46739f49d4c4680dd5f2da9b96b31/users/f396205186bd4d35b2d0ae316303be18/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:40.161456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329075d-d545-4e88-ac74-76d52297af25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3ea1bb8ba640afaac7a738aa7e52ad, user_id=41855d74928544c284fb8487e3299a97, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:40.164930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e442c78-97e0-48c6-9d14-a25dbddca1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e46739f49d4c4680dd5f2da9b96b31, user_id=f396205186bd4d35b2d0ae316303be18, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:40.168964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329075d-d545-4e88-ac74-76d52297af25 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:40.171133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e442c78-97e0-48c6-9d14-a25dbddca1aa admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:40.195512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 805/1636] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:39 2022] PUT /identity/v3/projects/7e3ea1bb8ba640afaac7a738aa7e52ad/users/41855d74928544c284fb8487e3299a97/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:40.204115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 832/1637] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:39 2022] PUT /identity/v3/projects/52e46739f49d4c4680dd5f2da9b96b31/users/f396205186bd4d35b2d0ae316303be18/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:40.204301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ef831-9ac5-4cc5-ad15-7b5704f2c700 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:40.204301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ef831-9ac5-4cc5-ad15-7b5704f2c700 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:40.204301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ef831-9ac5-4cc5-ad15-7b5704f2c700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:40.204593 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4887e7-8e80-4f1e-8986-0b36ca1df86a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:40.204593 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4887e7-8e80-4f1e-8986-0b36ca1df86a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:40.204593 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4887e7-8e80-4f1e-8986-0b36ca1df86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:40.252210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4e4887e7-8e80-4f1e-8986-0b36ca1df86a None None] MFA Rules not processed for user `b042da9298894712a0a29787a343bf85`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:40.257565 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4e4887e7-8e80-4f1e-8986-0b36ca1df86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:40.268673 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b30ef831-9ac5-4cc5-ad15-7b5704f2c700 None None] MFA Rules not processed for user `793f2a6c6f8e4e12a6a6c2035ca27938`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:40.269963 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b30ef831-9ac5-4cc5-ad15-7b5704f2c700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:40.424028 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 833/1638] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:36:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:40.432931 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1525f9-b778-40da-8d51-12103b09e55c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:40.433220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1525f9-b778-40da-8d51-12103b09e55c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:40.433496 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1525f9-b778-40da-8d51-12103b09e55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:40.461093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 806/1639] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:40.462324 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f721db9-6d74-478e-a1fe-4af1673eedc0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:40.462613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f721db9-6d74-478e-a1fe-4af1673eedc0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:40.462890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f721db9-6d74-478e-a1fe-4af1673eedc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:40.483708 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fa1525f9-b778-40da-8d51-12103b09e55c None None] MFA Rules not processed for user `41855d74928544c284fb8487e3299a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:40.487090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fa1525f9-b778-40da-8d51-12103b09e55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:40.501762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:40.527821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6f721db9-6d74-478e-a1fe-4af1673eedc0 None None] MFA Rules not processed for user `f396205186bd4d35b2d0ae316303be18`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:40.529074 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6f721db9-6d74-478e-a1fe-4af1673eedc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:40.634942 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 834/1640] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:40 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:40.637268 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1525f9-b778-40da-8d51-12103b09e55c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:40.649934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 807/1641] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:40.650865 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f721db9-6d74-478e-a1fe-4af1673eedc0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:40.717078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:40.788312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1525f9-b778-40da-8d51-12103b09e55c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:40.798945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398af6ed-5c37-496a-9e7d-55f7345bcd2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:40.799615 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398af6ed-5c37-496a-9e7d-55f7345bcd2d service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:40.799896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398af6ed-5c37-496a-9e7d-55f7345bcd2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:40.800172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398af6ed-5c37-496a-9e7d-55f7345bcd2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:40.807314 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f721db9-6d74-478e-a1fe-4af1673eedc0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:40.820799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e4f6d-cc4a-490a-8f44-1601e693d53a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:40.821527 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e4f6d-cc4a-490a-8f44-1601e693d53a service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:40.821795 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e4f6d-cc4a-490a-8f44-1601e693d53a service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:40.822070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e4f6d-cc4a-490a-8f44-1601e693d53a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:40.825142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398af6ed-5c37-496a-9e7d-55f7345bcd2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:40.827922 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398af6ed-5c37-496a-9e7d-55f7345bcd2d service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:40.842456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e4f6d-cc4a-490a-8f44-1601e693d53a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:40.846331 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e4f6d-cc4a-490a-8f44-1601e693d53a service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:40.856431 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 835/1642] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:40.863475 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 808/1643] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:40 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:40.922974 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398af6ed-5c37-496a-9e7d-55f7345bcd2d service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:40.933085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398af6ed-5c37-496a-9e7d-55f7345bcd2d service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:40.939892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da42ca-c929-4236-9f18-52a4aa5eb2e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:40.940599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da42ca-c929-4236-9f18-52a4aa5eb2e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:40.941603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da42ca-c929-4236-9f18-52a4aa5eb2e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:40.941893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da42ca-c929-4236-9f18-52a4aa5eb2e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:40.960040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da42ca-c929-4236-9f18-52a4aa5eb2e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:40.962079 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da42ca-c929-4236-9f18-52a4aa5eb2e9 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:40.987091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 836/1644] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:40 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:41.051347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e4f6d-cc4a-490a-8f44-1601e693d53a service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:41.060944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e4f6d-cc4a-490a-8f44-1601e693d53a service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:41.064437 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa3407-9857-453c-b56f-207cd92b847f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:41.065436 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa3407-9857-453c-b56f-207cd92b847f service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:41.065728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa3407-9857-453c-b56f-207cd92b847f service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:41.066667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa3407-9857-453c-b56f-207cd92b847f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:41.080172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa3407-9857-453c-b56f-207cd92b847f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:41.081940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa3407-9857-453c-b56f-207cd92b847f service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:41.106570 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 809/1645] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:41.277222 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da42ca-c929-4236-9f18-52a4aa5eb2e9 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:41.293132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da42ca-c929-4236-9f18-52a4aa5eb2e9 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:41.300193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440fa45-41a3-4978-8b14-c2818d16ddbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:41.302557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440fa45-41a3-4978-8b14-c2818d16ddbe service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:41.303195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440fa45-41a3-4978-8b14-c2818d16ddbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:41.305412 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440fa45-41a3-4978-8b14-c2818d16ddbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:41.404758 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440fa45-41a3-4978-8b14-c2818d16ddbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:41.409177 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440fa45-41a3-4978-8b14-c2818d16ddbe service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:41.427839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 837/1646] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:41.631177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ea293-1214-4d08-b000-975061709cf4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:41.631684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ea293-1214-4d08-b000-975061709cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:41.632088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ea293-1214-4d08-b000-975061709cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:41.685642 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-da7ea293-1214-4d08-b000-975061709cf4 None None] MFA Rules not processed for user `507e64cc71c441a6824b52f630191601`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:41.686788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-da7ea293-1214-4d08-b000-975061709cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:41.906705 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 810/1647] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:41.907834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440fa45-41a3-4978-8b14-c2818d16ddbe service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:41.999547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:42.057584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440fa45-41a3-4978-8b14-c2818d16ddbe service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:42.075523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8e140-2ab5-4c5c-91bb-a68ff3e3e5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:42.076370 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8e140-2ab5-4c5c-91bb-a68ff3e3e5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:42.076785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8e140-2ab5-4c5c-91bb-a68ff3e3e5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:42.077205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8e140-2ab5-4c5c-91bb-a68ff3e3e5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:42.079410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8e140-2ab5-4c5c-91bb-a68ff3e3e5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:42.086479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8e140-2ab5-4c5c-91bb-a68ff3e3e5f9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:42.215359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 838/1648] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:41 2022] POST /identity/v3/projects => generated 403 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:36:42.218911 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ea293-1214-4d08-b000-975061709cf4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:42.233636 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ea293-1214-4d08-b000-975061709cf4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:42.368697 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caf3d0-ccb3-4541-bdf3-3dfebb0fa0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:42.369405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caf3d0-ccb3-4541-bdf3-3dfebb0fa0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:42.369696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caf3d0-ccb3-4541-bdf3-3dfebb0fa0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:42.369981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caf3d0-ccb3-4541-bdf3-3dfebb0fa0d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:42.370689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33caf3d0-ccb3-4541-bdf3-3dfebb0fa0d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:42.376343 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33caf3d0-ccb3-4541-bdf3-3dfebb0fa0d4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:42.429811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 811/1649] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:42 2022] POST /identity/v3/users => generated 308 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:42.433378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8e140-2ab5-4c5c-91bb-a68ff3e3e5f9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:42.469624 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8e140-2ab5-4c5c-91bb-a68ff3e3e5f9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:42.481119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77b9c7-0584-4db7-8857-041304fdf06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:42.483584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77b9c7-0584-4db7-8857-041304fdf06d admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:42.483887 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77b9c7-0584-4db7-8857-041304fdf06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:42.484162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77b9c7-0584-4db7-8857-041304fdf06d admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:42.487128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77b9c7-0584-4db7-8857-041304fdf06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:42.491519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77b9c7-0584-4db7-8857-041304fdf06d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:42.520005 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 839/1650] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:42.520986 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caf3d0-ccb3-4541-bdf3-3dfebb0fa0d4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:42.536466 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caf3d0-ccb3-4541-bdf3-3dfebb0fa0d4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:42.547225 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6273484-7117-4da6-8198-9bc16f69c9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:42.548445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273484-7117-4da6-8198-9bc16f69c9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:42.548572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273484-7117-4da6-8198-9bc16f69c9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:42.550084 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273484-7117-4da6-8198-9bc16f69c9cf admin admin] PATH_INFO: `/v3/projects/5dfefaf247534f3b891fb48297d3d1a7/users/11962665bdc045e6a2eaef055926f406/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:42.587430 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6273484-7117-4da6-8198-9bc16f69c9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfefaf247534f3b891fb48297d3d1a7, user_id=11962665bdc045e6a2eaef055926f406, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:42.595785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6273484-7117-4da6-8198-9bc16f69c9cf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:42.637548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 812/1651] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:42 2022] PUT /identity/v3/projects/5dfefaf247534f3b891fb48297d3d1a7/users/11962665bdc045e6a2eaef055926f406/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:36:42.641505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77b9c7-0584-4db7-8857-041304fdf06d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:42.673275 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77b9c7-0584-4db7-8857-041304fdf06d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:42.743160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6273484-7117-4da6-8198-9bc16f69c9cf admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:42.747690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:42.853875 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5142bb0-e0a5-4218-8ed1-1e0e9cc8a470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:42.854823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5142bb0-e0a5-4218-8ed1-1e0e9cc8a470 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:42.855164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5142bb0-e0a5-4218-8ed1-1e0e9cc8a470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:42.855407 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5142bb0-e0a5-4218-8ed1-1e0e9cc8a470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:42.856217 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5142bb0-e0a5-4218-8ed1-1e0e9cc8a470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:42.884133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5142bb0-e0a5-4218-8ed1-1e0e9cc8a470 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:42.903169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 840/1652] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:42.903169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048bc05-5bf8-4237-b29d-659dea9cf203 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:42.903860 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048bc05-5bf8-4237-b29d-659dea9cf203 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:42.904218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048bc05-5bf8-4237-b29d-659dea9cf203 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:42.906419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 841/1653] 10.222.0.66 () {54 vars in 961 bytes} [Fri Jul 15 20:36:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:42.907727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048bc05-5bf8-4237-b29d-659dea9cf203 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:42.930767 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048bc05-5bf8-4237-b29d-659dea9cf203 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:42.936609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd09d4-2a31-4916-8ff3-01dcd28b2ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:42.937801 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd09d4-2a31-4916-8ff3-01dcd28b2ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:42.966634 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd09d4-2a31-4916-8ff3-01dcd28b2ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:42.966981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd09d4-2a31-4916-8ff3-01dcd28b2ed8 admin admin] PATH_INFO: `/v3/users/85bbcdafa72344bab912f7a3518f7ae1` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:42.975334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd09d4-2a31-4916-8ff3-01dcd28b2ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85bbcdafa72344bab912f7a3518f7ae1)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:42.976771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: WARNING py.warnings [None req-06cd09d4-2a31-4916-8ff3-01dcd28b2ed8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:36:42.976771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: warnings.warn(msg) Jul 15 20:36:42.976771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: Jul 15 20:36:42.978120 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd09d4-2a31-4916-8ff3-01dcd28b2ed8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:43.008205 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6273484-7117-4da6-8198-9bc16f69c9cf admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:43.021601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23747e7-6186-4b56-9874-7d67d0db2cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:43.024057 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23747e7-6186-4b56-9874-7d67d0db2cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.024684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23747e7-6186-4b56-9874-7d67d0db2cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.025543 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23747e7-6186-4b56-9874-7d67d0db2cda admin admin] PATH_INFO: `/v3/users/87421ecff1714c72916570cd47593cce` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.028901 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23747e7-6186-4b56-9874-7d67d0db2cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=87421ecff1714c72916570cd47593cce)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:43.039480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23747e7-6186-4b56-9874-7d67d0db2cda admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:43.108591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d23747e7-6186-4b56-9874-7d67d0db2cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87421ecff1714c72916570cd47593cce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:43.127206 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d23747e7-6186-4b56-9874-7d67d0db2cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87421ecff1714c72916570cd47593cce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:43.128215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d23747e7-6186-4b56-9874-7d67d0db2cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87421ecff1714c72916570cd47593cce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:43.140850 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d23747e7-6186-4b56-9874-7d67d0db2cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87421ecff1714c72916570cd47593cce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:43.141645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d23747e7-6186-4b56-9874-7d67d0db2cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87421ecff1714c72916570cd47593cce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:43.162061 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 813/1654] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:36:42 2022] DELETE /identity/v3/users/87421ecff1714c72916570cd47593cce => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:43.163009 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23747e7-6186-4b56-9874-7d67d0db2cda admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:43.164461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d23747e7-6186-4b56-9874-7d67d0db2cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:43.206027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-06cd09d4-2a31-4916-8ff3-01dcd28b2ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85bbcdafa72344bab912f7a3518f7ae1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:43.228551 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-06cd09d4-2a31-4916-8ff3-01dcd28b2ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85bbcdafa72344bab912f7a3518f7ae1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:43.246150 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-06cd09d4-2a31-4916-8ff3-01dcd28b2ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85bbcdafa72344bab912f7a3518f7ae1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:43.246874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-06cd09d4-2a31-4916-8ff3-01dcd28b2ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85bbcdafa72344bab912f7a3518f7ae1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:43.286840 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-06cd09d4-2a31-4916-8ff3-01dcd28b2ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85bbcdafa72344bab912f7a3518f7ae1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:43.295816 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 842/1655] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:36:42 2022] DELETE /identity/v3/users/85bbcdafa72344bab912f7a3518f7ae1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:43.297680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6b725-b741-4080-ba45-d86da63d30f1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.297978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6b725-b741-4080-ba45-d86da63d30f1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.298394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6b725-b741-4080-ba45-d86da63d30f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.301662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23747e7-6186-4b56-9874-7d67d0db2cda admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:43.331133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b0c6b725-b741-4080-ba45-d86da63d30f1 None None] MFA Rules not processed for user `b042da9298894712a0a29787a343bf85`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:43.335142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b0c6b725-b741-4080-ba45-d86da63d30f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:43.351952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:43.383085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:43.458994 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64742240-da11-4297-9379-cbb497f7ba34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:43.460246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64742240-da11-4297-9379-cbb497f7ba34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.462451 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64742240-da11-4297-9379-cbb497f7ba34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.462844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64742240-da11-4297-9379-cbb497f7ba34 admin admin] PATH_INFO: `/v3/projects/5dfefaf247534f3b891fb48297d3d1a7/users/11962665bdc045e6a2eaef055926f406/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.466526 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64742240-da11-4297-9379-cbb497f7ba34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfefaf247534f3b891fb48297d3d1a7, user_id=11962665bdc045e6a2eaef055926f406, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:43.470249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64742240-da11-4297-9379-cbb497f7ba34 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:43.497475 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 814/1656] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:43 2022] PUT /identity/v3/projects/5dfefaf247534f3b891fb48297d3d1a7/users/11962665bdc045e6a2eaef055926f406/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:43.499278 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b78970-435b-41c5-b445-c0e4e150311b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.501746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b78970-435b-41c5-b445-c0e4e150311b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.502760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b78970-435b-41c5-b445-c0e4e150311b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.531034 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 843/1657] 10.222.0.66 () {58 vars in 1058 bytes} [Fri Jul 15 20:36:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:43.540180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb9ebc-177d-4621-bfbf-358b221124cf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.540545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb9ebc-177d-4621-bfbf-358b221124cf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.540838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb9ebc-177d-4621-bfbf-358b221124cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.553117 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d8b78970-435b-41c5-b445-c0e4e150311b None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:43.557734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d8b78970-435b-41c5-b445-c0e4e150311b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:43.586231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-69eb9ebc-177d-4621-bfbf-358b221124cf None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:43.588864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-69eb9ebc-177d-4621-bfbf-358b221124cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:43.772098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 844/1658] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:43.773822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb941-8e29-4b18-8d57-e2675cae9bcc None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.774112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb941-8e29-4b18-8d57-e2675cae9bcc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.774366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb941-8e29-4b18-8d57-e2675cae9bcc None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.785976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 845/1659] 10.222.0.66 () {54 vars in 912 bytes} [Fri Jul 15 20:36:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:43.787412 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8874c7-22a2-428d-9f76-e80e1c5f8ff2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:43.787700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8874c7-22a2-428d-9f76-e80e1c5f8ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:43.788341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 815/1660] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:43.788812 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8874c7-22a2-428d-9f76-e80e1c5f8ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:43.814421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2c8874c7-22a2-428d-9f76-e80e1c5f8ff2 None None] MFA Rules not processed for user `b042da9298894712a0a29787a343bf85`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:43.815676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2c8874c7-22a2-428d-9f76-e80e1c5f8ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:43.873974 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b78970-435b-41c5-b445-c0e4e150311b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:43.875672 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d8b78970-435b-41c5-b445-c0e4e150311b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:44.054710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 846/1661] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:36:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:44.056378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8874c7-22a2-428d-9f76-e80e1c5f8ff2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:44.074601 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8874c7-22a2-428d-9f76-e80e1c5f8ff2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:44.079032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ceca9-81e6-4f33-bf49-53144188cbbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:44.079842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ceca9-81e6-4f33-bf49-53144188cbbd service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:44.082435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ceca9-81e6-4f33-bf49-53144188cbbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:44.083714 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ceca9-81e6-4f33-bf49-53144188cbbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:44.093304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b78970-435b-41c5-b445-c0e4e150311b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:44.104947 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c07c8-bab2-44b4-a57b-0cec19cfaa8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:44.107154 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c07c8-bab2-44b4-a57b-0cec19cfaa8b service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:44.108062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c07c8-bab2-44b4-a57b-0cec19cfaa8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:44.108559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c07c8-bab2-44b4-a57b-0cec19cfaa8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:44.116889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ceca9-81e6-4f33-bf49-53144188cbbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:44.120638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ceca9-81e6-4f33-bf49-53144188cbbd service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:44.140484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c07c8-bab2-44b4-a57b-0cec19cfaa8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:44.142237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c07c8-bab2-44b4-a57b-0cec19cfaa8b service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:44.146986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 847/1662] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:44.147968 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ceca9-81e6-4f33-bf49-53144188cbbd service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:44.149666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b38ceca9-81e6-4f33-bf49-53144188cbbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:44.174222 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 816/1663] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:44.223781 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:44.352414 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ceca9-81e6-4f33-bf49-53144188cbbd service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:44.372921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe411eb4-e92f-414f-82cc-174536cdb295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:44.376837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe411eb4-e92f-414f-82cc-174536cdb295 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:44.378567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe411eb4-e92f-414f-82cc-174536cdb295 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:44.379005 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe411eb4-e92f-414f-82cc-174536cdb295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:44.400235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe411eb4-e92f-414f-82cc-174536cdb295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:44.403180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe411eb4-e92f-414f-82cc-174536cdb295 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:44.431057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 848/1664] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:46.002510 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c07c8-bab2-44b4-a57b-0cec19cfaa8b service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:46.004263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9c3c07c8-bab2-44b4-a57b-0cec19cfaa8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:46.027647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c07c8-bab2-44b4-a57b-0cec19cfaa8b service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:46.038950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e836c90-54b0-491d-84f5-9281f7613bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:46.041319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e836c90-54b0-491d-84f5-9281f7613bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:46.042936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e836c90-54b0-491d-84f5-9281f7613bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:46.043830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e836c90-54b0-491d-84f5-9281f7613bb8 admin admin] PATH_INFO: `/v3/users/0252063927c6497d891859b0f6d907e3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:46.051141 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e836c90-54b0-491d-84f5-9281f7613bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0252063927c6497d891859b0f6d907e3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:46.054971 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e836c90-54b0-491d-84f5-9281f7613bb8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:46.170287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e836c90-54b0-491d-84f5-9281f7613bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0252063927c6497d891859b0f6d907e3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:46.193951 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:46.198755 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e836c90-54b0-491d-84f5-9281f7613bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0252063927c6497d891859b0f6d907e3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:46.199620 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e836c90-54b0-491d-84f5-9281f7613bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0252063927c6497d891859b0f6d907e3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:46.211146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e836c90-54b0-491d-84f5-9281f7613bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0252063927c6497d891859b0f6d907e3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:46.212205 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e836c90-54b0-491d-84f5-9281f7613bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0252063927c6497d891859b0f6d907e3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:46.252353 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e0aab-c0d4-45f9-8a3c-bc671acc5861 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:46.252880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e0aab-c0d4-45f9-8a3c-bc671acc5861 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:46.254918 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e0aab-c0d4-45f9-8a3c-bc671acc5861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:46.266309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 817/1665] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:36:45 2022] DELETE /identity/v3/users/0252063927c6497d891859b0f6d907e3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:46.308787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385812fc-eaf1-45f4-8785-096029781f07 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:46.309317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385812fc-eaf1-45f4-8785-096029781f07 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:46.309735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385812fc-eaf1-45f4-8785-096029781f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:46.321573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-960e0aab-c0d4-45f9-8a3c-bc671acc5861 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:46.325094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-960e0aab-c0d4-45f9-8a3c-bc671acc5861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:46.397581 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-385812fc-eaf1-45f4-8785-096029781f07 None None] MFA Rules not processed for user `11962665bdc045e6a2eaef055926f406`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:46.401211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-385812fc-eaf1-45f4-8785-096029781f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:46.646297 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 849/1666] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:46.669153 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 818/1667] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:46 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:46.678288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e0aab-c0d4-45f9-8a3c-bc671acc5861 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:46.680892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-960e0aab-c0d4-45f9-8a3c-bc671acc5861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:46.762749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385812fc-eaf1-45f4-8785-096029781f07 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:46.765267 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-385812fc-eaf1-45f4-8785-096029781f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:46.788956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385812fc-eaf1-45f4-8785-096029781f07 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:46.798579 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:46.802557 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:46.802557 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:46.802557 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] PATH_INFO: `/v3/projects/737fb248d98f4bd3bdc65bb58e66d11a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:46.804663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=737fb248d98f4bd3bdc65bb58e66d11a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:46.805733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: WARNING py.warnings [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:36:46.805733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: warnings.warn(msg) Jul 15 20:36:46.805733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: Jul 15 20:36:46.808522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:46.849473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e0aab-c0d4-45f9-8a3c-bc671acc5861 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:46.859835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675aa10-e53f-472f-8bd7-2caff5214d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:46.860790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675aa10-e53f-472f-8bd7-2caff5214d42 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:46.861083 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675aa10-e53f-472f-8bd7-2caff5214d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:46.861361 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675aa10-e53f-472f-8bd7-2caff5214d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:46.879599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675aa10-e53f-472f-8bd7-2caff5214d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:46.881084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675aa10-e53f-472f-8bd7-2caff5214d42 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:46.909052 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 850/1668] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:46.912520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675aa10-e53f-472f-8bd7-2caff5214d42 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:46.917452 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3675aa10-e53f-472f-8bd7-2caff5214d42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:46.955989 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737fb248d98f4bd3bdc65bb58e66d11a', 'request_id': 'req-82174e84-fe2e-462c-9757-1aaa23d11f3a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:46.958503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675aa10-e53f-472f-8bd7-2caff5214d42 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:46.971765 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737fb248d98f4bd3bdc65bb58e66d11a', 'request_id': 'req-82174e84-fe2e-462c-9757-1aaa23d11f3a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.000111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737fb248d98f4bd3bdc65bb58e66d11a', 'request_id': 'req-82174e84-fe2e-462c-9757-1aaa23d11f3a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.033135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] The token cache is being invalidate because project 737fb248d98f4bd3bdc65bb58e66d11a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:36:47.033974 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.035373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.042840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 819/1669] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:36:46 2022] DELETE /identity/v3/projects/737fb248d98f4bd3bdc65bb58e66d11a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:36:47.044573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:47.048158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:47.096137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:47.096914 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:47.097252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:47.097531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] PATH_INFO: `/v3/projects/8f5da4060dd448e0808a0fcc3b55fd54` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:47.104452 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f5da4060dd448e0808a0fcc3b55fd54)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:47.106398 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:47.147004 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:47.169690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:47.214689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82174e84-fe2e-462c-9757-1aaa23d11f3a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:47.222412 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5da4060dd448e0808a0fcc3b55fd54', 'request_id': 'req-d128a605-7fb8-4776-8dbb-3a710d2fa164'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.241847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5da4060dd448e0808a0fcc3b55fd54', 'request_id': 'req-d128a605-7fb8-4776-8dbb-3a710d2fa164'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.254350 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5da4060dd448e0808a0fcc3b55fd54', 'request_id': 'req-d128a605-7fb8-4776-8dbb-3a710d2fa164'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.279887 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] The token cache is being invalidate because project 8f5da4060dd448e0808a0fcc3b55fd54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:36:47.282126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.283056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.286724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 851/1670] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:36:46 2022] DELETE /identity/v3/projects/8f5da4060dd448e0808a0fcc3b55fd54 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:47.290414 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:47.291978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:47.356343 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a78a3d-a0dd-4b65-959c-7561c2f8dd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:47.357273 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a78a3d-a0dd-4b65-959c-7561c2f8dd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:47.357556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a78a3d-a0dd-4b65-959c-7561c2f8dd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:47.357841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a78a3d-a0dd-4b65-959c-7561c2f8dd61 admin admin] PATH_INFO: `/v3/users/41855d74928544c284fb8487e3299a97` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:47.363292 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a78a3d-a0dd-4b65-959c-7561c2f8dd61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41855d74928544c284fb8487e3299a97)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:47.367524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a78a3d-a0dd-4b65-959c-7561c2f8dd61 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:47.454378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128a605-7fb8-4776-8dbb-3a710d2fa164 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:47.465093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a6391-5a55-442d-906e-8c46a428c63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:47.465983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a6391-5a55-442d-906e-8c46a428c63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:47.468064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a6391-5a55-442d-906e-8c46a428c63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:47.468640 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-85a78a3d-a0dd-4b65-959c-7561c2f8dd61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41855d74928544c284fb8487e3299a97'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.470173 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a6391-5a55-442d-906e-8c46a428c63b admin admin] PATH_INFO: `/v3/users/f396205186bd4d35b2d0ae316303be18` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:47.473239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a6391-5a55-442d-906e-8c46a428c63b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f396205186bd4d35b2d0ae316303be18)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:47.477243 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a6391-5a55-442d-906e-8c46a428c63b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:47.501179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-85a78a3d-a0dd-4b65-959c-7561c2f8dd61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41855d74928544c284fb8487e3299a97'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.503033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-85a78a3d-a0dd-4b65-959c-7561c2f8dd61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41855d74928544c284fb8487e3299a97'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.526275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-85a78a3d-a0dd-4b65-959c-7561c2f8dd61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41855d74928544c284fb8487e3299a97'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.532612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-85a78a3d-a0dd-4b65-959c-7561c2f8dd61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41855d74928544c284fb8487e3299a97'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.563822 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 820/1671] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:36:47 2022] DELETE /identity/v3/users/41855d74928544c284fb8487e3299a97 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:47.582872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7d3a6391-5a55-442d-906e-8c46a428c63b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f396205186bd4d35b2d0ae316303be18'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.594634 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7d3a6391-5a55-442d-906e-8c46a428c63b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f396205186bd4d35b2d0ae316303be18'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.604543 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7d3a6391-5a55-442d-906e-8c46a428c63b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f396205186bd4d35b2d0ae316303be18'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.605878 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7d3a6391-5a55-442d-906e-8c46a428c63b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f396205186bd4d35b2d0ae316303be18'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.625201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7d3a6391-5a55-442d-906e-8c46a428c63b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f396205186bd4d35b2d0ae316303be18'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:47.637565 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 852/1672] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:36:47 2022] DELETE /identity/v3/users/f396205186bd4d35b2d0ae316303be18 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:48.932703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a16f3-107d-4f50-994d-3750f5e6878c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:48.933262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a16f3-107d-4f50-994d-3750f5e6878c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:48.933920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a16f3-107d-4f50-994d-3750f5e6878c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:48.935869 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 821/1673] 10.222.0.66 () {54 vars in 921 bytes} [Fri Jul 15 20:36:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:48.995373 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2a22d-3784-403b-8cf8-a41580e1aef9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:48.995826 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2a22d-3784-403b-8cf8-a41580e1aef9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:48.996497 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2a22d-3784-403b-8cf8-a41580e1aef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.047270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b6f2a22d-3784-403b-8cf8-a41580e1aef9 None None] MFA Rules not processed for user `6693dd1ea26049c1ac8460faf1bc9b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:49.052630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b6f2a22d-3784-403b-8cf8-a41580e1aef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:49.126582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:49.305749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 853/1674] 10.222.0.66 () {58 vars in 1018 bytes} [Fri Jul 15 20:36:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:49.363662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1f76-eb3e-4d2f-b37f-692d7cfaba1c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:49.363944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1f76-eb3e-4d2f-b37f-692d7cfaba1c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:49.364227 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1f76-eb3e-4d2f-b37f-692d7cfaba1c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.365966 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 822/1675] 10.222.0.66 () {54 vars in 960 bytes} [Fri Jul 15 20:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:49.373426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f7231-f246-47f5-b9b8-85c6926c6564 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:49.374061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f7231-f246-47f5-b9b8-85c6926c6564 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:49.374755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f7231-f246-47f5-b9b8-85c6926c6564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.416807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5e9f7231-f246-47f5-b9b8-85c6926c6564 None None] MFA Rules not processed for user `6693dd1ea26049c1ac8460faf1bc9b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:49.420384 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5e9f7231-f246-47f5-b9b8-85c6926c6564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:49.436838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 854/1676] 10.222.0.66 () {58 vars in 1057 bytes} [Fri Jul 15 20:36:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:49.445533 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe1f76-eb3e-4d2f-b37f-692d7cfaba1c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:49.467556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe1f76-eb3e-4d2f-b37f-692d7cfaba1c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:49.480762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c457f37-ffbe-4c86-8d1d-4eb16def46f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6693dd1ea26049c1ac8460faf1bc9b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:49.481490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c457f37-ffbe-4c86-8d1d-4eb16def46f9 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:49.481776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c457f37-ffbe-4c86-8d1d-4eb16def46f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:49.482103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c457f37-ffbe-4c86-8d1d-4eb16def46f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.501397 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c457f37-ffbe-4c86-8d1d-4eb16def46f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:49.503417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c457f37-ffbe-4c86-8d1d-4eb16def46f9 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:49.529242 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 823/1677] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:49.662399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f7231-f246-47f5-b9b8-85c6926c6564 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:49.666298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5e9f7231-f246-47f5-b9b8-85c6926c6564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:49.772607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c457f37-ffbe-4c86-8d1d-4eb16def46f9 service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:49.778156 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6c457f37-ffbe-4c86-8d1d-4eb16def46f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:49.839717 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f7231-f246-47f5-b9b8-85c6926c6564 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:49.847940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae3fb3-cc81-4717-a7eb-17075008d13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:49.850650 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae3fb3-cc81-4717-a7eb-17075008d13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:49.850973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae3fb3-cc81-4717-a7eb-17075008d13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:49.851204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae3fb3-cc81-4717-a7eb-17075008d13d admin admin] PATH_INFO: `/v3/projects/c1020584fa404da1a9ad11ead78d638c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:49.854874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae3fb3-cc81-4717-a7eb-17075008d13d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1020584fa404da1a9ad11ead78d638c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:49.856959 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae3fb3-cc81-4717-a7eb-17075008d13d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:49.966327 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c457f37-ffbe-4c86-8d1d-4eb16def46f9 service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:49.977579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-96ae3fb3-cc81-4717-a7eb-17075008d13d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1020584fa404da1a9ad11ead78d638c', 'request_id': 'req-96ae3fb3-cc81-4717-a7eb-17075008d13d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:49.982033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:49.994538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-96ae3fb3-cc81-4717-a7eb-17075008d13d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1020584fa404da1a9ad11ead78d638c', 'request_id': 'req-96ae3fb3-cc81-4717-a7eb-17075008d13d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:50.014506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-96ae3fb3-cc81-4717-a7eb-17075008d13d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1020584fa404da1a9ad11ead78d638c', 'request_id': 'req-96ae3fb3-cc81-4717-a7eb-17075008d13d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:50.047693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-96ae3fb3-cc81-4717-a7eb-17075008d13d admin admin] The token cache is being invalidate because project c1020584fa404da1a9ad11ead78d638c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:36:50.049385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-96ae3fb3-cc81-4717-a7eb-17075008d13d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:50.051899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-96ae3fb3-cc81-4717-a7eb-17075008d13d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:50.053763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 855/1678] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:36:49 2022] DELETE /identity/v3/projects/c1020584fa404da1a9ad11ead78d638c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:50.059282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144ec4c-1338-4a81-b5c5-1f6d8072d3d8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.061781 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144ec4c-1338-4a81-b5c5-1f6d8072d3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.063238 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144ec4c-1338-4a81-b5c5-1f6d8072d3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.105145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e144ec4c-1338-4a81-b5c5-1f6d8072d3d8 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:50.107416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e144ec4c-1338-4a81-b5c5-1f6d8072d3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:50.138853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:50.139950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.140337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.140788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f admin admin] PATH_INFO: `/v3/projects/52e46739f49d4c4680dd5f2da9b96b31` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.149476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e46739f49d4c4680dd5f2da9b96b31)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:50.152939 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:50.217399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:50.291409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 856/1679] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:50.292888 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144ec4c-1338-4a81-b5c5-1f6d8072d3d8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:50.294400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e144ec4c-1338-4a81-b5c5-1f6d8072d3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:50.343211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144ec4c-1338-4a81-b5c5-1f6d8072d3d8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:50.361998 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e46739f49d4c4680dd5f2da9b96b31', 'request_id': 'req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:50.379319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e46739f49d4c4680dd5f2da9b96b31', 'request_id': 'req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:50.390340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e46739f49d4c4680dd5f2da9b96b31', 'request_id': 'req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:50.454259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f admin admin] The token cache is being invalidate because project 52e46739f49d4c4680dd5f2da9b96b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:36:50.455099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:50.456200 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8e1c3b94-7619-408d-b0bd-30b99e1fb00f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:50.459893 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 824/1680] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:36:49 2022] DELETE /identity/v3/projects/52e46739f49d4c4680dd5f2da9b96b31 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:50.461687 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff672c0-fffd-4148-8fa4-48e1e04b0e14 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.462591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff672c0-fffd-4148-8fa4-48e1e04b0e14 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.463359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff672c0-fffd-4148-8fa4-48e1e04b0e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.498160 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:50.499378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.499760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.500136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] PATH_INFO: `/v3/projects/7e3ea1bb8ba640afaac7a738aa7e52ad` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.502997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e3ea1bb8ba640afaac7a738aa7e52ad)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:50.506348 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:50.534897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2ff672c0-fffd-4148-8fa4-48e1e04b0e14 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:50.544153 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2ff672c0-fffd-4148-8fa4-48e1e04b0e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:50.583442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 825/1681] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:50.589382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff201-5977-432b-b50b-f56a23458b41 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.589679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff201-5977-432b-b50b-f56a23458b41 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.589967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff201-5977-432b-b50b-f56a23458b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.681654 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e3ea1bb8ba640afaac7a738aa7e52ad', 'request_id': 'req-89cc566f-742d-45ae-a824-3e41ea20d662'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:50.698860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-388ff201-5977-432b-b50b-f56a23458b41 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:50.700149 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-388ff201-5977-432b-b50b-f56a23458b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:50.701212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e3ea1bb8ba640afaac7a738aa7e52ad', 'request_id': 'req-89cc566f-742d-45ae-a824-3e41ea20d662'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:50.725195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e3ea1bb8ba640afaac7a738aa7e52ad', 'request_id': 'req-89cc566f-742d-45ae-a824-3e41ea20d662'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:50.764048 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] The token cache is being invalidate because project 7e3ea1bb8ba640afaac7a738aa7e52ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:36:50.764435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:50.766497 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:50.772440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 857/1682] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:36:50 2022] DELETE /identity/v3/projects/7e3ea1bb8ba640afaac7a738aa7e52ad => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:50.772440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:50.772440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:50.874321 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 826/1683] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:50.875921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7991489-5def-4843-8ba7-c2935e4f620f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.876078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7991489-5def-4843-8ba7-c2935e4f620f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.876339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7991489-5def-4843-8ba7-c2935e4f620f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.911695 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a7991489-5def-4843-8ba7-c2935e4f620f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:50.914786 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a7991489-5def-4843-8ba7-c2935e4f620f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:50.930403 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 827/1684] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:50.931948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811ba68-50d1-4cfa-874b-9ce58f3aaf43 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.932667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811ba68-50d1-4cfa-874b-9ce58f3aaf43 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.933103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811ba68-50d1-4cfa-874b-9ce58f3aaf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.951810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc566f-742d-45ae-a824-3e41ea20d662 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:50.957198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4811ba68-50d1-4cfa-874b-9ce58f3aaf43 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:50.959099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4811ba68-50d1-4cfa-874b-9ce58f3aaf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:50.965794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351baef-19e1-4c31-8389-1394864884b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:50.970659 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351baef-19e1-4c31-8389-1394864884b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:50.970961 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351baef-19e1-4c31-8389-1394864884b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:50.971232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351baef-19e1-4c31-8389-1394864884b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:50.972753 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351baef-19e1-4c31-8389-1394864884b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:50.973135 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351baef-19e1-4c31-8389-1394864884b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:50.974640 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351baef-19e1-4c31-8389-1394864884b6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:51.007546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 828/1685] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:51.009186 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc85ce0-fd86-4f44-a909-107028558b75 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.009710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc85ce0-fd86-4f44-a909-107028558b75 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.010231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc85ce0-fd86-4f44-a909-107028558b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.020035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 858/1686] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:51.030717 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279269c8-cda0-4042-b622-6452a3f63678 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.031209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279269c8-cda0-4042-b622-6452a3f63678 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.031691 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279269c8-cda0-4042-b622-6452a3f63678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.048169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:51.064615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6fc85ce0-fd86-4f44-a909-107028558b75 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:51.069058 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6fc85ce0-fd86-4f44-a909-107028558b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:51.107492 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-279269c8-cda0-4042-b622-6452a3f63678 None None] MFA Rules not processed for user `1f231f706d2f4d3e9070105bb5981cec`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:51.109023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-279269c8-cda0-4042-b622-6452a3f63678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:51.129357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 829/1687] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:51.130483 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc85ce0-fd86-4f44-a909-107028558b75 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:51.188110 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc85ce0-fd86-4f44-a909-107028558b75 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:51.211680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ec1c1-9235-4d2a-a3cb-ffdb496f2d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:51.212892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ec1c1-9235-4d2a-a3cb-ffdb496f2d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.213388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ec1c1-9235-4d2a-a3cb-ffdb496f2d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.213696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ec1c1-9235-4d2a-a3cb-ffdb496f2d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.214461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ec1c1-9235-4d2a-a3cb-ffdb496f2d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:51.214990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ec1c1-9235-4d2a-a3cb-ffdb496f2d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:51.217582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ec1c1-9235-4d2a-a3cb-ffdb496f2d6d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:51.247518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:51.259353 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 859/1688] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:51.260675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279269c8-cda0-4042-b622-6452a3f63678 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:51.262163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 830/1689] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:51.263123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ec1c1-9235-4d2a-a3cb-ffdb496f2d6d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:51.283672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279269c8-cda0-4042-b622-6452a3f63678 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:51.309523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ec1c1-9235-4d2a-a3cb-ffdb496f2d6d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:51.310526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338f2e9-08ee-4edd-887e-696ecfde0a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:51.311400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338f2e9-08ee-4edd-887e-696ecfde0a3a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.311694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338f2e9-08ee-4edd-887e-696ecfde0a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.311975 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338f2e9-08ee-4edd-887e-696ecfde0a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.313681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338f2e9-08ee-4edd-887e-696ecfde0a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:51.316370 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338f2e9-08ee-4edd-887e-696ecfde0a3a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:51.324575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4e8f9-8cf0-4f13-bb15-f47759ecc7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:51.329589 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4e8f9-8cf0-4f13-bb15-f47759ecc7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.329878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4e8f9-8cf0-4f13-bb15-f47759ecc7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.330159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4e8f9-8cf0-4f13-bb15-f47759ecc7a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.330985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4e8f9-8cf0-4f13-bb15-f47759ecc7a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:51.331396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4e8f9-8cf0-4f13-bb15-f47759ecc7a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:51.339180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4e8f9-8cf0-4f13-bb15-f47759ecc7a2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:51.374594 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 831/1690] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:51.377380 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4e8f9-8cf0-4f13-bb15-f47759ecc7a2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:51.389571 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 860/1691] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:51 2022] POST /identity/v3/projects => generated 357 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:51.402284 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae823293-c022-4c85-b8cb-b0cbaa23bc0c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.407538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae823293-c022-4c85-b8cb-b0cbaa23bc0c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.408123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae823293-c022-4c85-b8cb-b0cbaa23bc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.424675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4e8f9-8cf0-4f13-bb15-f47759ecc7a2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:51.477617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ae823293-c022-4c85-b8cb-b0cbaa23bc0c None None] MFA Rules not processed for user `1f231f706d2f4d3e9070105bb5981cec`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:51.480547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ae823293-c022-4c85-b8cb-b0cbaa23bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:51.617922 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e228f-e987-48b7-b58e-6f6d2e11e601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:51.618941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e228f-e987-48b7-b58e-6f6d2e11e601 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.618941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e228f-e987-48b7-b58e-6f6d2e11e601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.619150 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e228f-e987-48b7-b58e-6f6d2e11e601 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.620590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e228f-e987-48b7-b58e-6f6d2e11e601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:51.627039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e228f-e987-48b7-b58e-6f6d2e11e601 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:51.641167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 861/1692] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:51.642214 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae823293-c022-4c85-b8cb-b0cbaa23bc0c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:51.644933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ae823293-c022-4c85-b8cb-b0cbaa23bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:51.691368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 832/1693] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:51 2022] POST /identity/v3/projects => generated 369 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:51.694432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e228f-e987-48b7-b58e-6f6d2e11e601 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:51.702084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae823293-c022-4c85-b8cb-b0cbaa23bc0c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:51.869783 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e228f-e987-48b7-b58e-6f6d2e11e601 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:51.877135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb5e9e-c4c3-4b96-8611-70170fd30f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:51.878391 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb5e9e-c4c3-4b96-8611-70170fd30f33 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.878707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb5e9e-c4c3-4b96-8611-70170fd30f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.878994 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb5e9e-c4c3-4b96-8611-70170fd30f33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.880078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb5e9e-c4c3-4b96-8611-70170fd30f33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:51.884626 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb5e9e-c4c3-4b96-8611-70170fd30f33 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:51.891175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27f739-7fd4-4aa5-855c-d7d0192dc4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:51.892093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f739-7fd4-4aa5-855c-d7d0192dc4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:51.895572 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f739-7fd4-4aa5-855c-d7d0192dc4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:51.896508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f739-7fd4-4aa5-855c-d7d0192dc4a0 admin admin] PATH_INFO: `/v3/users/507e64cc71c441a6824b52f630191601` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:51.898220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27f739-7fd4-4aa5-855c-d7d0192dc4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=507e64cc71c441a6824b52f630191601)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:51.902124 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27f739-7fd4-4aa5-855c-d7d0192dc4a0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:51.939931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 833/1694] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:51 2022] POST /identity/v3/projects => generated 365 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:51.942124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb5e9e-c4c3-4b96-8611-70170fd30f33 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:51.960525 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:52.034123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6d27f739-7fd4-4aa5-855c-d7d0192dc4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507e64cc71c441a6824b52f630191601'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:52.053664 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6d27f739-7fd4-4aa5-855c-d7d0192dc4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507e64cc71c441a6824b52f630191601'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:52.061547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:52.072015 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6d27f739-7fd4-4aa5-855c-d7d0192dc4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507e64cc71c441a6824b52f630191601'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:52.073597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6d27f739-7fd4-4aa5-855c-d7d0192dc4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507e64cc71c441a6824b52f630191601'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:52.073902 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb5e9e-c4c3-4b96-8611-70170fd30f33 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.087518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2981358-afdd-40ef-826a-a9670eb9fa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.088966 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981358-afdd-40ef-826a-a9670eb9fa45 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.089423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981358-afdd-40ef-826a-a9670eb9fa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.089892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981358-afdd-40ef-826a-a9670eb9fa45 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.090811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2981358-afdd-40ef-826a-a9670eb9fa45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:52.094293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2981358-afdd-40ef-826a-a9670eb9fa45 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:52.137105 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6d27f739-7fd4-4aa5-855c-d7d0192dc4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507e64cc71c441a6824b52f630191601'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:52.142061 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 834/1696] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:51 2022] POST /identity/v3/users => generated 279 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:52.142061 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2981358-afdd-40ef-826a-a9670eb9fa45 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:52.144474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c2981358-afdd-40ef-826a-a9670eb9fa45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:52.147547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 862/1696] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:36:51 2022] DELETE /identity/v3/users/507e64cc71c441a6824b52f630191601 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:52.148703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27f739-7fd4-4aa5-855c-d7d0192dc4a0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:52.152755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6d27f739-7fd4-4aa5-855c-d7d0192dc4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:52.311098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27f739-7fd4-4aa5-855c-d7d0192dc4a0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.326544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bc0d1-85af-4a9c-a60e-bbc84c64bcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.327470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bc0d1-85af-4a9c-a60e-bbc84c64bcca admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.328659 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bc0d1-85af-4a9c-a60e-bbc84c64bcca admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.329063 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bc0d1-85af-4a9c-a60e-bbc84c64bcca admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.329983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bc0d1-85af-4a9c-a60e-bbc84c64bcca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:52.333197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bc0d1-85af-4a9c-a60e-bbc84c64bcca admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:52.345554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2981358-afdd-40ef-826a-a9670eb9fa45 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.385054 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 863/1697] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:52 2022] POST /identity/v3/users => generated 285 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:52.390694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bc0d1-85af-4a9c-a60e-bbc84c64bcca admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:52.395686 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4e1bc0d1-85af-4a9c-a60e-bbc84c64bcca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:52.428574 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bc0d1-85af-4a9c-a60e-bbc84c64bcca admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.453653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb931a-a4f7-4391-a304-5562760d92d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.454535 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb931a-a4f7-4391-a304-5562760d92d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.455100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb931a-a4f7-4391-a304-5562760d92d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.455518 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb931a-a4f7-4391-a304-5562760d92d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.457149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb931a-a4f7-4391-a304-5562760d92d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:52.459698 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76eb9c-721b-4a2e-aa72-efb1d0200a91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.460553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76eb9c-721b-4a2e-aa72-efb1d0200a91 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.460837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76eb9c-721b-4a2e-aa72-efb1d0200a91 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.461162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76eb9c-721b-4a2e-aa72-efb1d0200a91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.463704 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eb76eb9c-721b-4a2e-aa72-efb1d0200a91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:52.464172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb931a-a4f7-4391-a304-5562760d92d8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:52.490502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 864/1698] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:52 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:52.492170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb931a-a4f7-4391-a304-5562760d92d8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:52.495579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-81eb931a-a4f7-4391-a304-5562760d92d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:52.513239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb931a-a4f7-4391-a304-5562760d92d8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.520661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c4f1d-f7ec-4461-8732-af8506752a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.521786 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c4f1d-f7ec-4461-8732-af8506752a6c admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.522084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c4f1d-f7ec-4461-8732-af8506752a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.522371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c4f1d-f7ec-4461-8732-af8506752a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.524052 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c4f1d-f7ec-4461-8732-af8506752a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:52.525793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c4f1d-f7ec-4461-8732-af8506752a6c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:52.549199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 865/1699] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:52.556969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631b178-1efe-42ec-b29a-56f2283b3a96 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.557281 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631b178-1efe-42ec-b29a-56f2283b3a96 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.557529 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631b178-1efe-42ec-b29a-56f2283b3a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.574712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76eb9c-721b-4a2e-aa72-efb1d0200a91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:52.579460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76eb9c-721b-4a2e-aa72-efb1d0200a91 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:52.603002 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 835/1700] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:52.620216 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76eb9c-721b-4a2e-aa72-efb1d0200a91 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:52.648209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5631b178-1efe-42ec-b29a-56f2283b3a96 None None] MFA Rules not processed for user `c0b5962b37b2470099436609425f7423`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:52.654672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5631b178-1efe-42ec-b29a-56f2283b3a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:52.668828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76eb9c-721b-4a2e-aa72-efb1d0200a91 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.691498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c7c2e-9347-48e4-b177-e75cd2c6b01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.696107 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c7c2e-9347-48e4-b177-e75cd2c6b01b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.697193 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c7c2e-9347-48e4-b177-e75cd2c6b01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.697798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c7c2e-9347-48e4-b177-e75cd2c6b01b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.699904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c7c2e-9347-48e4-b177-e75cd2c6b01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:52.708801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c7c2e-9347-48e4-b177-e75cd2c6b01b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:52.731461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 836/1701] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:52.739464 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c7c2e-9347-48e4-b177-e75cd2c6b01b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:52.766630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c7c2e-9347-48e4-b177-e75cd2c6b01b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.788829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0af60-a008-47e0-b381-ef937bc4f9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.789614 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0af60-a008-47e0-b381-ef937bc4f9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.789996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0af60-a008-47e0-b381-ef937bc4f9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.791872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0af60-a008-47e0-b381-ef937bc4f9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.796177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0af60-a008-47e0-b381-ef937bc4f9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:52.799090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0af60-a008-47e0-b381-ef937bc4f9ae admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:52.804187 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:52.830103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=7,keystone:SELECT=86,keystone:INSERT=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:52.837087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 837/1702] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:52.838296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0af60-a008-47e0-b381-ef937bc4f9ae admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:52.867273 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0af60-a008-47e0-b381-ef937bc4f9ae admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.879297 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 866/1703] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:52.879956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e534-b599-405b-b47e-ded5a363b715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.881645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e534-b599-405b-b47e-ded5a363b715 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.882463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631b178-1efe-42ec-b29a-56f2283b3a96 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:52.883229 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e534-b599-405b-b47e-ded5a363b715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.884909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5631b178-1efe-42ec-b29a-56f2283b3a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:52.894260 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e534-b599-405b-b47e-ded5a363b715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.895230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95e534-b599-405b-b47e-ded5a363b715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:52.898488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95e534-b599-405b-b47e-ded5a363b715 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:52.926356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 838/1704] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:52.930883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631b178-1efe-42ec-b29a-56f2283b3a96 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.933259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e534-b599-405b-b47e-ded5a363b715 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:52.951359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.952748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.952980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.953361 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] PATH_INFO: `/v3/projects/f0adae0a879c440a96daf21b59b7f8f0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.954793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0adae0a879c440a96daf21b59b7f8f0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:52.957463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:52.959971 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e534-b599-405b-b47e-ded5a363b715 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:52.971004 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7118a-795a-4e06-8849-cd453192d326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:52.974118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7118a-795a-4e06-8849-cd453192d326 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:52.975228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7118a-795a-4e06-8849-cd453192d326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:52.975548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7118a-795a-4e06-8849-cd453192d326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:52.977597 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7118a-795a-4e06-8849-cd453192d326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:52.980886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7118a-795a-4e06-8849-cd453192d326 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:53.007042 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 839/1705] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:53.008479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7118a-795a-4e06-8849-cd453192d326 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:53.028890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7118a-795a-4e06-8849-cd453192d326 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:53.043882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6afc8a-18fe-4ae6-8dbf-77076a9ba5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:53.045728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6afc8a-18fe-4ae6-8dbf-77076a9ba5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:53.047030 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6afc8a-18fe-4ae6-8dbf-77076a9ba5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:53.047571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6afc8a-18fe-4ae6-8dbf-77076a9ba5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:53.050875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6afc8a-18fe-4ae6-8dbf-77076a9ba5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:53.055407 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6afc8a-18fe-4ae6-8dbf-77076a9ba5a1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:53.062415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0adae0a879c440a96daf21b59b7f8f0', 'request_id': 'req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:53.074539 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0adae0a879c440a96daf21b59b7f8f0', 'request_id': 'req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:53.084670 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 840/1706] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:53.091135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6afc8a-18fe-4ae6-8dbf-77076a9ba5a1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:53.094742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0adae0a879c440a96daf21b59b7f8f0', 'request_id': 'req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:53.100358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-df6afc8a-18fe-4ae6-8dbf-77076a9ba5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:53.126324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] The token cache is being invalidate because project f0adae0a879c440a96daf21b59b7f8f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:36:53.126660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:53.128589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:53.132046 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 867/1707] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:36:52 2022] DELETE /identity/v3/projects/f0adae0a879c440a96daf21b59b7f8f0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:53.132488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6afc8a-18fe-4ae6-8dbf-77076a9ba5a1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:53.136108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:53.141484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:53.285253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b717c77-7702-4b1e-ba23-722ef98d20fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:53.286030 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b717c77-7702-4b1e-ba23-722ef98d20fc service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:53.286380 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b717c77-7702-4b1e-ba23-722ef98d20fc service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:53.286667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b717c77-7702-4b1e-ba23-722ef98d20fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:53.291145 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6b717c77-7702-4b1e-ba23-722ef98d20fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:53.358527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa535c-2678-4f9b-96d8-0f2ec935e47e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:53.366785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e80bd0-4f27-4b54-97f7-df91101937c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:53.368111 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80bd0-4f27-4b54-97f7-df91101937c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:53.368415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80bd0-4f27-4b54-97f7-df91101937c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:53.368861 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80bd0-4f27-4b54-97f7-df91101937c7 admin admin] PATH_INFO: `/v3/projects/bb1e84e6e80246b290316380d5cd7bad/users/3680bdfdcaa84140ae9352a111b2fe40/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:53.399594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e80bd0-4f27-4b54-97f7-df91101937c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1e84e6e80246b290316380d5cd7bad, user_id=3680bdfdcaa84140ae9352a111b2fe40, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:53.402410 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b717c77-7702-4b1e-ba23-722ef98d20fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:53.404333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b717c77-7702-4b1e-ba23-722ef98d20fc service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:53.405626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e80bd0-4f27-4b54-97f7-df91101937c7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:53.418499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 841/1708] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:53.419600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b717c77-7702-4b1e-ba23-722ef98d20fc service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:53.421195 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6b717c77-7702-4b1e-ba23-722ef98d20fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:53.441875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b717c77-7702-4b1e-ba23-722ef98d20fc service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:53.458937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 868/1709] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:53 2022] PUT /identity/v3/projects/bb1e84e6e80246b290316380d5cd7bad/users/3680bdfdcaa84140ae9352a111b2fe40/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:53.462218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e80bd0-4f27-4b54-97f7-df91101937c7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:53.469427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-99e80bd0-4f27-4b54-97f7-df91101937c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:53.598897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a1e5c-bc29-400a-bb54-a199f1b6f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:53.603095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:53.606539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a1e5c-bc29-400a-bb54-a199f1b6f5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:53.606736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a1e5c-bc29-400a-bb54-a199f1b6f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:53.607050 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a1e5c-bc29-400a-bb54-a199f1b6f5a3 admin admin] PATH_INFO: `/v3/projects/638ab2d441f24ac9b70eb087d94617f2/users/f6077edcaec94a58a00ee578fcaf056b/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:53.612538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e80bd0-4f27-4b54-97f7-df91101937c7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:53.621725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac897d1-6009-4699-a7ba-f955ab184387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:53.622634 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac897d1-6009-4699-a7ba-f955ab184387 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:53.622915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac897d1-6009-4699-a7ba-f955ab184387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:53.623206 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac897d1-6009-4699-a7ba-f955ab184387 admin admin] PATH_INFO: `/v3/projects/a8a7db2fd2084361ba9230e3d08b168e/users/a14994f49f6c44cf9786068f95333d39/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:53.627553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:53.644558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac897d1-6009-4699-a7ba-f955ab184387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a7db2fd2084361ba9230e3d08b168e, user_id=a14994f49f6c44cf9786068f95333d39, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:53.651731 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac897d1-6009-4699-a7ba-f955ab184387 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:53.663195 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a1e5c-bc29-400a-bb54-a199f1b6f5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638ab2d441f24ac9b70eb087d94617f2, user_id=f6077edcaec94a58a00ee578fcaf056b, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:53.669481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a1e5c-bc29-400a-bb54-a199f1b6f5a3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:53.693783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 869/1710] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:53 2022] PUT /identity/v3/projects/a8a7db2fd2084361ba9230e3d08b168e/users/a14994f49f6c44cf9786068f95333d39/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:53.693783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac897d1-6009-4699-a7ba-f955ab184387 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:53.693783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0ac897d1-6009-4699-a7ba-f955ab184387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:53.717619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 842/1711] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:53 2022] PUT /identity/v3/projects/638ab2d441f24ac9b70eb087d94617f2/users/f6077edcaec94a58a00ee578fcaf056b/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:53.717619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8bd56-3ae9-469e-bc8e-6fa5b0da70be None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:53.717619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8bd56-3ae9-469e-bc8e-6fa5b0da70be None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:53.717619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8bd56-3ae9-469e-bc8e-6fa5b0da70be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:53.787999 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-49e8bd56-3ae9-469e-bc8e-6fa5b0da70be None None] MFA Rules not processed for user `3680bdfdcaa84140ae9352a111b2fe40`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:53.789911 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-49e8bd56-3ae9-469e-bc8e-6fa5b0da70be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:53.872733 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac897d1-6009-4699-a7ba-f955ab184387 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:53.938179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 843/1712] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:53 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:53.940440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305bc0a-7d54-493f-a85e-7744fde3dc0e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:53.941765 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305bc0a-7d54-493f-a85e-7744fde3dc0e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:53.942198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305bc0a-7d54-493f-a85e-7744fde3dc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:53.987164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7305bc0a-7d54-493f-a85e-7744fde3dc0e None None] MFA Rules not processed for user `e13d5d7068e348248387b512c55dec5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:53.989941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7305bc0a-7d54-493f-a85e-7744fde3dc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:54.031696 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef450c-c611-4368-8496-e5ecacdd7ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:54.032750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef450c-c611-4368-8496-e5ecacdd7ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.033132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef450c-c611-4368-8496-e5ecacdd7ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.033506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef450c-c611-4368-8496-e5ecacdd7ed9 admin admin] PATH_INFO: `/v3/users/11962665bdc045e6a2eaef055926f406` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.036081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef450c-c611-4368-8496-e5ecacdd7ed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11962665bdc045e6a2eaef055926f406)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:54.040973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef450c-c611-4368-8496-e5ecacdd7ed9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:54.132164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3aef450c-c611-4368-8496-e5ecacdd7ed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11962665bdc045e6a2eaef055926f406'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:54.148051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3aef450c-c611-4368-8496-e5ecacdd7ed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11962665bdc045e6a2eaef055926f406'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:54.163633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3aef450c-c611-4368-8496-e5ecacdd7ed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11962665bdc045e6a2eaef055926f406'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:54.165220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3aef450c-c611-4368-8496-e5ecacdd7ed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11962665bdc045e6a2eaef055926f406'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:54.172016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 844/1713] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:54.174426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a529e-83b5-4944-8f9f-fd17d40b9d7d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.177650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a529e-83b5-4944-8f9f-fd17d40b9d7d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.180920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a529e-83b5-4944-8f9f-fd17d40b9d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.204013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3aef450c-c611-4368-8496-e5ecacdd7ed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11962665bdc045e6a2eaef055926f406'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:54.221127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 870/1714] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:36:53 2022] DELETE /identity/v3/users/11962665bdc045e6a2eaef055926f406 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:54.221127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e49a5-d9e4-426d-b8c9-943e318a4449 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.221127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e49a5-d9e4-426d-b8c9-943e318a4449 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.221127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e49a5-d9e4-426d-b8c9-943e318a4449 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.238125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 871/1715] 10.222.0.66 () {54 vars in 912 bytes} [Fri Jul 15 20:36:54 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:54.246021 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe9f7-19fb-498e-a2e5-ee53044281d0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.246448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe9f7-19fb-498e-a2e5-ee53044281d0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.246927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe9f7-19fb-498e-a2e5-ee53044281d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.271705 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c36a529e-83b5-4944-8f9f-fd17d40b9d7d None None] MFA Rules not processed for user `a14994f49f6c44cf9786068f95333d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:54.273840 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:54.278536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c36a529e-83b5-4944-8f9f-fd17d40b9d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:54.345302 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c13fe9f7-19fb-498e-a2e5-ee53044281d0 None None] MFA Rules not processed for user `f6077edcaec94a58a00ee578fcaf056b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:54.349570 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c13fe9f7-19fb-498e-a2e5-ee53044281d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:54.446557 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:54.484264 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 845/1716] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:54.484264 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a529e-83b5-4944-8f9f-fd17d40b9d7d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:54.484264 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c36a529e-83b5-4944-8f9f-fd17d40b9d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:54.528351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 872/1717] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:54.529970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d884f-0a5f-4070-9a31-22ddced3d330 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.532109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d884f-0a5f-4070-9a31-22ddced3d330 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.532586 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d884f-0a5f-4070-9a31-22ddced3d330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.566749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-624d884f-0a5f-4070-9a31-22ddced3d330 None None] MFA Rules not processed for user `e13d5d7068e348248387b512c55dec5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:54.568847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-624d884f-0a5f-4070-9a31-22ddced3d330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:54.601522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a529e-83b5-4944-8f9f-fd17d40b9d7d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:54.612134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f74b4-6c92-47d7-a997-f6d297a36b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:54.613971 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f74b4-6c92-47d7-a997-f6d297a36b94 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.613971 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f74b4-6c92-47d7-a997-f6d297a36b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.615219 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f74b4-6c92-47d7-a997-f6d297a36b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.616104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f74b4-6c92-47d7-a997-f6d297a36b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:54.619590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f74b4-6c92-47d7-a997-f6d297a36b94 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:54.659743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 846/1718] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:54 2022] POST /identity/v3/projects => generated 357 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:54.663655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970cebf-6b1f-417e-af8d-0dea47478d54 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.664354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970cebf-6b1f-417e-af8d-0dea47478d54 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.664793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970cebf-6b1f-417e-af8d-0dea47478d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.717556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e970cebf-6b1f-417e-af8d-0dea47478d54 None None] MFA Rules not processed for user `633e05f021544b669749f941f40cbf58`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:54.719407 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e970cebf-6b1f-417e-af8d-0dea47478d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:54.730581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 873/1719] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:54.731603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d884f-0a5f-4070-9a31-22ddced3d330 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:54.736642 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-624d884f-0a5f-4070-9a31-22ddced3d330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:54.777591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d884f-0a5f-4070-9a31-22ddced3d330 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:54.835487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 847/1720] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:36:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:54.837651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970cebf-6b1f-417e-af8d-0dea47478d54 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:54.840613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e970cebf-6b1f-417e-af8d-0dea47478d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:54.934788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66f137-c37a-4d43-80b8-5148be5f1dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:54.935704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66f137-c37a-4d43-80b8-5148be5f1dcd admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:54.935997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66f137-c37a-4d43-80b8-5148be5f1dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:54.936275 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66f137-c37a-4d43-80b8-5148be5f1dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:54.938710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66f137-c37a-4d43-80b8-5148be5f1dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:54.946211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66f137-c37a-4d43-80b8-5148be5f1dcd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:55.042037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 874/1721] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:54 2022] POST /identity/v3/projects => generated 363 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:55.043648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66f137-c37a-4d43-80b8-5148be5f1dcd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:55.060337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970cebf-6b1f-417e-af8d-0dea47478d54 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.136948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:55.142373 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:55.210786 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66f137-c37a-4d43-80b8-5148be5f1dcd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.214890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a350d69-a507-4b7c-a916-882c46ff4dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:55.217105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a350d69-a507-4b7c-a916-882c46ff4dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:55.217105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a350d69-a507-4b7c-a916-882c46ff4dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:55.217105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a350d69-a507-4b7c-a916-882c46ff4dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:55.217784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a350d69-a507-4b7c-a916-882c46ff4dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:55.219991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a350d69-a507-4b7c-a916-882c46ff4dfb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:55.230110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec26e4-38e1-48b9-8a04-73959b6c246c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:55.231015 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec26e4-38e1-48b9-8a04-73959b6c246c admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:55.231516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec26e4-38e1-48b9-8a04-73959b6c246c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:55.232073 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec26e4-38e1-48b9-8a04-73959b6c246c admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:55.233204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec26e4-38e1-48b9-8a04-73959b6c246c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:55.235784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec26e4-38e1-48b9-8a04-73959b6c246c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:55.264070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 848/1722] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:54 2022] POST /identity/v3/projects => generated 367 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:55.264070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a350d69-a507-4b7c-a916-882c46ff4dfb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:55.264806 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8a350d69-a507-4b7c-a916-882c46ff4dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:55.283426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 875/1723] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:55 2022] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:55.286248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec26e4-38e1-48b9-8a04-73959b6c246c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:55.288965 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-98ec26e4-38e1-48b9-8a04-73959b6c246c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:55.404637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec26e4-38e1-48b9-8a04-73959b6c246c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.446799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a350d69-a507-4b7c-a916-882c46ff4dfb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.464336 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaafcf-b1a5-4e72-ae39-afc350fcdcd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:55.465047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaafcf-b1a5-4e72-ae39-afc350fcdcd9 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:55.465329 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaafcf-b1a5-4e72-ae39-afc350fcdcd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:55.465664 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaafcf-b1a5-4e72-ae39-afc350fcdcd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:55.469540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4bcaafcf-b1a5-4e72-ae39-afc350fcdcd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:55.543312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b2abb-cb70-4cee-a27a-c54eb8e892f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:55.543902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b2abb-cb70-4cee-a27a-c54eb8e892f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:55.544196 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b2abb-cb70-4cee-a27a-c54eb8e892f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:55.544507 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b2abb-cb70-4cee-a27a-c54eb8e892f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:55.567589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b2abb-cb70-4cee-a27a-c54eb8e892f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:55.569545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b2abb-cb70-4cee-a27a-c54eb8e892f3 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:55.600231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 876/1724] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:55.601308 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b2abb-cb70-4cee-a27a-c54eb8e892f3 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:55.615215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaafcf-b1a5-4e72-ae39-afc350fcdcd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:55.632031 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaafcf-b1a5-4e72-ae39-afc350fcdcd9 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:55.677327 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 849/1725] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:55.678436 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaafcf-b1a5-4e72-ae39-afc350fcdcd9 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:55.683846 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4bcaafcf-b1a5-4e72-ae39-afc350fcdcd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:55.776199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b2abb-cb70-4cee-a27a-c54eb8e892f3 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.788247 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097da1d4-8742-475f-a97a-db27fe971cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:55.788978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097da1d4-8742-475f-a97a-db27fe971cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:55.789424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097da1d4-8742-475f-a97a-db27fe971cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:55.789702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097da1d4-8742-475f-a97a-db27fe971cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:55.793477 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097da1d4-8742-475f-a97a-db27fe971cc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:55.798832 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097da1d4-8742-475f-a97a-db27fe971cc1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:55.840942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:55.849580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 877/1726] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:55 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:55.849580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097da1d4-8742-475f-a97a-db27fe971cc1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:55.859915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:55.878122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097da1d4-8742-475f-a97a-db27fe971cc1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.889259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaafcf-b1a5-4e72-ae39-afc350fcdcd9 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.891037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cfbc0-465c-4191-b119-4c2204064f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:55.891869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cfbc0-465c-4191-b119-4c2204064f0e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:55.892169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cfbc0-465c-4191-b119-4c2204064f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:55.892465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cfbc0-465c-4191-b119-4c2204064f0e admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:55.893169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499cfbc0-465c-4191-b119-4c2204064f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:55.897151 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499cfbc0-465c-4191-b119-4c2204064f0e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:55.897528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:55.898666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:55.900348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:55.901041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] PATH_INFO: `/v3/projects/5dfefaf247534f3b891fb48297d3d1a7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:55.904602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dfefaf247534f3b891fb48297d3d1a7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:55.911969 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:55.946995 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 878/1727] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:55 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:55.948473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cfbc0-465c-4191-b119-4c2204064f0e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:55.966198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cfbc0-465c-4191-b119-4c2204064f0e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:55.994531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dfefaf247534f3b891fb48297d3d1a7', 'request_id': 'req-0a91535f-2eef-4a65-bba1-2f9854e961f3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:56.011512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dfefaf247534f3b891fb48297d3d1a7', 'request_id': 'req-0a91535f-2eef-4a65-bba1-2f9854e961f3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:56.020204 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dfefaf247534f3b891fb48297d3d1a7', 'request_id': 'req-0a91535f-2eef-4a65-bba1-2f9854e961f3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:56.033634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] The token cache is being invalidate because project 5dfefaf247534f3b891fb48297d3d1a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:36:56.035021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:56.035942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:36:56.038737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 850/1728] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:36:55 2022] DELETE /identity/v3/projects/5dfefaf247534f3b891fb48297d3d1a7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:56.039439 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:56.040899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:56.124435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ece081-527d-4892-9d85-d7ca8b535710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:56.125125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece081-527d-4892-9d85-d7ca8b535710 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.125419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece081-527d-4892-9d85-d7ca8b535710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.125704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece081-527d-4892-9d85-d7ca8b535710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.126701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ece081-527d-4892-9d85-d7ca8b535710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:56.133659 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ece081-527d-4892-9d85-d7ca8b535710 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:56.193005 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 879/1729] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:56.197586 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ece081-527d-4892-9d85-d7ca8b535710 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:56.201199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-60ece081-527d-4892-9d85-d7ca8b535710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:56.215496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91535f-2eef-4a65-bba1-2f9854e961f3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:56.229989 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5de66-7682-499a-885a-faaa04e2ce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:56.231399 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5de66-7682-499a-885a-faaa04e2ce6d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.231846 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5de66-7682-499a-885a-faaa04e2ce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.234894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5de66-7682-499a-885a-faaa04e2ce6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.235040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ece081-527d-4892-9d85-d7ca8b535710 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:56.235139 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5de66-7682-499a-885a-faaa04e2ce6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:56.236973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5de66-7682-499a-885a-faaa04e2ce6d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:56.252241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff83a81-f0ab-46fe-8e16-58aba8125c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:56.252241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff83a81-f0ab-46fe-8e16-58aba8125c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.252241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff83a81-f0ab-46fe-8e16-58aba8125c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.252241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff83a81-f0ab-46fe-8e16-58aba8125c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.255512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff83a81-f0ab-46fe-8e16-58aba8125c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:56.256019 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff83a81-f0ab-46fe-8e16-58aba8125c27 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:56.279962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 851/1730] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:56.281504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e14f8-e8c0-47fd-a727-a974e247c892 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.281796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e14f8-e8c0-47fd-a727-a974e247c892 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.282076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e14f8-e8c0-47fd-a727-a974e247c892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.284188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 880/1731] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:56.289484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff83a81-f0ab-46fe-8e16-58aba8125c27 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:56.295318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-eff83a81-f0ab-46fe-8e16-58aba8125c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:56.322253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6a1e14f8-e8c0-47fd-a727-a974e247c892 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:56.324092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6a1e14f8-e8c0-47fd-a727-a974e247c892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:56.331031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff83a81-f0ab-46fe-8e16-58aba8125c27 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:56.345227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f0c28-6563-4bfb-9085-482d34e27158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:56.346379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f0c28-6563-4bfb-9085-482d34e27158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.346828 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f0c28-6563-4bfb-9085-482d34e27158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.348117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f0c28-6563-4bfb-9085-482d34e27158 admin admin] PATH_INFO: `/v3/projects/34371c32d22a450bbb520ae96c27e8b4/users/f0ec99488ae54c959c5dae9192eebcdc/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.354995 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 852/1732] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:56.367659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e14f8-e8c0-47fd-a727-a974e247c892 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:56.397878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e14f8-e8c0-47fd-a727-a974e247c892 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:56.402633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f0c28-6563-4bfb-9085-482d34e27158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34371c32d22a450bbb520ae96c27e8b4, user_id=f0ec99488ae54c959c5dae9192eebcdc, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:56.405422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f0c28-6563-4bfb-9085-482d34e27158 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:56.410166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02abed9-1426-455d-9cf2-296848578a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:56.414166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02abed9-1426-455d-9cf2-296848578a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.415958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02abed9-1426-455d-9cf2-296848578a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.416431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02abed9-1426-455d-9cf2-296848578a3a admin admin] PATH_INFO: `/v3/projects/15351675185a4914ba844c1610816c3b/users/39d649c431c84c7ebcaa351d2fc36e5d/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.432140 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 881/1733] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:56 2022] PUT /identity/v3/projects/34371c32d22a450bbb520ae96c27e8b4/users/f0ec99488ae54c959c5dae9192eebcdc/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:56.432140 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f0c28-6563-4bfb-9085-482d34e27158 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:56.467236 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02abed9-1426-455d-9cf2-296848578a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15351675185a4914ba844c1610816c3b, user_id=39d649c431c84c7ebcaa351d2fc36e5d, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:56.476719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02abed9-1426-455d-9cf2-296848578a3a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:56.507593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 853/1734] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:56 2022] PUT /identity/v3/projects/15351675185a4914ba844c1610816c3b/users/39d649c431c84c7ebcaa351d2fc36e5d/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:56.509363 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560ad9e-f3e2-4bf4-852b-d7ee49345526 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.509809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560ad9e-f3e2-4bf4-852b-d7ee49345526 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.510758 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560ad9e-f3e2-4bf4-852b-d7ee49345526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.549343 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7560ad9e-f3e2-4bf4-852b-d7ee49345526 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:56.554318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7560ad9e-f3e2-4bf4-852b-d7ee49345526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:56.585318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f0c28-6563-4bfb-9085-482d34e27158 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:56.715160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:56.721431 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:56.754150 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0f448-81d5-4051-bddf-2d0ea3c79db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:56.755416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0f448-81d5-4051-bddf-2d0ea3c79db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.755416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0f448-81d5-4051-bddf-2d0ea3c79db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.755416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0f448-81d5-4051-bddf-2d0ea3c79db2 admin admin] PATH_INFO: `/v3/projects/27afaf2db12c4adbab18544b04c49d00/users/ce33eaa896dc48f58e264b300bb1451b/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.809423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 854/1735] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:56.811098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560ad9e-f3e2-4bf4-852b-d7ee49345526 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:56.820607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0f448-81d5-4051-bddf-2d0ea3c79db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27afaf2db12c4adbab18544b04c49d00, user_id=ce33eaa896dc48f58e264b300bb1451b, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:56.823335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0f448-81d5-4051-bddf-2d0ea3c79db2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:56.827589 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560ad9e-f3e2-4bf4-852b-d7ee49345526 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:56.849879 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f029290-a9f3-4251-922e-8f424f15a9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:56.852305 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f029290-a9f3-4251-922e-8f424f15a9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.852803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f029290-a9f3-4251-922e-8f424f15a9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.853042 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f029290-a9f3-4251-922e-8f424f15a9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.853877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f029290-a9f3-4251-922e-8f424f15a9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:56.858100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 882/1736] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:56 2022] PUT /identity/v3/projects/27afaf2db12c4adbab18544b04c49d00/users/ce33eaa896dc48f58e264b300bb1451b/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:56.858100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bfc34-bfc1-486b-b85d-f88ac14f448a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:56.858100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bfc34-bfc1-486b-b85d-f88ac14f448a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:56.858100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bfc34-bfc1-486b-b85d-f88ac14f448a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:56.860378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f029290-a9f3-4251-922e-8f424f15a9d2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:56.872802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 883/1737] 10.222.0.66 () {54 vars in 912 bytes} [Fri Jul 15 20:36:56 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:36:56.873858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bfc34-bfc1-486b-b85d-f88ac14f448a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:56.892878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 855/1738] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:56.894617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f029290-a9f3-4251-922e-8f424f15a9d2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:56.917698 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f029290-a9f3-4251-922e-8f424f15a9d2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:57.028927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bfc34-bfc1-486b-b85d-f88ac14f448a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:57.030674 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a0f1d-72a9-495c-817a-db1ad22ff4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:57.031353 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a0f1d-72a9-495c-817a-db1ad22ff4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.031637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a0f1d-72a9-495c-817a-db1ad22ff4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.032508 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a0f1d-72a9-495c-817a-db1ad22ff4d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.033244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a0f1d-72a9-495c-817a-db1ad22ff4d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:36:57.033553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a0f1d-72a9-495c-817a-db1ad22ff4d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:57.034418 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df62a1e-879b-4770-9ec7-efd341b40132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:57.035174 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df62a1e-879b-4770-9ec7-efd341b40132 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.035531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df62a1e-879b-4770-9ec7-efd341b40132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.035882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df62a1e-879b-4770-9ec7-efd341b40132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.036750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df62a1e-879b-4770-9ec7-efd341b40132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:57.037752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a0f1d-72a9-495c-817a-db1ad22ff4d4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:57.044366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df62a1e-879b-4770-9ec7-efd341b40132 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:57.064811 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 884/1739] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:57.066417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df62a1e-879b-4770-9ec7-efd341b40132 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:57.078305 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 856/1740] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:36:57.079940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc576f-36a0-4034-87b5-4ff9ceb13046 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.080238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc576f-36a0-4034-87b5-4ff9ceb13046 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.080541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc576f-36a0-4034-87b5-4ff9ceb13046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.086700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df62a1e-879b-4770-9ec7-efd341b40132 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:57.092101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc213f5-808c-4f6f-adae-371d3442b9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:57.092948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc213f5-808c-4f6f-adae-371d3442b9de admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.093335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc213f5-808c-4f6f-adae-371d3442b9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.093712 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc213f5-808c-4f6f-adae-371d3442b9de admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.094639 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc213f5-808c-4f6f-adae-371d3442b9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:57.096366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc213f5-808c-4f6f-adae-371d3442b9de admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:57.104061 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-22cc576f-36a0-4034-87b5-4ff9ceb13046 None None] MFA Rules not processed for user `633e05f021544b669749f941f40cbf58`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:57.105309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-22cc576f-36a0-4034-87b5-4ff9ceb13046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:57.110215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 885/1741] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:57.111169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc213f5-808c-4f6f-adae-371d3442b9de admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:57.122535 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc213f5-808c-4f6f-adae-371d3442b9de admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:57.127416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1254774-206b-4c5d-b95e-d1d49c6d8be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:57.129240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1254774-206b-4c5d-b95e-d1d49c6d8be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.129618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1254774-206b-4c5d-b95e-d1d49c6d8be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.129994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1254774-206b-4c5d-b95e-d1d49c6d8be6 admin admin] PATH_INFO: `/v3/projects/34371c32d22a450bbb520ae96c27e8b4/users/f0ec99488ae54c959c5dae9192eebcdc/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.132169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1254774-206b-4c5d-b95e-d1d49c6d8be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34371c32d22a450bbb520ae96c27e8b4, user_id=f0ec99488ae54c959c5dae9192eebcdc, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:57.135011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1254774-206b-4c5d-b95e-d1d49c6d8be6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:57.152531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 886/1742] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:57 2022] PUT /identity/v3/projects/34371c32d22a450bbb520ae96c27e8b4/users/f0ec99488ae54c959c5dae9192eebcdc/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:57.152531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1254774-206b-4c5d-b95e-d1d49c6d8be6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:57.154419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f1254774-206b-4c5d-b95e-d1d49c6d8be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:57.201695 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 857/1743] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:36:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:57.203125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc576f-36a0-4034-87b5-4ff9ceb13046 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:57.217295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc576f-36a0-4034-87b5-4ff9ceb13046 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:57.267653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1254774-206b-4c5d-b95e-d1d49c6d8be6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:57.274287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ce938-f03a-4789-8b00-aa30781dc529 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6693dd1ea26049c1ac8460faf1bc9b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:57.275060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ce938-f03a-4789-8b00-aa30781dc529 service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.275511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ce938-f03a-4789-8b00-aa30781dc529 service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.275900 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ce938-f03a-4789-8b00-aa30781dc529 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.278370 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-516ce938-f03a-4789-8b00-aa30781dc529 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:57.291789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ce938-f03a-4789-8b00-aa30781dc529 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:57.293919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ce938-f03a-4789-8b00-aa30781dc529 service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:57.299463 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5805f80-84a5-425f-8359-3d72fa18ff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:57.300934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5805f80-84a5-425f-8359-3d72fa18ff29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.301226 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5805f80-84a5-425f-8359-3d72fa18ff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.301500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5805f80-84a5-425f-8359-3d72fa18ff29 admin admin] PATH_INFO: `/v3/projects/15351675185a4914ba844c1610816c3b/users/39d649c431c84c7ebcaa351d2fc36e5d/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.303920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5805f80-84a5-425f-8359-3d72fa18ff29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15351675185a4914ba844c1610816c3b, user_id=39d649c431c84c7ebcaa351d2fc36e5d, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:57.305621 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 887/1744] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:57.306482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ce938-f03a-4789-8b00-aa30781dc529 service placement] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:57.306643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5805f80-84a5-425f-8359-3d72fa18ff29 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:57.319245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 858/1745] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:57 2022] PUT /identity/v3/projects/15351675185a4914ba844c1610816c3b/users/39d649c431c84c7ebcaa351d2fc36e5d/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:57.320078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5805f80-84a5-425f-8359-3d72fa18ff29 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:57.320501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ce938-f03a-4789-8b00-aa30781dc529 service placement] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:57.330571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:57.385909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:57.401255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5805f80-84a5-425f-8359-3d72fa18ff29 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:57.408452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dfd84-c2c9-4bf4-a576-d2a85f778e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:57.409666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dfd84-c2c9-4bf4-a576-d2a85f778e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.409958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dfd84-c2c9-4bf4-a576-d2a85f778e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.410235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dfd84-c2c9-4bf4-a576-d2a85f778e78 admin admin] PATH_INFO: `/v3/projects/27afaf2db12c4adbab18544b04c49d00/users/ce33eaa896dc48f58e264b300bb1451b/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.412907 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dfd84-c2c9-4bf4-a576-d2a85f778e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27afaf2db12c4adbab18544b04c49d00, user_id=ce33eaa896dc48f58e264b300bb1451b, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:57.419059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dfd84-c2c9-4bf4-a576-d2a85f778e78 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:57.421699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d5c6a-3be1-4c00-9eb9-a86ece8af0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:57.428837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5c6a-3be1-4c00-9eb9-a86ece8af0ed admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.429214 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5c6a-3be1-4c00-9eb9-a86ece8af0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.429443 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5c6a-3be1-4c00-9eb9-a86ece8af0ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.430156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d5c6a-3be1-4c00-9eb9-a86ece8af0ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:57.432117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d5c6a-3be1-4c00-9eb9-a86ece8af0ed admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:57.440283 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 859/1746] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:57 2022] PUT /identity/v3/projects/27afaf2db12c4adbab18544b04c49d00/users/ce33eaa896dc48f58e264b300bb1451b/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:57.442494 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31521e9-021d-49c2-a76b-182eb59644c3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.442789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31521e9-021d-49c2-a76b-182eb59644c3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.443069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31521e9-021d-49c2-a76b-182eb59644c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.474844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e31521e9-021d-49c2-a76b-182eb59644c3 None None] MFA Rules not processed for user `f0ec99488ae54c959c5dae9192eebcdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:57.475309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 888/1747] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:57 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:57.476866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8ea2b-3677-48c7-acb6-3f1a6af29aab None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.477498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8ea2b-3677-48c7-acb6-3f1a6af29aab None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.477785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8ea2b-3677-48c7-acb6-3f1a6af29aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.479732 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e31521e9-021d-49c2-a76b-182eb59644c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:57.507039 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-24b8ea2b-3677-48c7-acb6-3f1a6af29aab None None] MFA Rules not processed for user `c0b5962b37b2470099436609425f7423`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:57.509341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-24b8ea2b-3677-48c7-acb6-3f1a6af29aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:57.612593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 860/1748] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:57 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:57.614082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31521e9-021d-49c2-a76b-182eb59644c3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:57.617904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e31521e9-021d-49c2-a76b-182eb59644c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:57.628522 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 889/1749] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:57.629996 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c69f25-c732-464f-b8d9-9fb925a3d17e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.630291 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c69f25-c732-464f-b8d9-9fb925a3d17e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.630573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c69f25-c732-464f-b8d9-9fb925a3d17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.711876 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-00c69f25-c732-464f-b8d9-9fb925a3d17e None None] MFA Rules not processed for user `39d649c431c84c7ebcaa351d2fc36e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:57.713399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-00c69f25-c732-464f-b8d9-9fb925a3d17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:57.736094 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31521e9-021d-49c2-a76b-182eb59644c3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:57.748975 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d88c80-d392-47b8-8073-e31f16dbf8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:57.749662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d88c80-d392-47b8-8073-e31f16dbf8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.749930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d88c80-d392-47b8-8073-e31f16dbf8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.750208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d88c80-d392-47b8-8073-e31f16dbf8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.773979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d88c80-d392-47b8-8073-e31f16dbf8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:57.777235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d88c80-d392-47b8-8073-e31f16dbf8f3 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:57.810525 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 861/1750] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:57.813172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5978b-cabb-48ef-9e22-8fc211394beb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:57.813528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5978b-cabb-48ef-9e22-8fc211394beb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:57.813806 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5978b-cabb-48ef-9e22-8fc211394beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:57.835599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 890/1751] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:57 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:57.835599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c69f25-c732-464f-b8d9-9fb925a3d17e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:57.857530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d4c5978b-cabb-48ef-9e22-8fc211394beb None None] MFA Rules not processed for user `ce33eaa896dc48f58e264b300bb1451b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:57.858848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d4c5978b-cabb-48ef-9e22-8fc211394beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:57.915818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:58.005883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:58.022656 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c69f25-c732-464f-b8d9-9fb925a3d17e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.028506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ab946-f4fd-4823-9b64-8a4d24c91236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.029203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ab946-f4fd-4823-9b64-8a4d24c91236 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.029491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ab946-f4fd-4823-9b64-8a4d24c91236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.030033 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ab946-f4fd-4823-9b64-8a4d24c91236 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.030813 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ab946-f4fd-4823-9b64-8a4d24c91236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.032808 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ab946-f4fd-4823-9b64-8a4d24c91236 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:58.092446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 862/1752] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:58.093510 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5978b-cabb-48ef-9e22-8fc211394beb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.094864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d4c5978b-cabb-48ef-9e22-8fc211394beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:58.115920 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 891/1753] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:57 2022] POST /identity/v3/users => generated 294 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:58.115920 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ab946-f4fd-4823-9b64-8a4d24c91236 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.140151 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-290ab946-f4fd-4823-9b64-8a4d24c91236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:58.238560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5978b-cabb-48ef-9e22-8fc211394beb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.251015 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280d39d-1760-4d95-bf79-6877e4683470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.251948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280d39d-1760-4d95-bf79-6877e4683470 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.252484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280d39d-1760-4d95-bf79-6877e4683470 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.252743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280d39d-1760-4d95-bf79-6877e4683470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.292453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280d39d-1760-4d95-bf79-6877e4683470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.294435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280d39d-1760-4d95-bf79-6877e4683470 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:58.305377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ab946-f4fd-4823-9b64-8a4d24c91236 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.320710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0216e2-e26f-428a-92aa-dbe5939e8e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.331223 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0216e2-e26f-428a-92aa-dbe5939e8e7a service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.331921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0216e2-e26f-428a-92aa-dbe5939e8e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.332292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0216e2-e26f-428a-92aa-dbe5939e8e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.337257 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 863/1754] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:58 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:58.340673 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280d39d-1760-4d95-bf79-6877e4683470 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.368723 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280d39d-1760-4d95-bf79-6877e4683470 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.385331 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7436a-6e65-4875-8d0c-cb9d94b17c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.386579 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7436a-6e65-4875-8d0c-cb9d94b17c0c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.387096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7436a-6e65-4875-8d0c-cb9d94b17c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.387514 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7436a-6e65-4875-8d0c-cb9d94b17c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.388458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0216e2-e26f-428a-92aa-dbe5939e8e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.389022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7436a-6e65-4875-8d0c-cb9d94b17c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.393546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0216e2-e26f-428a-92aa-dbe5939e8e7a service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:58.394259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7436a-6e65-4875-8d0c-cb9d94b17c0c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:58.424479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 864/1755] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:58.429778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7436a-6e65-4875-8d0c-cb9d94b17c0c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.432326 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 892/1756] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:58 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:58.462413 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7436a-6e65-4875-8d0c-cb9d94b17c0c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.474680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a75d2f-af65-428f-9e04-1c421cb77489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.475485 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a75d2f-af65-428f-9e04-1c421cb77489 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.475773 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a75d2f-af65-428f-9e04-1c421cb77489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.476520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a75d2f-af65-428f-9e04-1c421cb77489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.476807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a75d2f-af65-428f-9e04-1c421cb77489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.478432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a75d2f-af65-428f-9e04-1c421cb77489 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:58.483343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0216e2-e26f-428a-92aa-dbe5939e8e7a service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.493019 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0216e2-e26f-428a-92aa-dbe5939e8e7a service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.504368 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 865/1757] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:36:58.506730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501ffb3-dce3-4311-a4ca-17d00f2694ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.507830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501ffb3-dce3-4311-a4ca-17d00f2694ad service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.508306 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501ffb3-dce3-4311-a4ca-17d00f2694ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.508899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501ffb3-dce3-4311-a4ca-17d00f2694ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.513435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a75d2f-af65-428f-9e04-1c421cb77489 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.530514 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501ffb3-dce3-4311-a4ca-17d00f2694ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.534707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501ffb3-dce3-4311-a4ca-17d00f2694ad service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:58.537741 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a75d2f-af65-428f-9e04-1c421cb77489 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.547111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578b22d-df8e-4a6f-b405-36d24b2d3144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.547870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578b22d-df8e-4a6f-b405-36d24b2d3144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.548230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578b22d-df8e-4a6f-b405-36d24b2d3144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.548879 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578b22d-df8e-4a6f-b405-36d24b2d3144 admin admin] PATH_INFO: `/v3/projects/03afd3915a2c4f1d8b138c1a668293cd/users/34e5adba6c0d45949b5a04bf3f844f45/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.568882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 893/1758] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:58.609282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578b22d-df8e-4a6f-b405-36d24b2d3144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03afd3915a2c4f1d8b138c1a668293cd, user_id=34e5adba6c0d45949b5a04bf3f844f45, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:58.621447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578b22d-df8e-4a6f-b405-36d24b2d3144 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:58.657955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 866/1759] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:36:58 2022] PUT /identity/v3/projects/03afd3915a2c4f1d8b138c1a668293cd/users/34e5adba6c0d45949b5a04bf3f844f45/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:36:58.669847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1703a-0b30-4b32-a61d-d2db2a330a0f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.670483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1703a-0b30-4b32-a61d-d2db2a330a0f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.670973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1703a-0b30-4b32-a61d-d2db2a330a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.730982 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578b22d-df8e-4a6f-b405-36d24b2d3144 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:58.770434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5ce1703a-0b30-4b32-a61d-d2db2a330a0f None None] MFA Rules not processed for user `34e5adba6c0d45949b5a04bf3f844f45`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:36:58.774544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5ce1703a-0b30-4b32-a61d-d2db2a330a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:58.871676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578b22d-df8e-4a6f-b405-36d24b2d3144 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:58.889461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc7fcb-4624-49b7-b55b-3c7d9f4dd1a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:58.890275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc7fcb-4624-49b7-b55b-3c7d9f4dd1a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:58.893259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc7fcb-4624-49b7-b55b-3c7d9f4dd1a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:58.894417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc7fcb-4624-49b7-b55b-3c7d9f4dd1a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:58.911757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4dcc7fcb-4624-49b7-b55b-3c7d9f4dd1a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:58.968574 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 894/1760] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:36:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:36:58.975670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1703a-0b30-4b32-a61d-d2db2a330a0f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:59.004301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:59.006259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1703a-0b30-4b32-a61d-d2db2a330a0f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:59.013203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a5376-8e3d-4182-8d69-18900583d1c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:59.014517 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a5376-8e3d-4182-8d69-18900583d1c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:59.020910 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a5376-8e3d-4182-8d69-18900583d1c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:59.021323 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a5376-8e3d-4182-8d69-18900583d1c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:59.027356 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-479a5376-8e3d-4182-8d69-18900583d1c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:36:59.112382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc7fcb-4624-49b7-b55b-3c7d9f4dd1a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:59.114367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc7fcb-4624-49b7-b55b-3c7d9f4dd1a4 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:59.145287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 867/1761] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:58 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:36:59.148561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc7fcb-4624-49b7-b55b-3c7d9f4dd1a4 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:59.173439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a5376-8e3d-4182-8d69-18900583d1c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:59.176629 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a5376-8e3d-4182-8d69-18900583d1c1 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:59.182369 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:59.189075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 895/1762] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:36:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:36:59.377619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc7fcb-4624-49b7-b55b-3c7d9f4dd1a4 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:59.389787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ccc5a-20be-4461-8a21-8f77b31b57db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:59.390569 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ccc5a-20be-4461-8a21-8f77b31b57db admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:59.390866 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ccc5a-20be-4461-8a21-8f77b31b57db admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:59.391141 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ccc5a-20be-4461-8a21-8f77b31b57db admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:59.391856 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ccc5a-20be-4461-8a21-8f77b31b57db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:59.395162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ccc5a-20be-4461-8a21-8f77b31b57db admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:59.537978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a5376-8e3d-4182-8d69-18900583d1c1 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:59.542792 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 868/1763] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:36:59 2022] POST /identity/v3/projects => generated 387 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:36:59.564605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a5376-8e3d-4182-8d69-18900583d1c1 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:59.747732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716fe38-9f8d-4607-80a2-f9dc1fed65c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:59.751818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716fe38-9f8d-4607-80a2-f9dc1fed65c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:59.753335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716fe38-9f8d-4607-80a2-f9dc1fed65c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:59.754956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716fe38-9f8d-4607-80a2-f9dc1fed65c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:59.757680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716fe38-9f8d-4607-80a2-f9dc1fed65c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:59.772578 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716fe38-9f8d-4607-80a2-f9dc1fed65c9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:36:59.922935 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 896/1764] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:36:59 2022] POST /identity/v3/users => generated 300 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:36:59.938683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ccc5a-20be-4461-8a21-8f77b31b57db admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:36:59.957939 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ccc5a-20be-4461-8a21-8f77b31b57db admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:36:59.973673 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa1e46-27c4-4aea-b636-a138b36d849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:36:59.974622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa1e46-27c4-4aea-b636-a138b36d849a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:36:59.975065 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa1e46-27c4-4aea-b636-a138b36d849a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:36:59.975500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa1e46-27c4-4aea-b636-a138b36d849a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:36:59.976488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa1e46-27c4-4aea-b636-a138b36d849a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:36:59.978350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa1e46-27c4-4aea-b636-a138b36d849a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:00.001715 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 869/1765] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:00.006419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716fe38-9f8d-4607-80a2-f9dc1fed65c9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:00.039028 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716fe38-9f8d-4607-80a2-f9dc1fed65c9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:00.073605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af620cd6-cb8a-4f60-9539-a3730bbe0a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:00.074664 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620cd6-cb8a-4f60-9539-a3730bbe0a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:00.074937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620cd6-cb8a-4f60-9539-a3730bbe0a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:00.080111 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620cd6-cb8a-4f60-9539-a3730bbe0a23 admin admin] PATH_INFO: `/v3/projects/f935583c899142dda4446f97e1415b10/users/8fc73dba70274ea18f6535682618dc5a/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:00.082524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2db006-145c-4b45-b01b-fd2ae3bc840d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:00.083052 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2db006-145c-4b45-b01b-fd2ae3bc840d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:00.083515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2db006-145c-4b45-b01b-fd2ae3bc840d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:00.122599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af620cd6-cb8a-4f60-9539-a3730bbe0a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f935583c899142dda4446f97e1415b10, user_id=8fc73dba70274ea18f6535682618dc5a, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:00.124613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0b2db006-145c-4b45-b01b-fd2ae3bc840d None None] MFA Rules not processed for user `e13d5d7068e348248387b512c55dec5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:00.130523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0b2db006-145c-4b45-b01b-fd2ae3bc840d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:00.131100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af620cd6-cb8a-4f60-9539-a3730bbe0a23 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:00.169670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 897/1766] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:00 2022] PUT /identity/v3/projects/f935583c899142dda4446f97e1415b10/users/8fc73dba70274ea18f6535682618dc5a/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:00.170802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af620cd6-cb8a-4f60-9539-a3730bbe0a23 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:00.273009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af620cd6-cb8a-4f60-9539-a3730bbe0a23 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:00.280200 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457c192-1951-4787-b305-15d708771a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:00.281439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457c192-1951-4787-b305-15d708771a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:00.282380 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457c192-1951-4787-b305-15d708771a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:00.283458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457c192-1951-4787-b305-15d708771a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:00.285823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457c192-1951-4787-b305-15d708771a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:00.289079 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457c192-1951-4787-b305-15d708771a33 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:00.328645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 898/1767] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:00.329946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457c192-1951-4787-b305-15d708771a33 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:00.346007 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 870/1768] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:00.395566 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457c192-1951-4787-b305-15d708771a33 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:00.415655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda23a6-d1cb-4813-b48f-6f1dccabc660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:00.419286 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda23a6-d1cb-4813-b48f-6f1dccabc660 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:00.420900 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda23a6-d1cb-4813-b48f-6f1dccabc660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:00.424104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda23a6-d1cb-4813-b48f-6f1dccabc660 admin admin] PATH_INFO: `/v3/projects/f935583c899142dda4446f97e1415b10/users/8fc73dba70274ea18f6535682618dc5a/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:00.444333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda23a6-d1cb-4813-b48f-6f1dccabc660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f935583c899142dda4446f97e1415b10, user_id=8fc73dba70274ea18f6535682618dc5a, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:00.455517 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda23a6-d1cb-4813-b48f-6f1dccabc660 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:00.516095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 899/1769] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:00 2022] PUT /identity/v3/projects/f935583c899142dda4446f97e1415b10/users/8fc73dba70274ea18f6535682618dc5a/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:00.527677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8777ef-5fe3-403b-893d-0a4cd065076a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:00.528234 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8777ef-5fe3-403b-893d-0a4cd065076a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:00.528626 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8777ef-5fe3-403b-893d-0a4cd065076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:00.590540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3f8777ef-5fe3-403b-893d-0a4cd065076a None None] MFA Rules not processed for user `8fc73dba70274ea18f6535682618dc5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:00.602151 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3f8777ef-5fe3-403b-893d-0a4cd065076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:00.724860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:00.865321 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 871/1770] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:01.084234 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda23a6-d1cb-4813-b48f-6f1dccabc660 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:01.311122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:01.321128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda23a6-d1cb-4813-b48f-6f1dccabc660 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:01.332862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bed03-781f-4122-9015-d9294a2173dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:01.334144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bed03-781f-4122-9015-d9294a2173dd service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:01.334623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bed03-781f-4122-9015-d9294a2173dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:01.335966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bed03-781f-4122-9015-d9294a2173dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:01.370346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bed03-781f-4122-9015-d9294a2173dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:01.371952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bed03-781f-4122-9015-d9294a2173dd service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:01.400588 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 900/1771] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:01.726794 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4844e65-5a96-455d-baac-db2e551fd243 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:01.727551 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4844e65-5a96-455d-baac-db2e551fd243 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:01.727551 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4844e65-5a96-455d-baac-db2e551fd243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:01.875906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f4844e65-5a96-455d-baac-db2e551fd243 None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:01.880744 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f4844e65-5a96-455d-baac-db2e551fd243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:01.959801 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bed03-781f-4122-9015-d9294a2173dd service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:02.032961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 872/1772] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:37:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:02.153645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bed03-781f-4122-9015-d9294a2173dd service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:02.177883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194ccf-ae37-4caa-9aa9-57af9e48affb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:02.181147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194ccf-ae37-4caa-9aa9-57af9e48affb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:02.182228 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194ccf-ae37-4caa-9aa9-57af9e48affb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:02.184294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194ccf-ae37-4caa-9aa9-57af9e48affb admin admin] PATH_INFO: `/v3/users/34e5adba6c0d45949b5a04bf3f844f45` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:02.186752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f194ccf-ae37-4caa-9aa9-57af9e48affb admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e5adba6c0d45949b5a04bf3f844f45)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:02.192679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f194ccf-ae37-4caa-9aa9-57af9e48affb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:02.401647 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4f194ccf-ae37-4caa-9aa9-57af9e48affb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e5adba6c0d45949b5a04bf3f844f45'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:02.417785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4f194ccf-ae37-4caa-9aa9-57af9e48affb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e5adba6c0d45949b5a04bf3f844f45'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:02.457644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4f194ccf-ae37-4caa-9aa9-57af9e48affb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e5adba6c0d45949b5a04bf3f844f45'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:02.458978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4f194ccf-ae37-4caa-9aa9-57af9e48affb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e5adba6c0d45949b5a04bf3f844f45'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:02.515852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4844e65-5a96-455d-baac-db2e551fd243 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:02.519615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f4844e65-5a96-455d-baac-db2e551fd243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:02.525393 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4f194ccf-ae37-4caa-9aa9-57af9e48affb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e5adba6c0d45949b5a04bf3f844f45'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:02.539468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 901/1773] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:01 2022] DELETE /identity/v3/users/34e5adba6c0d45949b5a04bf3f844f45 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:02.545129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fd41a-aac4-42f9-820d-a798ba65a1bc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:02.545395 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fd41a-aac4-42f9-820d-a798ba65a1bc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:02.545631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fd41a-aac4-42f9-820d-a798ba65a1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:02.587906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d35fd41a-aac4-42f9-820d-a798ba65a1bc None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:02.590380 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d35fd41a-aac4-42f9-820d-a798ba65a1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:02.860199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 902/1774] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:02.905710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fd41a-aac4-42f9-820d-a798ba65a1bc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:02.907736 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d35fd41a-aac4-42f9-820d-a798ba65a1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:02.922394 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4844e65-5a96-455d-baac-db2e551fd243 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:02.939814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:02.980685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:03.080771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b0eaf-ced4-454b-979b-7ecaa5d5ed7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:03.081976 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b0eaf-ced4-454b-979b-7ecaa5d5ed7c service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:03.082263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b0eaf-ced4-454b-979b-7ecaa5d5ed7c service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:03.082545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b0eaf-ced4-454b-979b-7ecaa5d5ed7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:03.085010 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e23b0eaf-ced4-454b-979b-7ecaa5d5ed7c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:03.086135 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fd41a-aac4-42f9-820d-a798ba65a1bc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:03.098009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e20c81-470f-427c-bcaf-8d563c114bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:03.099170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e20c81-470f-427c-bcaf-8d563c114bec service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:03.100311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e20c81-470f-427c-bcaf-8d563c114bec service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:03.100992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e20c81-470f-427c-bcaf-8d563c114bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:03.131770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e20c81-470f-427c-bcaf-8d563c114bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:03.136206 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e20c81-470f-427c-bcaf-8d563c114bec service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:03.175513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 903/1775] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:03.181248 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b0eaf-ced4-454b-979b-7ecaa5d5ed7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:03.188893 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b0eaf-ced4-454b-979b-7ecaa5d5ed7c service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:03.204287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 873/1776] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:37:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 20:37:04.189275 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0ba04-bf4a-4e9f-8128-1a244012bdd6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:04.189874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0ba04-bf4a-4e9f-8128-1a244012bdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:04.190067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0ba04-bf4a-4e9f-8128-1a244012bdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:04.257977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7be0ba04-bf4a-4e9f-8128-1a244012bdd6 None None] MFA Rules not processed for user `633e05f021544b669749f941f40cbf58`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:04.263391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7be0ba04-bf4a-4e9f-8128-1a244012bdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:04.301356 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 904/1777] 10.222.0.64 () {58 vars in 1015 bytes} [Fri Jul 15 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:04.356319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b0eaf-ced4-454b-979b-7ecaa5d5ed7c service swift] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:04.359350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e23b0eaf-ced4-454b-979b-7ecaa5d5ed7c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:04.401975 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b0eaf-ced4-454b-979b-7ecaa5d5ed7c service swift] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:04.447123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e9c49-a9db-44b6-8949-d4127e217274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:04.448846 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e9c49-a9db-44b6-8949-d4127e217274 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:04.449349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e9c49-a9db-44b6-8949-d4127e217274 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:04.449886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e9c49-a9db-44b6-8949-d4127e217274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:04.495053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e9c49-a9db-44b6-8949-d4127e217274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:04.496702 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e9c49-a9db-44b6-8949-d4127e217274 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:04.517607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 874/1778] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:06.382870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0ba04-bf4a-4e9f-8128-1a244012bdd6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:06.384655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7be0ba04-bf4a-4e9f-8128-1a244012bdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:06.410926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0ba04-bf4a-4e9f-8128-1a244012bdd6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:06.423457 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e15fe4-80a5-4528-8f02-1d2e361f1781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:06.424725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e15fe4-80a5-4528-8f02-1d2e361f1781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:06.425162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e15fe4-80a5-4528-8f02-1d2e361f1781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:06.425780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e15fe4-80a5-4528-8f02-1d2e361f1781 admin admin] PATH_INFO: `/v3/users/f6077edcaec94a58a00ee578fcaf056b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:06.427271 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e15fe4-80a5-4528-8f02-1d2e361f1781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6077edcaec94a58a00ee578fcaf056b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:06.429408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e15fe4-80a5-4528-8f02-1d2e361f1781 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:06.525433 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-31e15fe4-80a5-4528-8f02-1d2e361f1781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6077edcaec94a58a00ee578fcaf056b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:06.543634 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-31e15fe4-80a5-4528-8f02-1d2e361f1781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6077edcaec94a58a00ee578fcaf056b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:06.555576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-31e15fe4-80a5-4528-8f02-1d2e361f1781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6077edcaec94a58a00ee578fcaf056b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:06.556587 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-31e15fe4-80a5-4528-8f02-1d2e361f1781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6077edcaec94a58a00ee578fcaf056b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:06.589277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-31e15fe4-80a5-4528-8f02-1d2e361f1781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6077edcaec94a58a00ee578fcaf056b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:06.592563 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e9c49-a9db-44b6-8949-d4127e217274 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:06.594131 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-af8e9c49-a9db-44b6-8949-d4127e217274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:06.603523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 905/1779] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:06 2022] DELETE /identity/v3/users/f6077edcaec94a58a00ee578fcaf056b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:06.605439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5940bd0-1398-4a5e-871f-6ec9b1a4a961 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:06.605894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5940bd0-1398-4a5e-871f-6ec9b1a4a961 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:06.606336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5940bd0-1398-4a5e-871f-6ec9b1a4a961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:06.630821 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c5940bd0-1398-4a5e-871f-6ec9b1a4a961 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:06.632896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c5940bd0-1398-4a5e-871f-6ec9b1a4a961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:06.633613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e9c49-a9db-44b6-8949-d4127e217274 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:06.730699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 906/1780] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:06.765183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5940bd0-1398-4a5e-871f-6ec9b1a4a961 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:06.767513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c5940bd0-1398-4a5e-871f-6ec9b1a4a961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:06.801399 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:06.802450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:06.802800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:06.803140 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] PATH_INFO: `/v3/projects/03afd3915a2c4f1d8b138c1a668293cd` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:06.804460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03afd3915a2c4f1d8b138c1a668293cd)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:06.807652 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:06.827256 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:06.945695 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5940bd0-1398-4a5e-871f-6ec9b1a4a961 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:06.983421 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03afd3915a2c4f1d8b138c1a668293cd', 'request_id': 'req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.000124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:07.014608 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03afd3915a2c4f1d8b138c1a668293cd', 'request_id': 'req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.033565 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03afd3915a2c4f1d8b138c1a668293cd', 'request_id': 'req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.069928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] The token cache is being invalidate because project 03afd3915a2c4f1d8b138c1a668293cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:07.070326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.071472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.078832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 875/1781] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:06 2022] DELETE /identity/v3/projects/03afd3915a2c4f1d8b138c1a668293cd => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:07.080852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:07.082311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:07.085972 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273114a-cbce-43dd-9fe1-4a7f33958e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:07.087153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273114a-cbce-43dd-9fe1-4a7f33958e14 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.088041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273114a-cbce-43dd-9fe1-4a7f33958e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.088748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273114a-cbce-43dd-9fe1-4a7f33958e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.094185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f273114a-cbce-43dd-9fe1-4a7f33958e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:07.180986 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8d8c1-5b2e-481a-ac99-9d2fe4596416 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:07.186906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dbe04-bd45-4dc1-a7c6-49e5cda24aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:07.187988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbe04-bd45-4dc1-a7c6-49e5cda24aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.188619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbe04-bd45-4dc1-a7c6-49e5cda24aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.189005 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbe04-bd45-4dc1-a7c6-49e5cda24aab admin admin] PATH_INFO: `/v3/users/8fc73dba70274ea18f6535682618dc5a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.191182 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dbe04-bd45-4dc1-a7c6-49e5cda24aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc73dba70274ea18f6535682618dc5a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:07.194951 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dbe04-bd45-4dc1-a7c6-49e5cda24aab admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:07.207979 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273114a-cbce-43dd-9fe1-4a7f33958e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:07.209653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273114a-cbce-43dd-9fe1-4a7f33958e14 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:07.229614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 907/1782] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:37:07.239006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a2d28-553b-4619-90a5-4ba29654e2e1 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.239300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a2d28-553b-4619-90a5-4ba29654e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.239644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a2d28-553b-4619-90a5-4ba29654e2e1 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.248476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 908/1783] 10.222.0.66 () {54 vars in 921 bytes} [Fri Jul 15 20:37:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:07.254345 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e7ee-7608-4ae4-bf46-041fa38e61d7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.254632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e7ee-7608-4ae4-bf46-041fa38e61d7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.255034 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e7ee-7608-4ae4-bf46-041fa38e61d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.278925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e27dbe04-bd45-4dc1-a7c6-49e5cda24aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc73dba70274ea18f6535682618dc5a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.295936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e910e7ee-7608-4ae4-bf46-041fa38e61d7 None None] MFA Rules not processed for user `b042da9298894712a0a29787a343bf85`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:07.296918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e27dbe04-bd45-4dc1-a7c6-49e5cda24aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc73dba70274ea18f6535682618dc5a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.297805 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e910e7ee-7608-4ae4-bf46-041fa38e61d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:07.298166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e27dbe04-bd45-4dc1-a7c6-49e5cda24aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc73dba70274ea18f6535682618dc5a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.309370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e27dbe04-bd45-4dc1-a7c6-49e5cda24aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc73dba70274ea18f6535682618dc5a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.310531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e27dbe04-bd45-4dc1-a7c6-49e5cda24aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc73dba70274ea18f6535682618dc5a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.339091 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 876/1784] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:07 2022] DELETE /identity/v3/users/8fc73dba70274ea18f6535682618dc5a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:07.392107 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 909/1785] 10.222.0.66 () {58 vars in 1018 bytes} [Fri Jul 15 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:07.414535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dbe04-bd45-4dc1-a7c6-49e5cda24aab admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:07.417628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e27dbe04-bd45-4dc1-a7c6-49e5cda24aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:07.517316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:07.550477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dbe04-bd45-4dc1-a7c6-49e5cda24aab admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:07.556188 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7efec1-f665-4255-844c-44dec8bc7474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:07.557095 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7efec1-f665-4255-844c-44dec8bc7474 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.557285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7efec1-f665-4255-844c-44dec8bc7474 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.557629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7efec1-f665-4255-844c-44dec8bc7474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.567080 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7efec1-f665-4255-844c-44dec8bc7474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:07.568856 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7efec1-f665-4255-844c-44dec8bc7474 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:07.579783 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 877/1786] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:07.637229 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910e7ee-7608-4ae4-bf46-041fa38e61d7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:07.638891 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e910e7ee-7608-4ae4-bf46-041fa38e61d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:07.657065 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910e7ee-7608-4ae4-bf46-041fa38e61d7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:07.674358 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:07.723516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:07.724822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.725109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.725391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] PATH_INFO: `/v3/projects/638ab2d441f24ac9b70eb087d94617f2` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.726637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=638ab2d441f24ac9b70eb087d94617f2)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:07.728702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:07.785697 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638ab2d441f24ac9b70eb087d94617f2', 'request_id': 'req-d9cc3f01-cad4-40f6-b0de-11d25362db77'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.796655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638ab2d441f24ac9b70eb087d94617f2', 'request_id': 'req-d9cc3f01-cad4-40f6-b0de-11d25362db77'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.797604 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7efec1-f665-4255-844c-44dec8bc7474 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:07.801274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1e7efec1-f665-4255-844c-44dec8bc7474 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:07.818826 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638ab2d441f24ac9b70eb087d94617f2', 'request_id': 'req-d9cc3f01-cad4-40f6-b0de-11d25362db77'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.821516 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7efec1-f665-4255-844c-44dec8bc7474 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:07.841805 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] The token cache is being invalidate because project 638ab2d441f24ac9b70eb087d94617f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:07.842098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.842796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.844385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 910/1787] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:07 2022] DELETE /identity/v3/projects/638ab2d441f24ac9b70eb087d94617f2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:07.848683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:07.850064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:07.887263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3f151-365d-4516-8a86-d5e3463effe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:07.888215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3f151-365d-4516-8a86-d5e3463effe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.888529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3f151-365d-4516-8a86-d5e3463effe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.888812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3f151-365d-4516-8a86-d5e3463effe5 admin admin] PATH_INFO: `/v3/projects/f935583c899142dda4446f97e1415b10` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.890012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3f151-365d-4516-8a86-d5e3463effe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f935583c899142dda4446f97e1415b10)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:07.891941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3f151-365d-4516-8a86-d5e3463effe5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:07.915369 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc3f01-cad4-40f6-b0de-11d25362db77 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:07.920320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbfcc4-0d77-4f2c-b030-d6187ef4c2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:07.921218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbfcc4-0d77-4f2c-b030-d6187ef4c2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.921509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbfcc4-0d77-4f2c-b030-d6187ef4c2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.921799 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbfcc4-0d77-4f2c-b030-d6187ef4c2c8 admin admin] PATH_INFO: `/v3/users/ce33eaa896dc48f58e264b300bb1451b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.923036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbfcc4-0d77-4f2c-b030-d6187ef4c2c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce33eaa896dc48f58e264b300bb1451b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:07.925636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbfcc4-0d77-4f2c-b030-d6187ef4c2c8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:07.941082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-76f3f151-365d-4516-8a86-d5e3463effe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f935583c899142dda4446f97e1415b10', 'request_id': 'req-76f3f151-365d-4516-8a86-d5e3463effe5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.950511 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-76f3f151-365d-4516-8a86-d5e3463effe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f935583c899142dda4446f97e1415b10', 'request_id': 'req-76f3f151-365d-4516-8a86-d5e3463effe5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.958502 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-76f3f151-365d-4516-8a86-d5e3463effe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f935583c899142dda4446f97e1415b10', 'request_id': 'req-76f3f151-365d-4516-8a86-d5e3463effe5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.973255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-76f3f151-365d-4516-8a86-d5e3463effe5 admin admin] The token cache is being invalidate because project f935583c899142dda4446f97e1415b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:07.973456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-76f3f151-365d-4516-8a86-d5e3463effe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.974024 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-76f3f151-365d-4516-8a86-d5e3463effe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.975823 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 878/1788] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:07 2022] DELETE /identity/v3/projects/f935583c899142dda4446f97e1415b10 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:07.982241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-94fbfcc4-0d77-4f2c-b030-d6187ef4c2c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce33eaa896dc48f58e264b300bb1451b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:07.984575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59824a95-69fe-4970-bbde-9c8d8ecec48d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:07.984879 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59824a95-69fe-4970-bbde-9c8d8ecec48d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:07.985863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59824a95-69fe-4970-bbde-9c8d8ecec48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:07.989119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:07.995216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-94fbfcc4-0d77-4f2c-b030-d6187ef4c2c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce33eaa896dc48f58e264b300bb1451b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:08.012128 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-59824a95-69fe-4970-bbde-9c8d8ecec48d None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:08.012938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-94fbfcc4-0d77-4f2c-b030-d6187ef4c2c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce33eaa896dc48f58e264b300bb1451b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:08.013272 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-59824a95-69fe-4970-bbde-9c8d8ecec48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:08.014607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-94fbfcc4-0d77-4f2c-b030-d6187ef4c2c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce33eaa896dc48f58e264b300bb1451b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:08.035115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-94fbfcc4-0d77-4f2c-b030-d6187ef4c2c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce33eaa896dc48f58e264b300bb1451b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:08.045856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 911/1789] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:07 2022] DELETE /identity/v3/users/ce33eaa896dc48f58e264b300bb1451b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:08.093252 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 879/1790] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:08.102228 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665db7-3ee1-4de0-8071-613a0354686c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.102410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665db7-3ee1-4de0-8071-613a0354686c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.102667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665db7-3ee1-4de0-8071-613a0354686c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.122290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-36665db7-3ee1-4de0-8071-613a0354686c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:08.123579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-36665db7-3ee1-4de0-8071-613a0354686c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:08.232784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 912/1791] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:08.237139 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59824a95-69fe-4970-bbde-9c8d8ecec48d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:08.273391 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59824a95-69fe-4970-bbde-9c8d8ecec48d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:08.287861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b7702-6137-435c-9c61-41a2ea077396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:08.287861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b7702-6137-435c-9c61-41a2ea077396 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.289237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b7702-6137-435c-9c61-41a2ea077396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.289541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b7702-6137-435c-9c61-41a2ea077396 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.290308 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b7702-6137-435c-9c61-41a2ea077396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:08.290625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b7702-6137-435c-9c61-41a2ea077396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:08.292552 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b7702-6137-435c-9c61-41a2ea077396 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:08.321341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 880/1792] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:08.322523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36665db7-3ee1-4de0-8071-613a0354686c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:08.333722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36665db7-3ee1-4de0-8071-613a0354686c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:08.338559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb70dc-1a9c-4532-83cf-8f82307a50f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:08.339235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb70dc-1a9c-4532-83cf-8f82307a50f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.339517 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb70dc-1a9c-4532-83cf-8f82307a50f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.339794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb70dc-1a9c-4532-83cf-8f82307a50f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.340517 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb70dc-1a9c-4532-83cf-8f82307a50f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:08.342481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb70dc-1a9c-4532-83cf-8f82307a50f3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:08.392433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b7702-6137-435c-9c61-41a2ea077396 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:08.392664 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 913/1793] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:08 2022] POST /identity/v3/projects => generated 391 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:08.400983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:08.408295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b7702-6137-435c-9c61-41a2ea077396 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:08.502010 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e35cf0-3cb1-4d92-a1e1-265e5a891a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:08.502792 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e35cf0-3cb1-4d92-a1e1-265e5a891a67 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.503076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e35cf0-3cb1-4d92-a1e1-265e5a891a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.503360 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e35cf0-3cb1-4d92-a1e1-265e5a891a67 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.504053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e35cf0-3cb1-4d92-a1e1-265e5a891a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:08.506406 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e35cf0-3cb1-4d92-a1e1-265e5a891a67 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:08.535484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 881/1794] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:08 2022] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:08.541094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb70dc-1a9c-4532-83cf-8f82307a50f3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:08.559367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb70dc-1a9c-4532-83cf-8f82307a50f3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:08.564876 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f6f8-0dc9-4dd7-8ecb-9fc17b391989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:08.566426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f6f8-0dc9-4dd7-8ecb-9fc17b391989 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.566785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f6f8-0dc9-4dd7-8ecb-9fc17b391989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.567149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f6f8-0dc9-4dd7-8ecb-9fc17b391989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.567982 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19f6f8-0dc9-4dd7-8ecb-9fc17b391989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:08.569764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19f6f8-0dc9-4dd7-8ecb-9fc17b391989 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:08.584928 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 914/1795] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:08.586972 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e35cf0-3cb1-4d92-a1e1-265e5a891a67 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:08.612186 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e35cf0-3cb1-4d92-a1e1-265e5a891a67 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:08.614710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f6f8-0dc9-4dd7-8ecb-9fc17b391989 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:08.616868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5b19f6f8-0dc9-4dd7-8ecb-9fc17b391989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:08.618965 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76d946-6b12-4a97-8827-066a3ea3de4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:08.620115 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76d946-6b12-4a97-8827-066a3ea3de4a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.620351 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76d946-6b12-4a97-8827-066a3ea3de4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.620801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76d946-6b12-4a97-8827-066a3ea3de4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.621789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76d946-6b12-4a97-8827-066a3ea3de4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:08.624407 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76d946-6b12-4a97-8827-066a3ea3de4a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:08.646433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 882/1796] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:08.652039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76d946-6b12-4a97-8827-066a3ea3de4a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:08.664593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76d946-6b12-4a97-8827-066a3ea3de4a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:08.664959 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f6f8-0dc9-4dd7-8ecb-9fc17b391989 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:08.673601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779050de-bfa4-4a64-a6a6-2f56ebbbb2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:08.678221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779050de-bfa4-4a64-a6a6-2f56ebbbb2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.679073 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779050de-bfa4-4a64-a6a6-2f56ebbbb2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.682797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d505a-56ed-4647-be54-45cf8b79a474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:08.684023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d505a-56ed-4647-be54-45cf8b79a474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.684323 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d505a-56ed-4647-be54-45cf8b79a474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.684775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d505a-56ed-4647-be54-45cf8b79a474 admin admin] PATH_INFO: `/v3/projects/27afaf2db12c4adbab18544b04c49d00` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.686658 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779050de-bfa4-4a64-a6a6-2f56ebbbb2d1 admin admin] PATH_INFO: `/v3/projects/4501a21c4d8847f39addaf603e4f06ee/users/f52ad70dfb994f7bb6b1ea534a78a1b1/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.692526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d505a-56ed-4647-be54-45cf8b79a474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27afaf2db12c4adbab18544b04c49d00)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:08.697114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d505a-56ed-4647-be54-45cf8b79a474 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:08.733998 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779050de-bfa4-4a64-a6a6-2f56ebbbb2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4501a21c4d8847f39addaf603e4f06ee, user_id=f52ad70dfb994f7bb6b1ea534a78a1b1, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:08.739262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779050de-bfa4-4a64-a6a6-2f56ebbbb2d1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:08.769915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 883/1797] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:08 2022] PUT /identity/v3/projects/4501a21c4d8847f39addaf603e4f06ee/users/f52ad70dfb994f7bb6b1ea534a78a1b1/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:08.790267 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20493c5b-2dbc-4012-8e37-deb2be88f4b6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.790478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20493c5b-2dbc-4012-8e37-deb2be88f4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.790804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20493c5b-2dbc-4012-8e37-deb2be88f4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.841507 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b06d505a-56ed-4647-be54-45cf8b79a474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27afaf2db12c4adbab18544b04c49d00', 'request_id': 'req-b06d505a-56ed-4647-be54-45cf8b79a474'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:08.845134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b06d505a-56ed-4647-be54-45cf8b79a474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27afaf2db12c4adbab18544b04c49d00', 'request_id': 'req-b06d505a-56ed-4647-be54-45cf8b79a474'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:08.848289 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-20493c5b-2dbc-4012-8e37-deb2be88f4b6 None None] MFA Rules not processed for user `f52ad70dfb994f7bb6b1ea534a78a1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:08.850185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-20493c5b-2dbc-4012-8e37-deb2be88f4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:08.863448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b06d505a-56ed-4647-be54-45cf8b79a474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27afaf2db12c4adbab18544b04c49d00', 'request_id': 'req-b06d505a-56ed-4647-be54-45cf8b79a474'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:08.890093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b06d505a-56ed-4647-be54-45cf8b79a474 admin admin] The token cache is being invalidate because project 27afaf2db12c4adbab18544b04c49d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:08.891028 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b06d505a-56ed-4647-be54-45cf8b79a474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:08.892312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b06d505a-56ed-4647-be54-45cf8b79a474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:08.903845 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 915/1798] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:08 2022] DELETE /identity/v3/projects/27afaf2db12c4adbab18544b04c49d00 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:08.905775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e74190-87b8-428c-89a1-1ec700f797d8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:08.906260 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e74190-87b8-428c-89a1-1ec700f797d8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:08.906697 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e74190-87b8-428c-89a1-1ec700f797d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:08.939707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b5e74190-87b8-428c-89a1-1ec700f797d8 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:08.944374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b5e74190-87b8-428c-89a1-1ec700f797d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:08.963883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:08.983841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 884/1799] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:08.989346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20493c5b-2dbc-4012-8e37-deb2be88f4b6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:08.990955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-20493c5b-2dbc-4012-8e37-deb2be88f4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:09.097773 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:09.115653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 916/1800] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:09.125589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99253-4e61-4c9d-af46-2e4673141992 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.125915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99253-4e61-4c9d-af46-2e4673141992 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.126266 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99253-4e61-4c9d-af46-2e4673141992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.152417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20493c5b-2dbc-4012-8e37-deb2be88f4b6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:09.153387 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d02ce-99f9-4597-9939-3518a1ed13fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:09.154540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d02ce-99f9-4597-9939-3518a1ed13fa admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.154898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d02ce-99f9-4597-9939-3518a1ed13fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.155568 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d02ce-99f9-4597-9939-3518a1ed13fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.156340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d02ce-99f9-4597-9939-3518a1ed13fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:09.159969 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d02ce-99f9-4597-9939-3518a1ed13fa admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:09.177837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ebd99253-4e61-4c9d-af46-2e4673141992 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:09.179096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ebd99253-4e61-4c9d-af46-2e4673141992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:09.190896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 917/1801] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:09.198152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd99253-4e61-4c9d-af46-2e4673141992 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:09.211567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd99253-4e61-4c9d-af46-2e4673141992 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:09.220651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 885/1802] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:08 2022] POST /identity/v3/projects => generated 393 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:09.225085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d02ce-99f9-4597-9939-3518a1ed13fa admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:09.226567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f08583-c751-4169-8653-05f028b97561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:09.227531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f08583-c751-4169-8653-05f028b97561 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.227832 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f08583-c751-4169-8653-05f028b97561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.228172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f08583-c751-4169-8653-05f028b97561 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.228953 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f08583-c751-4169-8653-05f028b97561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:09.229268 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f08583-c751-4169-8653-05f028b97561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:09.233740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f08583-c751-4169-8653-05f028b97561 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:09.270367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 918/1803] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:09.271348 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f08583-c751-4169-8653-05f028b97561 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:09.282992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f08583-c751-4169-8653-05f028b97561 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:09.390751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d02ce-99f9-4597-9939-3518a1ed13fa admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:09.405748 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ce783-c9e5-4cb2-9c4c-1241fc4e7f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:09.406823 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ce783-c9e5-4cb2-9c4c-1241fc4e7f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.407195 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ce783-c9e5-4cb2-9c4c-1241fc4e7f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.409932 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ce783-c9e5-4cb2-9c4c-1241fc4e7f3c admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.413384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ce783-c9e5-4cb2-9c4c-1241fc4e7f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:09.417777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ce783-c9e5-4cb2-9c4c-1241fc4e7f3c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:09.459167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096968f1-0776-4d36-a047-e0d7eb72d10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:09.462606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096968f1-0776-4d36-a047-e0d7eb72d10a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.462921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096968f1-0776-4d36-a047-e0d7eb72d10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.464678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096968f1-0776-4d36-a047-e0d7eb72d10a admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.465267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096968f1-0776-4d36-a047-e0d7eb72d10a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:09.468176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096968f1-0776-4d36-a047-e0d7eb72d10a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:09.499644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 886/1804] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:09 2022] POST /identity/v3/users => generated 303 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:09.504712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ce783-c9e5-4cb2-9c4c-1241fc4e7f3c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:09.557914 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ce783-c9e5-4cb2-9c4c-1241fc4e7f3c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:09.559027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 919/1805] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:09 2022] POST /identity/v3/projects => generated 381 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:09.564661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096968f1-0776-4d36-a047-e0d7eb72d10a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:09.649966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096968f1-0776-4d36-a047-e0d7eb72d10a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:09.665302 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b532730-1510-46ac-91e5-e4d41b79c45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:09.667573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b532730-1510-46ac-91e5-e4d41b79c45e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.669491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b532730-1510-46ac-91e5-e4d41b79c45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.669821 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b532730-1510-46ac-91e5-e4d41b79c45e admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.672866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b532730-1510-46ac-91e5-e4d41b79c45e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:09.692263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b532730-1510-46ac-91e5-e4d41b79c45e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:09.735856 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c8652-eb4a-489a-b4d9-12dbe915b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:09.737493 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c8652-eb4a-489a-b4d9-12dbe915b24e admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.741752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c8652-eb4a-489a-b4d9-12dbe915b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.741752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c8652-eb4a-489a-b4d9-12dbe915b24e admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.747971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 920/1806] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:09 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:09.755800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c8652-eb4a-489a-b4d9-12dbe915b24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:09.759287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b532730-1510-46ac-91e5-e4d41b79c45e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:09.774705 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c8652-eb4a-489a-b4d9-12dbe915b24e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:09.813113 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b532730-1510-46ac-91e5-e4d41b79c45e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:09.815906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 887/1807] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:09.820625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c8652-eb4a-489a-b4d9-12dbe915b24e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:09.836683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837c781-776c-4b66-b6f6-e415054ce17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:09.837497 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837c781-776c-4b66-b6f6-e415054ce17f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.838110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837c781-776c-4b66-b6f6-e415054ce17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.838386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837c781-776c-4b66-b6f6-e415054ce17f admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.839149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837c781-776c-4b66-b6f6-e415054ce17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:09.864031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837c781-776c-4b66-b6f6-e415054ce17f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:09.893825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c8652-eb4a-489a-b4d9-12dbe915b24e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:09.917769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a4fe1-db88-4029-9661-1cfb61c4b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:09.925567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 921/1808] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:09.926622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a4fe1-db88-4029-9661-1cfb61c4b703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.927083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a4fe1-db88-4029-9661-1cfb61c4b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.927531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a4fe1-db88-4029-9661-1cfb61c4b703 admin admin] PATH_INFO: `/v3/projects/5a6f184719a7428a8f31e2b2aaed1ceb/users/221f091ceaf241fe8384547f70fc479d/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.929729 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837c781-776c-4b66-b6f6-e415054ce17f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:09.951637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:09.968007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837c781-776c-4b66-b6f6-e415054ce17f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:09.985531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a4fe1-db88-4029-9661-1cfb61c4b703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6f184719a7428a8f31e2b2aaed1ceb, user_id=221f091ceaf241fe8384547f70fc479d, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:09.990910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a4fe1-db88-4029-9661-1cfb61c4b703 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:09.994262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf0ee8-d636-4d63-951b-47971db933cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:09.995218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf0ee8-d636-4d63-951b-47971db933cd admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:09.995611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf0ee8-d636-4d63-951b-47971db933cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:09.996041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf0ee8-d636-4d63-951b-47971db933cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:09.996859 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf0ee8-d636-4d63-951b-47971db933cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:09.998579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf0ee8-d636-4d63-951b-47971db933cd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:10.030813 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 922/1810] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:10.031016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 888/1810] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:09 2022] PUT /identity/v3/projects/5a6f184719a7428a8f31e2b2aaed1ceb/users/221f091ceaf241fe8384547f70fc479d/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:10.031606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf0ee8-d636-4d63-951b-47971db933cd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.036518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a4fe1-db88-4029-9661-1cfb61c4b703 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.069538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf0ee8-d636-4d63-951b-47971db933cd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:10.156973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:10.219932 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a4fe1-db88-4029-9661-1cfb61c4b703 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:10.244157 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df6568-0ae9-4270-b0f3-02bc7f5325ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:10.246980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df6568-0ae9-4270-b0f3-02bc7f5325ce admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.248554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df6568-0ae9-4270-b0f3-02bc7f5325ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.249246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df6568-0ae9-4270-b0f3-02bc7f5325ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.250258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df6568-0ae9-4270-b0f3-02bc7f5325ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:10.252190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df6568-0ae9-4270-b0f3-02bc7f5325ce admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:10.260082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7199ede-7898-43e0-b157-b65bf413c26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:10.261122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7199ede-7898-43e0-b157-b65bf413c26f admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.261761 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7199ede-7898-43e0-b157-b65bf413c26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.262014 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7199ede-7898-43e0-b157-b65bf413c26f admin admin] PATH_INFO: `/v3/projects/56a3d731273f468d84e4e14bac46f81f/users/63483303b34b432e82788650774d0db8/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.275292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 923/1811] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:10.276241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df6568-0ae9-4270-b0f3-02bc7f5325ce admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.289389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df6568-0ae9-4270-b0f3-02bc7f5325ce admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:10.303624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7199ede-7898-43e0-b157-b65bf413c26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a3d731273f468d84e4e14bac46f81f, user_id=63483303b34b432e82788650774d0db8, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:10.308011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7199ede-7898-43e0-b157-b65bf413c26f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:10.310073 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464694f7-884b-4c33-90ba-bee7e95982ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:10.311126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464694f7-884b-4c33-90ba-bee7e95982ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.311522 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464694f7-884b-4c33-90ba-bee7e95982ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.311898 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464694f7-884b-4c33-90ba-bee7e95982ce admin admin] PATH_INFO: `/v3/projects/5a6f184719a7428a8f31e2b2aaed1ceb/users/221f091ceaf241fe8384547f70fc479d/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.321902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464694f7-884b-4c33-90ba-bee7e95982ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6f184719a7428a8f31e2b2aaed1ceb, user_id=221f091ceaf241fe8384547f70fc479d, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:10.328418 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464694f7-884b-4c33-90ba-bee7e95982ce admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:10.338005 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 889/1812] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:10 2022] PUT /identity/v3/projects/56a3d731273f468d84e4e14bac46f81f/users/63483303b34b432e82788650774d0db8/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:10.350407 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d9a96-80ca-46bf-819e-e932740f2a81 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.350703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d9a96-80ca-46bf-819e-e932740f2a81 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.351033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d9a96-80ca-46bf-819e-e932740f2a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.368696 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 924/1813] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:10 2022] PUT /identity/v3/projects/5a6f184719a7428a8f31e2b2aaed1ceb/users/221f091ceaf241fe8384547f70fc479d/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:10.386693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851c00a-6a69-4401-b089-d8fb27b31603 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.387067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851c00a-6a69-4401-b089-d8fb27b31603 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.399633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851c00a-6a69-4401-b089-d8fb27b31603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.421087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4b3d9a96-80ca-46bf-819e-e932740f2a81 None None] MFA Rules not processed for user `63483303b34b432e82788650774d0db8`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:10.425558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4b3d9a96-80ca-46bf-819e-e932740f2a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:10.454746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5851c00a-6a69-4401-b089-d8fb27b31603 None None] MFA Rules not processed for user `221f091ceaf241fe8384547f70fc479d`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:10.456755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5851c00a-6a69-4401-b089-d8fb27b31603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:10.618361 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 890/1814] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:10.620629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d9a96-80ca-46bf-819e-e932740f2a81 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.658172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 925/1815] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:10.673307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851c00a-6a69-4401-b089-d8fb27b31603 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.675427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5851c00a-6a69-4401-b089-d8fb27b31603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:10.803604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851c00a-6a69-4401-b089-d8fb27b31603 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:10.825915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d9a96-80ca-46bf-819e-e932740f2a81 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:10.828989 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620f27d-f46f-4bbd-a676-c2bd50b0db58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:10.830243 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620f27d-f46f-4bbd-a676-c2bd50b0db58 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.831510 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620f27d-f46f-4bbd-a676-c2bd50b0db58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.832129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620f27d-f46f-4bbd-a676-c2bd50b0db58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.845176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a319d4f-ed66-463e-b490-966cf88af135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:10.846347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a319d4f-ed66-463e-b490-966cf88af135 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:10.847760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a319d4f-ed66-463e-b490-966cf88af135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:10.848960 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a319d4f-ed66-463e-b490-966cf88af135 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:10.849885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a319d4f-ed66-463e-b490-966cf88af135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:10.854434 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a319d4f-ed66-463e-b490-966cf88af135 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:10.866252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620f27d-f46f-4bbd-a676-c2bd50b0db58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:10.867765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620f27d-f46f-4bbd-a676-c2bd50b0db58 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:10.904883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 926/1816] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:10.922544 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 891/1817] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:10 2022] POST /identity/v3/projects => generated 381 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:10.927477 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620f27d-f46f-4bbd-a676-c2bd50b0db58 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:10.943509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:10.977771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620f27d-f46f-4bbd-a676-c2bd50b0db58 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:11.198238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a319d4f-ed66-463e-b490-966cf88af135 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:11.200011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9a319d4f-ed66-463e-b490-966cf88af135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:11.288684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:11.296280 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37019c-342f-48d9-97a3-5bc76cdc4d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:11.298351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37019c-342f-48d9-97a3-5bc76cdc4d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:11.299339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37019c-342f-48d9-97a3-5bc76cdc4d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:11.300304 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37019c-342f-48d9-97a3-5bc76cdc4d45 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:11.301256 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37019c-342f-48d9-97a3-5bc76cdc4d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:11.304727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37019c-342f-48d9-97a3-5bc76cdc4d45 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:11.342608 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a319d4f-ed66-463e-b490-966cf88af135 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:11.354364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b62068-9a7c-4778-befd-4f63b060e69e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:11.355046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b62068-9a7c-4778-befd-4f63b060e69e service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:11.356573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b62068-9a7c-4778-befd-4f63b060e69e service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:11.356863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b62068-9a7c-4778-befd-4f63b060e69e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:11.361257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 927/1818] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:10 2022] POST /identity/v3/users => generated 297 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:11.362542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37019c-342f-48d9-97a3-5bc76cdc4d45 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:11.387571 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37019c-342f-48d9-97a3-5bc76cdc4d45 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:11.396251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b470b-cdbb-42bd-8b3d-9c86d755dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:11.400007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b470b-cdbb-42bd-8b3d-9c86d755dd97 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:11.400466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b470b-cdbb-42bd-8b3d-9c86d755dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:11.400852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b470b-cdbb-42bd-8b3d-9c86d755dd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:11.405420 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b470b-cdbb-42bd-8b3d-9c86d755dd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:11.408056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b470b-cdbb-42bd-8b3d-9c86d755dd97 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:11.447489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 928/1819] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:11.453082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b470b-cdbb-42bd-8b3d-9c86d755dd97 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:11.488894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b470b-cdbb-42bd-8b3d-9c86d755dd97 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:11.518157 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b5b1d-7d58-4509-b1d3-5fba80cc3b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:11.522000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5b1d-7d58-4509-b1d3-5fba80cc3b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:11.522938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5b1d-7d58-4509-b1d3-5fba80cc3b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:11.524119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5b1d-7d58-4509-b1d3-5fba80cc3b68 admin admin] PATH_INFO: `/v3/projects/f8c91774448144c58606f2004fa729b1/users/ca519bf4309140f1a820b255275d21e1/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:11.539038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b62068-9a7c-4778-befd-4f63b060e69e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:11.541751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b62068-9a7c-4778-befd-4f63b060e69e service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:11.582262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 892/1820] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:37:11.605704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b5b1d-7d58-4509-b1d3-5fba80cc3b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c91774448144c58606f2004fa729b1, user_id=ca519bf4309140f1a820b255275d21e1, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:11.611948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b5b1d-7d58-4509-b1d3-5fba80cc3b68 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:11.655687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 929/1821] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:11 2022] PUT /identity/v3/projects/f8c91774448144c58606f2004fa729b1/users/ca519bf4309140f1a820b255275d21e1/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:11.657184 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b62068-9a7c-4778-befd-4f63b060e69e service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:11.677940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b62068-9a7c-4778-befd-4f63b060e69e service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:11.916245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fe463-4a36-4629-8553-334470655410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:11.922673 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe463-4a36-4629-8553-334470655410 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:11.925432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe463-4a36-4629-8553-334470655410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:11.926871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe463-4a36-4629-8553-334470655410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:11.934136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fe463-4a36-4629-8553-334470655410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:11.936086 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fe463-4a36-4629-8553-334470655410 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:11.963150 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 893/1822] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:11.967710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b5b1d-7d58-4509-b1d3-5fba80cc3b68 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:11.984426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b5b1d-7d58-4509-b1d3-5fba80cc3b68 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:11.998617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb52e2-21e8-48d7-ba54-4b4c59560a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:12.000958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb52e2-21e8-48d7-ba54-4b4c59560a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:12.002673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb52e2-21e8-48d7-ba54-4b4c59560a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:12.004493 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb52e2-21e8-48d7-ba54-4b4c59560a13 admin admin] PATH_INFO: `/v3/projects/f8c91774448144c58606f2004fa729b1/users/ca519bf4309140f1a820b255275d21e1/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:12.022836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb52e2-21e8-48d7-ba54-4b4c59560a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c91774448144c58606f2004fa729b1, user_id=ca519bf4309140f1a820b255275d21e1, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:12.025865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb52e2-21e8-48d7-ba54-4b4c59560a13 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:12.083498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 930/1823] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:11 2022] PUT /identity/v3/projects/f8c91774448144c58606f2004fa729b1/users/ca519bf4309140f1a820b255275d21e1/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:12.089471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e9a2-464b-4be5-9bed-225666c6ff40 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:12.089962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e9a2-464b-4be5-9bed-225666c6ff40 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:12.090073 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e9a2-464b-4be5-9bed-225666c6ff40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:12.173856 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-03a5e9a2-464b-4be5-9bed-225666c6ff40 None None] MFA Rules not processed for user `ca519bf4309140f1a820b255275d21e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:12.175981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-03a5e9a2-464b-4be5-9bed-225666c6ff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:12.372655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 894/1824] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:12.563243 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb52e2-21e8-48d7-ba54-4b4c59560a13 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:12.698527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb52e2-21e8-48d7-ba54-4b4c59560a13 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:12.705686 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30bd61-c690-4889-b48d-49e0d3e2f6c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:12.707061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30bd61-c690-4889-b48d-49e0d3e2f6c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:12.707513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30bd61-c690-4889-b48d-49e0d3e2f6c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:12.708003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30bd61-c690-4889-b48d-49e0d3e2f6c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:12.758650 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30bd61-c690-4889-b48d-49e0d3e2f6c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:12.758650 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30bd61-c690-4889-b48d-49e0d3e2f6c7 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:12.818915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 931/1825] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:13.219445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fc57b-c5cf-478d-ba5e-c3bb5efd84d5 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.220043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fc57b-c5cf-478d-ba5e-c3bb5efd84d5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.220043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fc57b-c5cf-478d-ba5e-c3bb5efd84d5 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.223200 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 895/1826] 10.222.0.66 () {54 vars in 921 bytes} [Fri Jul 15 20:37:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:13.287715 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3a79a-82d3-48fd-b5c1-faa271a6ea3a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.292610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3a79a-82d3-48fd-b5c1-faa271a6ea3a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.293654 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3a79a-82d3-48fd-b5c1-faa271a6ea3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.389261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ecd3a79a-82d3-48fd-b5c1-faa271a6ea3a None None] MFA Rules not processed for user `b042da9298894712a0a29787a343bf85`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:13.397099 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ecd3a79a-82d3-48fd-b5c1-faa271a6ea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:13.487230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:13.593936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 932/1827] 10.222.0.66 () {58 vars in 1018 bytes} [Fri Jul 15 20:37:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:13.802378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fc57b-c5cf-478d-ba5e-c3bb5efd84d5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:13.805258 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-163fc57b-c5cf-478d-ba5e-c3bb5efd84d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:13.902765 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fc57b-c5cf-478d-ba5e-c3bb5efd84d5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:13.921580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c78e9-84fc-41e4-b8a7-04d8a837e6be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:13.923171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c78e9-84fc-41e4-b8a7-04d8a837e6be service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:13.923727 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c78e9-84fc-41e4-b8a7-04d8a837e6be service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:13.924102 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c78e9-84fc-41e4-b8a7-04d8a837e6be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:13.946995 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:13.969147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c78e9-84fc-41e4-b8a7-04d8a837e6be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:13.969147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c78e9-84fc-41e4-b8a7-04d8a837e6be service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:14.006529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 896/1828] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:14.064880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3a79a-82d3-48fd-b5c1-faa271a6ea3a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:14.068708 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ecd3a79a-82d3-48fd-b5c1-faa271a6ea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:14.284283 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3a79a-82d3-48fd-b5c1-faa271a6ea3a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:14.309325 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5eddb4-654c-4de4-b908-1d8e41ad2229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:14.311962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eddb4-654c-4de4-b908-1d8e41ad2229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:14.313953 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eddb4-654c-4de4-b908-1d8e41ad2229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:14.319304 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eddb4-654c-4de4-b908-1d8e41ad2229 admin admin] PATH_INFO: `/v3/users/a14994f49f6c44cf9786068f95333d39` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:14.320663 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5eddb4-654c-4de4-b908-1d8e41ad2229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14994f49f6c44cf9786068f95333d39)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:14.323306 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5eddb4-654c-4de4-b908-1d8e41ad2229 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:14.507495 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1a5eddb4-654c-4de4-b908-1d8e41ad2229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14994f49f6c44cf9786068f95333d39'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:14.523747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1a5eddb4-654c-4de4-b908-1d8e41ad2229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14994f49f6c44cf9786068f95333d39'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:14.550803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1a5eddb4-654c-4de4-b908-1d8e41ad2229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14994f49f6c44cf9786068f95333d39'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:14.552979 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1a5eddb4-654c-4de4-b908-1d8e41ad2229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14994f49f6c44cf9786068f95333d39'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:14.593272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1a5eddb4-654c-4de4-b908-1d8e41ad2229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14994f49f6c44cf9786068f95333d39'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:14.604113 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 933/1829] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:14 2022] DELETE /identity/v3/users/a14994f49f6c44cf9786068f95333d39 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:14.609373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4935950-7b79-4489-acd5-69099783f276 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:14.609930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4935950-7b79-4489-acd5-69099783f276 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:14.609930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4935950-7b79-4489-acd5-69099783f276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:14.651991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a4935950-7b79-4489-acd5-69099783f276 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:14.662853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5eddb4-654c-4de4-b908-1d8e41ad2229 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:14.664499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1a5eddb4-654c-4de4-b908-1d8e41ad2229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:14.666237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a4935950-7b79-4489-acd5-69099783f276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:14.867104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:14.878851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 897/1830] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:14.881030 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5eddb4-654c-4de4-b908-1d8e41ad2229 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:14.887232 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4935950-7b79-4489-acd5-69099783f276 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:14.890964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a4935950-7b79-4489-acd5-69099783f276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:14.897511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f83d4-1c73-4a9b-a334-60e314772967 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca519bf4309140f1a820b255275d21e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c91774448144c58606f2004fa729b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:14.898282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f83d4-1c73-4a9b-a334-60e314772967 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:14.898620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f83d4-1c73-4a9b-a334-60e314772967 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:14.898906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f83d4-1c73-4a9b-a334-60e314772967 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:14.903160 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f83d4-1c73-4a9b-a334-60e314772967 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:14.903488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f83d4-1c73-4a9b-a334-60e314772967 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:14.906403 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f83d4-1c73-4a9b-a334-60e314772967 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:14.939323 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 934/1831] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:14.955435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f83d4-1c73-4a9b-a334-60e314772967 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:14.981025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f83d4-1c73-4a9b-a334-60e314772967 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:14.998999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bf635-730b-4a40-a875-6327f422dbf4 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca519bf4309140f1a820b255275d21e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c91774448144c58606f2004fa729b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:14.999694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bf635-730b-4a40-a875-6327f422dbf4 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:14.999989 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bf635-730b-4a40-a875-6327f422dbf4 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:15.000266 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bf635-730b-4a40-a875-6327f422dbf4 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:15.001010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bf635-730b-4a40-a875-6327f422dbf4 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:15.010001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bf635-730b-4a40-a875-6327f422dbf4 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:15.037533 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4935950-7b79-4489-acd5-69099783f276 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:15.046039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b327c-8c1e-4496-afd2-fda2b5c9cf73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:15.046719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b327c-8c1e-4496-afd2-fda2b5c9cf73 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:15.047011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b327c-8c1e-4496-afd2-fda2b5c9cf73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:15.047298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b327c-8c1e-4496-afd2-fda2b5c9cf73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:15.069962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b327c-8c1e-4496-afd2-fda2b5c9cf73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:15.071457 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b327c-8c1e-4496-afd2-fda2b5c9cf73 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:15.085359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 898/1832] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:15.106156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 935/1833] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:14 2022] POST /identity/v3/projects => generated 353 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:15.107053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b327c-8c1e-4496-afd2-fda2b5c9cf73 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:15.123896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b327c-8c1e-4496-afd2-fda2b5c9cf73 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:15.262982 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fbbf7-375e-41e9-83c5-4eee92109ef0 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca519bf4309140f1a820b255275d21e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c91774448144c58606f2004fa729b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:15.263709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fbbf7-375e-41e9-83c5-4eee92109ef0 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:15.263987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fbbf7-375e-41e9-83c5-4eee92109ef0 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:15.264273 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fbbf7-375e-41e9-83c5-4eee92109ef0 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:15.269355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fbbf7-375e-41e9-83c5-4eee92109ef0 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:15.269736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fbbf7-375e-41e9-83c5-4eee92109ef0 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:15.273009 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fbbf7-375e-41e9-83c5-4eee92109ef0 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:15.321270 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 899/1834] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:15.464494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bf635-730b-4a40-a875-6327f422dbf4 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:15.484892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bf635-730b-4a40-a875-6327f422dbf4 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:15.500739 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca519bf4309140f1a820b255275d21e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c91774448144c58606f2004fa729b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:15.501637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:15.501930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:15.503092 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] PATH_INFO: `/v3/projects/a2c04632c1e34a4ebf03966154b7b937` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:15.508848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a2c04632c1e34a4ebf03966154b7b937)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:15.513349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:15.620367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fbbf7-375e-41e9-83c5-4eee92109ef0 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:15.625528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ad4fbbf7-375e-41e9-83c5-4eee92109ef0 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:15.637137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c04632c1e34a4ebf03966154b7b937', 'request_id': 'req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:15.655573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c04632c1e34a4ebf03966154b7b937', 'request_id': 'req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:15.664573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c04632c1e34a4ebf03966154b7b937', 'request_id': 'req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:15.682795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] The token cache is being invalidate because project a2c04632c1e34a4ebf03966154b7b937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:15.683917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:15.684833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:15.687397 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 936/1835] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:15 2022] DELETE /identity/v3/projects/a2c04632c1e34a4ebf03966154b7b937 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:15.724608 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:15.795434 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fbbf7-375e-41e9-83c5-4eee92109ef0 tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:15.913928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:15.915032 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:15.915906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:15.916511 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] PATH_INFO: `/v3/projects/a8a7db2fd2084361ba9230e3d08b168e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:15.918985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a7db2fd2084361ba9230e3d08b168e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:15.925556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:16.000246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:16.001792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:16.008047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a7db2fd2084361ba9230e3d08b168e', 'request_id': 'req-7451e8ea-6eff-424e-bbaa-000d2acdf316'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.015622 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e6998-c056-4a1b-8a2f-6c02e542f37e tempest-VolumeQuotaClassesTest-1245503579 tempest-VolumeQuotaClassesTest-1245503579-project-admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:16.015809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a7db2fd2084361ba9230e3d08b168e', 'request_id': 'req-7451e8ea-6eff-424e-bbaa-000d2acdf316'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.023286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a7db2fd2084361ba9230e3d08b168e', 'request_id': 'req-7451e8ea-6eff-424e-bbaa-000d2acdf316'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.034918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] The token cache is being invalidate because project a8a7db2fd2084361ba9230e3d08b168e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:16.035208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.035991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.037615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 900/1836] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:15 2022] DELETE /identity/v3/projects/a8a7db2fd2084361ba9230e3d08b168e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:16.041355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:16.042927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:16.078190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80139905-8ee7-45a9-a120-91d3ad550a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:16.079864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139905-8ee7-45a9-a120-91d3ad550a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.079864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139905-8ee7-45a9-a120-91d3ad550a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.079864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139905-8ee7-45a9-a120-91d3ad550a2f admin admin] PATH_INFO: `/v3/users/63483303b34b432e82788650774d0db8` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.081279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80139905-8ee7-45a9-a120-91d3ad550a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=63483303b34b432e82788650774d0db8)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:16.083408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80139905-8ee7-45a9-a120-91d3ad550a2f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:16.109435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451e8ea-6eff-424e-bbaa-000d2acdf316 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:16.115088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3d6cb-5d03-45dc-a7d1-02b90aed5d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:16.116021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3d6cb-5d03-45dc-a7d1-02b90aed5d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.116346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3d6cb-5d03-45dc-a7d1-02b90aed5d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.116630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3d6cb-5d03-45dc-a7d1-02b90aed5d6d admin admin] PATH_INFO: `/v3/users/39d649c431c84c7ebcaa351d2fc36e5d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.118169 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3d6cb-5d03-45dc-a7d1-02b90aed5d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d649c431c84c7ebcaa351d2fc36e5d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:16.120090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3d6cb-5d03-45dc-a7d1-02b90aed5d6d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:16.131836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-80139905-8ee7-45a9-a120-91d3ad550a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63483303b34b432e82788650774d0db8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.134168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:16.139774 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-80139905-8ee7-45a9-a120-91d3ad550a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63483303b34b432e82788650774d0db8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.141350 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:16.150110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-80139905-8ee7-45a9-a120-91d3ad550a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63483303b34b432e82788650774d0db8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.150882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-80139905-8ee7-45a9-a120-91d3ad550a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63483303b34b432e82788650774d0db8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.167817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-80139905-8ee7-45a9-a120-91d3ad550a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63483303b34b432e82788650774d0db8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.174778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 937/1837] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:15 2022] DELETE /identity/v3/users/63483303b34b432e82788650774d0db8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:16.178172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6bc3d6cb-5d03-45dc-a7d1-02b90aed5d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d649c431c84c7ebcaa351d2fc36e5d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.179350 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199aa2a-b8ab-4f13-b03d-12fce9fa0bb5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.179652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199aa2a-b8ab-4f13-b03d-12fce9fa0bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.179944 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199aa2a-b8ab-4f13-b03d-12fce9fa0bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.190397 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6bc3d6cb-5d03-45dc-a7d1-02b90aed5d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d649c431c84c7ebcaa351d2fc36e5d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.191110 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6bc3d6cb-5d03-45dc-a7d1-02b90aed5d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d649c431c84c7ebcaa351d2fc36e5d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.198178 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6bc3d6cb-5d03-45dc-a7d1-02b90aed5d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d649c431c84c7ebcaa351d2fc36e5d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.198320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a199aa2a-b8ab-4f13-b03d-12fce9fa0bb5 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:16.198818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6bc3d6cb-5d03-45dc-a7d1-02b90aed5d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d649c431c84c7ebcaa351d2fc36e5d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.199392 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a199aa2a-b8ab-4f13-b03d-12fce9fa0bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:16.212139 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 901/1838] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:16 2022] DELETE /identity/v3/users/39d649c431c84c7ebcaa351d2fc36e5d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:16.275148 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 938/1839] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:16.281985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3d6cb-5d03-45dc-a7d1-02b90aed5d6d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:16.283848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6bc3d6cb-5d03-45dc-a7d1-02b90aed5d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:16.356257 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3d6cb-5d03-45dc-a7d1-02b90aed5d6d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:16.359952 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce334a-fda5-4a59-be61-f5e1f5fb9723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:16.360942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce334a-fda5-4a59-be61-f5e1f5fb9723 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.360942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce334a-fda5-4a59-be61-f5e1f5fb9723 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.361174 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce334a-fda5-4a59-be61-f5e1f5fb9723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.433286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce334a-fda5-4a59-be61-f5e1f5fb9723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:16.434776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce334a-fda5-4a59-be61-f5e1f5fb9723 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:16.451049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 902/1840] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:16.742132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199aa2a-b8ab-4f13-b03d-12fce9fa0bb5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:16.745379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a199aa2a-b8ab-4f13-b03d-12fce9fa0bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:16.760538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199aa2a-b8ab-4f13-b03d-12fce9fa0bb5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:16.767283 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528f79f-b7a9-4157-a255-3d014d45eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:16.768170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528f79f-b7a9-4157-a255-3d014d45eec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.768499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528f79f-b7a9-4157-a255-3d014d45eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.768841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528f79f-b7a9-4157-a255-3d014d45eec9 admin admin] PATH_INFO: `/v3/projects/15351675185a4914ba844c1610816c3b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.771176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528f79f-b7a9-4157-a255-3d014d45eec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15351675185a4914ba844c1610816c3b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:16.773217 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528f79f-b7a9-4157-a255-3d014d45eec9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:16.832603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0528f79f-b7a9-4157-a255-3d014d45eec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15351675185a4914ba844c1610816c3b', 'request_id': 'req-0528f79f-b7a9-4157-a255-3d014d45eec9'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.840087 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0528f79f-b7a9-4157-a255-3d014d45eec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15351675185a4914ba844c1610816c3b', 'request_id': 'req-0528f79f-b7a9-4157-a255-3d014d45eec9'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.852382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0528f79f-b7a9-4157-a255-3d014d45eec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15351675185a4914ba844c1610816c3b', 'request_id': 'req-0528f79f-b7a9-4157-a255-3d014d45eec9'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.859706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce334a-fda5-4a59-be61-f5e1f5fb9723 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:16.861219 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-05ce334a-fda5-4a59-be61-f5e1f5fb9723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:16.868892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0528f79f-b7a9-4157-a255-3d014d45eec9 admin admin] The token cache is being invalidate because project 15351675185a4914ba844c1610816c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:16.869184 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0528f79f-b7a9-4157-a255-3d014d45eec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.869837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0528f79f-b7a9-4157-a255-3d014d45eec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:16.874716 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 939/1841] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:16 2022] DELETE /identity/v3/projects/15351675185a4914ba844c1610816c3b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:16.876546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce334a-fda5-4a59-be61-f5e1f5fb9723 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:16.879342 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53504eca-3bcf-452d-a390-76ff50a9cab4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.879644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53504eca-3bcf-452d-a390-76ff50a9cab4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.879946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53504eca-3bcf-452d-a390-76ff50a9cab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.899599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-53504eca-3bcf-452d-a390-76ff50a9cab4 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:16.900907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-53504eca-3bcf-452d-a390-76ff50a9cab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:16.918842 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:16.939719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:16.940621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.940904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.941176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] PATH_INFO: `/v3/projects/56a3d731273f468d84e4e14bac46f81f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.942358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56a3d731273f468d84e4e14bac46f81f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:16.944261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:16.951532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:16.966838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 940/1842] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:16.976944 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a66fd-409d-43a2-ae44-63729486f616 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:16.977255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a66fd-409d-43a2-ae44-63729486f616 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:16.977531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a66fd-409d-43a2-ae44-63729486f616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:16.999974 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a3d731273f468d84e4e14bac46f81f', 'request_id': 'req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.004095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8e8a66fd-409d-43a2-ae44-63729486f616 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:17.005488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8e8a66fd-409d-43a2-ae44-63729486f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:17.014990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a3d731273f468d84e4e14bac46f81f', 'request_id': 'req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.023816 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a3d731273f468d84e4e14bac46f81f', 'request_id': 'req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.037662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] The token cache is being invalidate because project 56a3d731273f468d84e4e14bac46f81f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:17.037948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.038625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.048457 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 903/1843] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:16 2022] DELETE /identity/v3/projects/56a3d731273f468d84e4e14bac46f81f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:17.048457 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:17.052602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:17.091724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 941/1844] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:17.095654 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a66fd-409d-43a2-ae44-63729486f616 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:17.105045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a66fd-409d-43a2-ae44-63729486f616 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.109588 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179c21e-c2f2-4c8d-b9d4-35ba27389ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.110248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179c21e-c2f2-4c8d-b9d4-35ba27389ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.110534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179c21e-c2f2-4c8d-b9d4-35ba27389ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.111023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179c21e-c2f2-4c8d-b9d4-35ba27389ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.111540 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179c21e-c2f2-4c8d-b9d4-35ba27389ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:17.113258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179c21e-c2f2-4c8d-b9d4-35ba27389ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:17.114158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179c21e-c2f2-4c8d-b9d4-35ba27389ae1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:17.129478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 942/1845] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:17.130167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de56c70-51ee-427b-8eee-c4aaca1c6ce5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.134022 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179c21e-c2f2-4c8d-b9d4-35ba27389ae1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:17.137097 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f80aca-9326-4649-b61d-8c39f1729d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.138611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f80aca-9326-4649-b61d-8c39f1729d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.139104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f80aca-9326-4649-b61d-8c39f1729d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.139395 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f80aca-9326-4649-b61d-8c39f1729d96 admin admin] PATH_INFO: `/v3/users/ca519bf4309140f1a820b255275d21e1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.141729 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f80aca-9326-4649-b61d-8c39f1729d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca519bf4309140f1a820b255275d21e1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:17.144254 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f80aca-9326-4649-b61d-8c39f1729d96 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:17.145465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179c21e-c2f2-4c8d-b9d4-35ba27389ae1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.150513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cd424-058e-4135-a17f-50b21c48d5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.151068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cd424-058e-4135-a17f-50b21c48d5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.151354 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cd424-058e-4135-a17f-50b21c48d5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.151633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cd424-058e-4135-a17f-50b21c48d5a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.152328 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cd424-058e-4135-a17f-50b21c48d5a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:17.154259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cd424-058e-4135-a17f-50b21c48d5a2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:17.187244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 943/1846] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:17 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:17.188543 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cd424-058e-4135-a17f-50b21c48d5a2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:17.205902 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b6f80aca-9326-4649-b61d-8c39f1729d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca519bf4309140f1a820b255275d21e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.218526 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b6f80aca-9326-4649-b61d-8c39f1729d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca519bf4309140f1a820b255275d21e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.219285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b6f80aca-9326-4649-b61d-8c39f1729d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca519bf4309140f1a820b255275d21e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.225444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:17.227646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b6f80aca-9326-4649-b61d-8c39f1729d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca519bf4309140f1a820b255275d21e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.228631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b6f80aca-9326-4649-b61d-8c39f1729d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca519bf4309140f1a820b255275d21e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.246548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 904/1847] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:17 2022] DELETE /identity/v3/users/ca519bf4309140f1a820b255275d21e1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:17.256377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cd424-058e-4135-a17f-50b21c48d5a2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.321017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48886f88-6cb0-4f51-8bdb-6c0514b15556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.321788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886f88-6cb0-4f51-8bdb-6c0514b15556 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.322079 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886f88-6cb0-4f51-8bdb-6c0514b15556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.322441 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886f88-6cb0-4f51-8bdb-6c0514b15556 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.323058 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48886f88-6cb0-4f51-8bdb-6c0514b15556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:17.325212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48886f88-6cb0-4f51-8bdb-6c0514b15556 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:17.339648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:17.348581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 944/1848] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:17 2022] POST /identity/v3/users => generated 282 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:17.350885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f80aca-9326-4649-b61d-8c39f1729d96 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:17.352702 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b6f80aca-9326-4649-b61d-8c39f1729d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:17.366864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f80aca-9326-4649-b61d-8c39f1729d96 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.371334 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e828df-2c21-43d9-ad53-c0c177866836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.372001 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e828df-2c21-43d9-ad53-c0c177866836 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.372302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e828df-2c21-43d9-ad53-c0c177866836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.372605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e828df-2c21-43d9-ad53-c0c177866836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.373333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e828df-2c21-43d9-ad53-c0c177866836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:17.374926 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e828df-2c21-43d9-ad53-c0c177866836 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:17.386073 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 905/1849] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:17.390189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48886f88-6cb0-4f51-8bdb-6c0514b15556 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:17.401600 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48886f88-6cb0-4f51-8bdb-6c0514b15556 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.407046 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382975a3-71b5-4d9f-be3a-bdd0c0cda3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.407727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382975a3-71b5-4d9f-be3a-bdd0c0cda3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.408016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382975a3-71b5-4d9f-be3a-bdd0c0cda3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.408298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382975a3-71b5-4d9f-be3a-bdd0c0cda3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.409806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382975a3-71b5-4d9f-be3a-bdd0c0cda3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:17.411198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382975a3-71b5-4d9f-be3a-bdd0c0cda3d0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:17.421979 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 945/1850] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:37:17.427393 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e828df-2c21-43d9-ad53-c0c177866836 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:17.437441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e828df-2c21-43d9-ad53-c0c177866836 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.443531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be0248-e5ca-40c6-9410-121835e3d4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.445180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be0248-e5ca-40c6-9410-121835e3d4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.445635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be0248-e5ca-40c6-9410-121835e3d4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.445928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be0248-e5ca-40c6-9410-121835e3d4a1 admin admin] PATH_INFO: `/v3/projects/dbcc816fc48e468a89ea76e2cf9ab75b/users/79a55d873abd4c84af2bb6685d158b46/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.463872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be0248-e5ca-40c6-9410-121835e3d4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcc816fc48e468a89ea76e2cf9ab75b, user_id=79a55d873abd4c84af2bb6685d158b46, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:17.466628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be0248-e5ca-40c6-9410-121835e3d4a1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:17.480591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 906/1851] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:17 2022] PUT /identity/v3/projects/dbcc816fc48e468a89ea76e2cf9ab75b/users/79a55d873abd4c84af2bb6685d158b46/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:17.492288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb187c-351f-434b-9ba0-3df886191b81 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.492875 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb187c-351f-434b-9ba0-3df886191b81 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.492875 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb187c-351f-434b-9ba0-3df886191b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.534837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b5bb187c-351f-434b-9ba0-3df886191b81 None None] MFA Rules not processed for user `79a55d873abd4c84af2bb6685d158b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:17.536221 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b5bb187c-351f-434b-9ba0-3df886191b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:17.556292 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be0248-e5ca-40c6-9410-121835e3d4a1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:17.562482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b5be0248-e5ca-40c6-9410-121835e3d4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:17.693808 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 946/1852] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:17.698431 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb187c-351f-434b-9ba0-3df886191b81 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:17.706927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be0248-e5ca-40c6-9410-121835e3d4a1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.712660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e24ed-5729-483b-8d30-2892ad812f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.713822 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e24ed-5729-483b-8d30-2892ad812f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.714322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e24ed-5729-483b-8d30-2892ad812f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.714745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e24ed-5729-483b-8d30-2892ad812f67 admin admin] PATH_INFO: `/v3/projects/f8c91774448144c58606f2004fa729b1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.715229 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb187c-351f-434b-9ba0-3df886191b81 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.716353 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e24ed-5729-483b-8d30-2892ad812f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c91774448144c58606f2004fa729b1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:17.718509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e24ed-5729-483b-8d30-2892ad812f67 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:17.723462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0780eb-932e-478f-b336-f788ef82bfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.724283 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0780eb-932e-478f-b336-f788ef82bfee admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.724757 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0780eb-932e-478f-b336-f788ef82bfee admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.725083 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0780eb-932e-478f-b336-f788ef82bfee admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.726068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0780eb-932e-478f-b336-f788ef82bfee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:17.728694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0780eb-932e-478f-b336-f788ef82bfee admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:17.777889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 947/1853] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:17 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:17.779308 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0780eb-932e-478f-b336-f788ef82bfee admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:17.805578 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ba2e24ed-5729-483b-8d30-2892ad812f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c91774448144c58606f2004fa729b1', 'request_id': 'req-ba2e24ed-5729-483b-8d30-2892ad812f67'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.841464 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ba2e24ed-5729-483b-8d30-2892ad812f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c91774448144c58606f2004fa729b1', 'request_id': 'req-ba2e24ed-5729-483b-8d30-2892ad812f67'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.879540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ba2e24ed-5729-483b-8d30-2892ad812f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c91774448144c58606f2004fa729b1', 'request_id': 'req-ba2e24ed-5729-483b-8d30-2892ad812f67'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.939418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ba2e24ed-5729-483b-8d30-2892ad812f67 admin admin] The token cache is being invalidate because project f8c91774448144c58606f2004fa729b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:17.939796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ba2e24ed-5729-483b-8d30-2892ad812f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.943384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ba2e24ed-5729-483b-8d30-2892ad812f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:17.945146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0780eb-932e-478f-b336-f788ef82bfee admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:17.945802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 907/1854] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:17 2022] DELETE /identity/v3/projects/f8c91774448144c58606f2004fa729b1 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:17.950601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b5da-2e42-406c-934d-1ad91de51625 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.951004 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b5da-2e42-406c-934d-1ad91de51625 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.951662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b5da-2e42-406c-934d-1ad91de51625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.965377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750bf7e-e63a-4fbd-ae50-922b373bbd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:17.966466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bf7e-e63a-4fbd-ae50-922b373bbd05 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:17.966962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bf7e-e63a-4fbd-ae50-922b373bbd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:17.967448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bf7e-e63a-4fbd-ae50-922b373bbd05 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:17.968350 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750bf7e-e63a-4fbd-ae50-922b373bbd05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:17.970958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750bf7e-e63a-4fbd-ae50-922b373bbd05 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:18.005019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3b23b5da-2e42-406c-934d-1ad91de51625 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:18.005833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 948/1855] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:17 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:18.009103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3b23b5da-2e42-406c-934d-1ad91de51625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:18.013892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750bf7e-e63a-4fbd-ae50-922b373bbd05 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:18.015736 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2750bf7e-e63a-4fbd-ae50-922b373bbd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:18.030999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750bf7e-e63a-4fbd-ae50-922b373bbd05 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:18.032522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 908/1856] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:18.041987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2568f5-90ef-4777-89b2-584ecba937ec None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.042822 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2568f5-90ef-4777-89b2-584ecba937ec None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.043455 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2568f5-90ef-4777-89b2-584ecba937ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.056011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eec6be-0304-4519-b688-4c0180591cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:18.056227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eec6be-0304-4519-b688-4c0180591cfa admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.060614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eec6be-0304-4519-b688-4c0180591cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.060614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eec6be-0304-4519-b688-4c0180591cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.060614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eec6be-0304-4519-b688-4c0180591cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:18.064626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eec6be-0304-4519-b688-4c0180591cfa admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:18.083343 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2d2568f5-90ef-4777-89b2-584ecba937ec None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:18.084461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2d2568f5-90ef-4777-89b2-584ecba937ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:18.088726 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 949/1857] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:18.091058 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eec6be-0304-4519-b688-4c0180591cfa admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:18.095328 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 909/1858] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:18.101108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2568f5-90ef-4777-89b2-584ecba937ec None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:18.114304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2568f5-90ef-4777-89b2-584ecba937ec None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:18.122093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eec6be-0304-4519-b688-4c0180591cfa admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:18.129137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90875bc2-51e9-4c74-8afb-82a522759765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:18.132581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90875bc2-51e9-4c74-8afb-82a522759765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.132581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90875bc2-51e9-4c74-8afb-82a522759765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.132581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90875bc2-51e9-4c74-8afb-82a522759765 admin admin] PATH_INFO: `/v3/projects/a603355120014504a92d7fd3ae4ad713/users/18bcfbbb711c43dd857cf08be17fef52/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.138139 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35509cd-6dfb-4aaa-a097-df94e376b018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:18.138712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35509cd-6dfb-4aaa-a097-df94e376b018 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.139829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35509cd-6dfb-4aaa-a097-df94e376b018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.139829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35509cd-6dfb-4aaa-a097-df94e376b018 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.140340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35509cd-6dfb-4aaa-a097-df94e376b018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:18.140769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35509cd-6dfb-4aaa-a097-df94e376b018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:18.142473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35509cd-6dfb-4aaa-a097-df94e376b018 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:18.159238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 910/1859] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:18.165897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35509cd-6dfb-4aaa-a097-df94e376b018 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:18.170250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90875bc2-51e9-4c74-8afb-82a522759765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a603355120014504a92d7fd3ae4ad713, user_id=18bcfbbb711c43dd857cf08be17fef52, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:18.173511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90875bc2-51e9-4c74-8afb-82a522759765 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:18.186549 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35509cd-6dfb-4aaa-a097-df94e376b018 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:18.196810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 950/1860] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:18 2022] PUT /identity/v3/projects/a603355120014504a92d7fd3ae4ad713/users/18bcfbbb711c43dd857cf08be17fef52/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:18.197970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90875bc2-51e9-4c74-8afb-82a522759765 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:18.211713 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:18.228879 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:18.303735 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90875bc2-51e9-4c74-8afb-82a522759765 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:18.310045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc409d94-914c-4835-9b8e-ae3507384d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:18.311069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409d94-914c-4835-9b8e-ae3507384d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.311465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409d94-914c-4835-9b8e-ae3507384d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.311748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409d94-914c-4835-9b8e-ae3507384d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.312701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc409d94-914c-4835-9b8e-ae3507384d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:18.314314 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc409d94-914c-4835-9b8e-ae3507384d11 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:18.314953 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904885f-c249-4fc3-ba3a-420237eace26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:18.315584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904885f-c249-4fc3-ba3a-420237eace26 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.315876 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904885f-c249-4fc3-ba3a-420237eace26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.316157 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904885f-c249-4fc3-ba3a-420237eace26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.320780 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904885f-c249-4fc3-ba3a-420237eace26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:18.320780 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904885f-c249-4fc3-ba3a-420237eace26 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:18.328576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 951/1861] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:18.335404 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc409d94-914c-4835-9b8e-ae3507384d11 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:18.353793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc409d94-914c-4835-9b8e-ae3507384d11 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:18.360033 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d552a3-df80-4a84-91c7-0d7b2de9e9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:18.362743 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d552a3-df80-4a84-91c7-0d7b2de9e9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.363309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d552a3-df80-4a84-91c7-0d7b2de9e9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.363735 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d552a3-df80-4a84-91c7-0d7b2de9e9c6 admin admin] PATH_INFO: `/v3/projects/a603355120014504a92d7fd3ae4ad713/users/18bcfbbb711c43dd857cf08be17fef52/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.366988 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d552a3-df80-4a84-91c7-0d7b2de9e9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a603355120014504a92d7fd3ae4ad713, user_id=18bcfbbb711c43dd857cf08be17fef52, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:18.370473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d552a3-df80-4a84-91c7-0d7b2de9e9c6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:18.382694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 911/1862] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:18 2022] POST /identity/v3/projects => generated 381 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:18.383275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904885f-c249-4fc3-ba3a-420237eace26 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:18.392607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 952/1863] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:18 2022] PUT /identity/v3/projects/a603355120014504a92d7fd3ae4ad713/users/18bcfbbb711c43dd857cf08be17fef52/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:18.395952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547224bd-aba6-49d4-8593-00e03cb44835 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.396251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547224bd-aba6-49d4-8593-00e03cb44835 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.396580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547224bd-aba6-49d4-8593-00e03cb44835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.428869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-547224bd-aba6-49d4-8593-00e03cb44835 None None] MFA Rules not processed for user `18bcfbbb711c43dd857cf08be17fef52`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:18.430126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-547224bd-aba6-49d4-8593-00e03cb44835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:18.504112 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904885f-c249-4fc3-ba3a-420237eace26 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:18.550817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 953/1864] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:18.562651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547224bd-aba6-49d4-8593-00e03cb44835 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:18.564068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-547224bd-aba6-49d4-8593-00e03cb44835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:18.585147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d20a1-8295-4ab7-b99b-989bba0a0727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:18.585837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d20a1-8295-4ab7-b99b-989bba0a0727 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.586122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d20a1-8295-4ab7-b99b-989bba0a0727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.586428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d20a1-8295-4ab7-b99b-989bba0a0727 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.587213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d20a1-8295-4ab7-b99b-989bba0a0727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:18.589360 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d20a1-8295-4ab7-b99b-989bba0a0727 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:18.617294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 912/1865] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:18 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:18.626296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d20a1-8295-4ab7-b99b-989bba0a0727 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:18.640053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d20a1-8295-4ab7-b99b-989bba0a0727 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:18.646877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b10f4-4c87-4326-b731-f4b86a4eea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:18.647702 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b10f4-4c87-4326-b731-f4b86a4eea2e admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.648126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b10f4-4c87-4326-b731-f4b86a4eea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.648518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b10f4-4c87-4326-b731-f4b86a4eea2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.648832 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547224bd-aba6-49d4-8593-00e03cb44835 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:18.649394 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b10f4-4c87-4326-b731-f4b86a4eea2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:18.651623 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b10f4-4c87-4326-b731-f4b86a4eea2e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:18.653686 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824eb5f-0086-44b4-bd1b-13ea0894db12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:18.654617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824eb5f-0086-44b4-bd1b-13ea0894db12 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.655117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824eb5f-0086-44b4-bd1b-13ea0894db12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.655606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824eb5f-0086-44b4-bd1b-13ea0894db12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.664806 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 913/1866] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:18.668789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b10f4-4c87-4326-b731-f4b86a4eea2e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:18.670905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824eb5f-0086-44b4-bd1b-13ea0894db12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:18.672879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824eb5f-0086-44b4-bd1b-13ea0894db12 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:18.680237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b10f4-4c87-4326-b731-f4b86a4eea2e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:18.685337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 954/1867] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:37:18.685609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515959f-0829-41f5-8f1b-02cc2e6babf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:18.686609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515959f-0829-41f5-8f1b-02cc2e6babf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.686998 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515959f-0829-41f5-8f1b-02cc2e6babf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.687300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515959f-0829-41f5-8f1b-02cc2e6babf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.688034 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515959f-0829-41f5-8f1b-02cc2e6babf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:18.690445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515959f-0829-41f5-8f1b-02cc2e6babf2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:18.702601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 914/1868] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:18.707685 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824eb5f-0086-44b4-bd1b-13ea0894db12 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:18.723539 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824eb5f-0086-44b4-bd1b-13ea0894db12 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:18.739366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b79ae6-3551-4449-a10a-b8238dd0dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:18.740444 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b79ae6-3551-4449-a10a-b8238dd0dc36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.740717 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b79ae6-3551-4449-a10a-b8238dd0dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.741006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b79ae6-3551-4449-a10a-b8238dd0dc36 admin admin] PATH_INFO: `/v3/projects/409683bcd1cc40389cce24be02d5a4dd/users/1b864711176b4d50a77e31939b3a5a9a/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.766666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b79ae6-3551-4449-a10a-b8238dd0dc36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=409683bcd1cc40389cce24be02d5a4dd, user_id=1b864711176b4d50a77e31939b3a5a9a, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:18.774953 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b79ae6-3551-4449-a10a-b8238dd0dc36 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:18.779010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:18.797282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 955/1869] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:18 2022] PUT /identity/v3/projects/409683bcd1cc40389cce24be02d5a4dd/users/1b864711176b4d50a77e31939b3a5a9a/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:18.807951 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c6034-901c-4d0a-a7b2-095c9b8d03f4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.808246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c6034-901c-4d0a-a7b2-095c9b8d03f4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.808572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c6034-901c-4d0a-a7b2-095c9b8d03f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.809855 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b79ae6-3551-4449-a10a-b8238dd0dc36 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:18.839372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a74c6034-901c-4d0a-a7b2-095c9b8d03f4 None None] MFA Rules not processed for user `1b864711176b4d50a77e31939b3a5a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:18.840671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a74c6034-901c-4d0a-a7b2-095c9b8d03f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:18.846040 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:18.898937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b79ae6-3551-4449-a10a-b8238dd0dc36 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:18.902771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d5102-f746-4972-9d72-11f1e75bdb15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:18.903423 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d5102-f746-4972-9d72-11f1e75bdb15 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:18.903879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d5102-f746-4972-9d72-11f1e75bdb15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:18.904159 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d5102-f746-4972-9d72-11f1e75bdb15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:18.906568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d62d5102-f746-4972-9d72-11f1e75bdb15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:18.980284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 915/1870] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:18.985393 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c6034-901c-4d0a-a7b2-095c9b8d03f4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:19.030672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d5102-f746-4972-9d72-11f1e75bdb15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:19.030672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d5102-f746-4972-9d72-11f1e75bdb15 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:19.045534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 956/1871] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:37:19.098750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c6034-901c-4d0a-a7b2-095c9b8d03f4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:19.105347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422398f8-fd19-4407-aae2-c517928b0ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:19.106240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422398f8-fd19-4407-aae2-c517928b0ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:19.106457 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422398f8-fd19-4407-aae2-c517928b0ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:19.106690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422398f8-fd19-4407-aae2-c517928b0ac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:19.107420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422398f8-fd19-4407-aae2-c517928b0ac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:19.114574 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422398f8-fd19-4407-aae2-c517928b0ac5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:19.145577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 916/1872] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:18 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:19.147847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d5102-f746-4972-9d72-11f1e75bdb15 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:19.163250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d5102-f746-4972-9d72-11f1e75bdb15 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:19.246205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a9dd5-bf8e-4a52-90b8-e61c3906277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:19.247793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a9dd5-bf8e-4a52-90b8-e61c3906277a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:19.248106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a9dd5-bf8e-4a52-90b8-e61c3906277a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:19.248425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a9dd5-bf8e-4a52-90b8-e61c3906277a admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:19.249330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a9dd5-bf8e-4a52-90b8-e61c3906277a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:19.251741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a9dd5-bf8e-4a52-90b8-e61c3906277a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:19.278083 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 957/1873] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:19 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:19.282145 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422398f8-fd19-4407-aae2-c517928b0ac5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:19.295123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422398f8-fd19-4407-aae2-c517928b0ac5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:19.300917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798acda-58bf-4e3c-a008-4a210bcfa34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:19.301588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798acda-58bf-4e3c-a008-4a210bcfa34a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:19.301877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798acda-58bf-4e3c-a008-4a210bcfa34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:19.302161 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798acda-58bf-4e3c-a008-4a210bcfa34a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:19.302894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798acda-58bf-4e3c-a008-4a210bcfa34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:19.304522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798acda-58bf-4e3c-a008-4a210bcfa34a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:19.318256 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 917/1874] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:19.322557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a9dd5-bf8e-4a52-90b8-e61c3906277a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:19.333026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a9dd5-bf8e-4a52-90b8-e61c3906277a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:19.337820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72a849-e9c5-465f-9587-497dad9a0e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:19.338715 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72a849-e9c5-465f-9587-497dad9a0e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:19.339001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72a849-e9c5-465f-9587-497dad9a0e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:19.339355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72a849-e9c5-465f-9587-497dad9a0e59 admin admin] PATH_INFO: `/v3/projects/68724808d1544bf29a1e6c85f681f907/users/e5f52da0d02f42a3a52f0d0db3ec40b1/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:19.355070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72a849-e9c5-465f-9587-497dad9a0e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68724808d1544bf29a1e6c85f681f907, user_id=e5f52da0d02f42a3a52f0d0db3ec40b1, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:19.357804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72a849-e9c5-465f-9587-497dad9a0e59 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:19.373310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 958/1875] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:19 2022] PUT /identity/v3/projects/68724808d1544bf29a1e6c85f681f907/users/e5f52da0d02f42a3a52f0d0db3ec40b1/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:19.377054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798acda-58bf-4e3c-a008-4a210bcfa34a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:19.388010 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798acda-58bf-4e3c-a008-4a210bcfa34a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:19.466952 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a891185-a813-4e92-9845-7b09451fab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:19.467636 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891185-a813-4e92-9845-7b09451fab92 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:19.467922 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891185-a813-4e92-9845-7b09451fab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:19.468199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891185-a813-4e92-9845-7b09451fab92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:19.468979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a891185-a813-4e92-9845-7b09451fab92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:19.470558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a891185-a813-4e92-9845-7b09451fab92 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:19.481155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 918/1876] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:19.485361 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72a849-e9c5-465f-9587-497dad9a0e59 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:19.496166 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72a849-e9c5-465f-9587-497dad9a0e59 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:19.501023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81e239-3825-4352-8011-d49863693573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:19.502001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81e239-3825-4352-8011-d49863693573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:19.502943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81e239-3825-4352-8011-d49863693573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:19.503290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81e239-3825-4352-8011-d49863693573 admin admin] PATH_INFO: `/v3/projects/68724808d1544bf29a1e6c85f681f907/users/e5f52da0d02f42a3a52f0d0db3ec40b1/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:19.505367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81e239-3825-4352-8011-d49863693573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68724808d1544bf29a1e6c85f681f907, user_id=e5f52da0d02f42a3a52f0d0db3ec40b1, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:19.508029 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81e239-3825-4352-8011-d49863693573 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:19.518702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 959/1877] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:19 2022] PUT /identity/v3/projects/68724808d1544bf29a1e6c85f681f907/users/e5f52da0d02f42a3a52f0d0db3ec40b1/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:19.530066 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4ffd-3f7e-4c4f-a3a0-f285aa334d3b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:19.530360 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4ffd-3f7e-4c4f-a3a0-f285aa334d3b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:19.530640 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4ffd-3f7e-4c4f-a3a0-f285aa334d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:19.559301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1eee4ffd-3f7e-4c4f-a3a0-f285aa334d3b None None] MFA Rules not processed for user `e5f52da0d02f42a3a52f0d0db3ec40b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:19.560544 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1eee4ffd-3f7e-4c4f-a3a0-f285aa334d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:19.566249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:19.630198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 919/1878] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:19.640847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81e239-3825-4352-8011-d49863693573 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:19.646030 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:19.700701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81e239-3825-4352-8011-d49863693573 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:19.704231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ee638-e60a-47fc-aec6-bf8bc88572ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:19.704896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ee638-e60a-47fc-aec6-bf8bc88572ce service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:19.705179 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ee638-e60a-47fc-aec6-bf8bc88572ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:19.705495 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ee638-e60a-47fc-aec6-bf8bc88572ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:19.714343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ee638-e60a-47fc-aec6-bf8bc88572ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:19.715747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ee638-e60a-47fc-aec6-bf8bc88572ce service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:19.725626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 960/1879] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:20.117035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee4ffd-3f7e-4c4f-a3a0-f285aa334d3b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:20.186534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee4ffd-3f7e-4c4f-a3a0-f285aa334d3b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:20.191869 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e433b-a5dd-46e7-9893-15c9e8ef9ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:20.193372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e433b-a5dd-46e7-9893-15c9e8ef9ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:20.193829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e433b-a5dd-46e7-9893-15c9e8ef9ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:20.194119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e433b-a5dd-46e7-9893-15c9e8ef9ba3 admin admin] PATH_INFO: `/v3/users/1b864711176b4d50a77e31939b3a5a9a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:20.195340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e433b-a5dd-46e7-9893-15c9e8ef9ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b864711176b4d50a77e31939b3a5a9a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:20.197703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e433b-a5dd-46e7-9893-15c9e8ef9ba3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:20.268874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e76e433b-a5dd-46e7-9893-15c9e8ef9ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b864711176b4d50a77e31939b3a5a9a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:20.288097 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e76e433b-a5dd-46e7-9893-15c9e8ef9ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b864711176b4d50a77e31939b3a5a9a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:20.289513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e76e433b-a5dd-46e7-9893-15c9e8ef9ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b864711176b4d50a77e31939b3a5a9a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:20.300597 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e76e433b-a5dd-46e7-9893-15c9e8ef9ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b864711176b4d50a77e31939b3a5a9a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:20.301598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e76e433b-a5dd-46e7-9893-15c9e8ef9ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b864711176b4d50a77e31939b3a5a9a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:20.323308 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 920/1880] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:20 2022] DELETE /identity/v3/users/1b864711176b4d50a77e31939b3a5a9a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:20.328493 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65635d-90a9-4915-92d3-84648bc4e72e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:20.328971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65635d-90a9-4915-92d3-84648bc4e72e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:20.329052 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65635d-90a9-4915-92d3-84648bc4e72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:20.352280 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8d65635d-90a9-4915-92d3-84648bc4e72e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:20.353723 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8d65635d-90a9-4915-92d3-84648bc4e72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:20.432574 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 961/1881] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:20.446669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e433b-a5dd-46e7-9893-15c9e8ef9ba3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:20.446669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e76e433b-a5dd-46e7-9893-15c9e8ef9ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:20.479313 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:20.522657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e433b-a5dd-46e7-9893-15c9e8ef9ba3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:20.537453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81335c07-a29b-4ae3-9be6-413b54057a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:20.538320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81335c07-a29b-4ae3-9be6-413b54057a52 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:20.538407 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81335c07-a29b-4ae3-9be6-413b54057a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:20.538653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81335c07-a29b-4ae3-9be6-413b54057a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:20.548543 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81335c07-a29b-4ae3-9be6-413b54057a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:20.549984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81335c07-a29b-4ae3-9be6-413b54057a52 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:20.559901 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 921/1882] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:21.001983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65635d-90a9-4915-92d3-84648bc4e72e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:21.004221 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8d65635d-90a9-4915-92d3-84648bc4e72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:21.043326 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65635d-90a9-4915-92d3-84648bc4e72e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:21.050310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:21.051642 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:21.052085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:21.052555 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] PATH_INFO: `/v3/projects/409683bcd1cc40389cce24be02d5a4dd` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:21.055127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=409683bcd1cc40389cce24be02d5a4dd)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:21.057690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:21.122160 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '409683bcd1cc40389cce24be02d5a4dd', 'request_id': 'req-81ec05c3-3008-4794-bbd5-087b55ba8ad1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.129675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '409683bcd1cc40389cce24be02d5a4dd', 'request_id': 'req-81ec05c3-3008-4794-bbd5-087b55ba8ad1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.136059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '409683bcd1cc40389cce24be02d5a4dd', 'request_id': 'req-81ec05c3-3008-4794-bbd5-087b55ba8ad1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.150423 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] The token cache is being invalidate because project 409683bcd1cc40389cce24be02d5a4dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:21.150718 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.151351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.152968 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 962/1883] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:21 2022] DELETE /identity/v3/projects/409683bcd1cc40389cce24be02d5a4dd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:21.157476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81335c07-a29b-4ae3-9be6-413b54057a52 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:21.168797 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81335c07-a29b-4ae3-9be6-413b54057a52 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:21.231153 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8cd14-6e14-4b75-986c-56d47971e6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:21.232022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8cd14-6e14-4b75-986c-56d47971e6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:21.232310 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8cd14-6e14-4b75-986c-56d47971e6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:21.232619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8cd14-6e14-4b75-986c-56d47971e6a9 admin admin] PATH_INFO: `/v3/users/e5f52da0d02f42a3a52f0d0db3ec40b1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:21.233841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8cd14-6e14-4b75-986c-56d47971e6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f52da0d02f42a3a52f0d0db3ec40b1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:21.235854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8cd14-6e14-4b75-986c-56d47971e6a9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:21.287611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b8c8cd14-6e14-4b75-986c-56d47971e6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f52da0d02f42a3a52f0d0db3ec40b1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.301131 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b8c8cd14-6e14-4b75-986c-56d47971e6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f52da0d02f42a3a52f0d0db3ec40b1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.301855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b8c8cd14-6e14-4b75-986c-56d47971e6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f52da0d02f42a3a52f0d0db3ec40b1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.308840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b8c8cd14-6e14-4b75-986c-56d47971e6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f52da0d02f42a3a52f0d0db3ec40b1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.309501 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b8c8cd14-6e14-4b75-986c-56d47971e6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f52da0d02f42a3a52f0d0db3ec40b1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.323777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 922/1884] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:21 2022] DELETE /identity/v3/users/e5f52da0d02f42a3a52f0d0db3ec40b1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:21.588771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:21.590702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:21.616051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec05c3-3008-4794-bbd5-087b55ba8ad1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:21.685355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:21.769569 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b287b-1cc9-4db3-878c-edd13edb1b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:21.770487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b287b-1cc9-4db3-878c-edd13edb1b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:21.772002 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b287b-1cc9-4db3-878c-edd13edb1b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:21.772229 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b287b-1cc9-4db3-878c-edd13edb1b60 admin admin] PATH_INFO: `/v3/users/f52ad70dfb994f7bb6b1ea534a78a1b1` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:21.777207 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b287b-1cc9-4db3-878c-edd13edb1b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f52ad70dfb994f7bb6b1ea534a78a1b1)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:21.782339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b287b-1cc9-4db3-878c-edd13edb1b60 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:21.891121 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-001b287b-1cc9-4db3-878c-edd13edb1b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f52ad70dfb994f7bb6b1ea534a78a1b1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.906909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-001b287b-1cc9-4db3-878c-edd13edb1b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f52ad70dfb994f7bb6b1ea534a78a1b1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.921698 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-001b287b-1cc9-4db3-878c-edd13edb1b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f52ad70dfb994f7bb6b1ea534a78a1b1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.922550 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-001b287b-1cc9-4db3-878c-edd13edb1b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f52ad70dfb994f7bb6b1ea534a78a1b1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.952429 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-001b287b-1cc9-4db3-878c-edd13edb1b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f52ad70dfb994f7bb6b1ea534a78a1b1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:21.957347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8cd14-6e14-4b75-986c-56d47971e6a9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:21.962496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b8c8cd14-6e14-4b75-986c-56d47971e6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:21.989934 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 963/1885] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:21 2022] DELETE /identity/v3/users/f52ad70dfb994f7bb6b1ea534a78a1b1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:21.991622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8cd14-6e14-4b75-986c-56d47971e6a9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:21.995288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99bfd7-20a7-4d96-95c1-dff6c9ca57f1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:21.995766 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99bfd7-20a7-4d96-95c1-dff6c9ca57f1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:21.996294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99bfd7-20a7-4d96-95c1-dff6c9ca57f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.054969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0a99bfd7-20a7-4d96-95c1-dff6c9ca57f1 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:22.060489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0a99bfd7-20a7-4d96-95c1-dff6c9ca57f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:22.109325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:22.137396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.138901 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.139097 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.139491 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] PATH_INFO: `/v3/projects/68724808d1544bf29a1e6c85f681f907` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.141079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68724808d1544bf29a1e6c85f681f907)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:22.143870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:22.169508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 964/1886] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:22.170454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99bfd7-20a7-4d96-95c1-dff6c9ca57f1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.171819 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0a99bfd7-20a7-4d96-95c1-dff6c9ca57f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:22.187515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99bfd7-20a7-4d96-95c1-dff6c9ca57f1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.195499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82210ce-1da4-4296-9371-3c111f4cc8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.197618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82210ce-1da4-4296-9371-3c111f4cc8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.198127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82210ce-1da4-4296-9371-3c111f4cc8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.198768 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82210ce-1da4-4296-9371-3c111f4cc8d5 admin admin] PATH_INFO: `/v3/users/79a55d873abd4c84af2bb6685d158b46` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.208431 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82210ce-1da4-4296-9371-3c111f4cc8d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a55d873abd4c84af2bb6685d158b46)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:22.214636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82210ce-1da4-4296-9371-3c111f4cc8d5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:22.264585 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68724808d1544bf29a1e6c85f681f907', 'request_id': 'req-e6550474-ce53-45b6-ba57-b72cd2a35179'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:22.276976 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68724808d1544bf29a1e6c85f681f907', 'request_id': 'req-e6550474-ce53-45b6-ba57-b72cd2a35179'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:22.286099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68724808d1544bf29a1e6c85f681f907', 'request_id': 'req-e6550474-ce53-45b6-ba57-b72cd2a35179'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:22.309742 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] The token cache is being invalidate because project 68724808d1544bf29a1e6c85f681f907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:22.313388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:22.321310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:22.321593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:22.324494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d82210ce-1da4-4296-9371-3c111f4cc8d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a55d873abd4c84af2bb6685d158b46'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:22.327178 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 923/1887] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:21 2022] DELETE /identity/v3/projects/68724808d1544bf29a1e6c85f681f907 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:22.328948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.335241 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:22.340138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d82210ce-1da4-4296-9371-3c111f4cc8d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a55d873abd4c84af2bb6685d158b46'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:22.349854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d82210ce-1da4-4296-9371-3c111f4cc8d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a55d873abd4c84af2bb6685d158b46'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:22.351108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d82210ce-1da4-4296-9371-3c111f4cc8d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a55d873abd4c84af2bb6685d158b46'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:22.367362 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d82210ce-1da4-4296-9371-3c111f4cc8d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a55d873abd4c84af2bb6685d158b46'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:22.375484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 965/1888] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:22 2022] DELETE /identity/v3/users/79a55d873abd4c84af2bb6685d158b46 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:22.377592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09c4b-c071-4fc4-b1c7-8f4e3851fb24 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.377592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09c4b-c071-4fc4-b1c7-8f4e3851fb24 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.377592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09c4b-c071-4fc4-b1c7-8f4e3851fb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.406616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-94b09c4b-c071-4fc4-b1c7-8f4e3851fb24 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:22.407830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-94b09c4b-c071-4fc4-b1c7-8f4e3851fb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:22.416586 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6550474-ce53-45b6-ba57-b72cd2a35179 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.483959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e67c2-73dc-4bcd-89a4-a96ada9cdd5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.484773 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e67c2-73dc-4bcd-89a4-a96ada9cdd5a service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.486104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e67c2-73dc-4bcd-89a4-a96ada9cdd5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.486707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e67c2-73dc-4bcd-89a4-a96ada9cdd5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.489562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-301e67c2-73dc-4bcd-89a4-a96ada9cdd5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:22.492598 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 966/1889] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:22.493934 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17acd9-7c48-41d5-acb1-fb869b6995d0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.494230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17acd9-7c48-41d5-acb1-fb869b6995d0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.494513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17acd9-7c48-41d5-acb1-fb869b6995d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.505014 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e67c2-73dc-4bcd-89a4-a96ada9cdd5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:22.507165 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e67c2-73dc-4bcd-89a4-a96ada9cdd5a service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:22.521738 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 924/1890] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:22.522897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1e17acd9-7c48-41d5-acb1-fb869b6995d0 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:22.523437 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1da91c-bee5-41b6-9080-91c6a941b177 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.523831 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1da91c-bee5-41b6-9080-91c6a941b177 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.524300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1da91c-bee5-41b6-9080-91c6a941b177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.524917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1e17acd9-7c48-41d5-acb1-fb869b6995d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:22.536686 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 967/1891] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:22.548611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7e1da91c-bee5-41b6-9080-91c6a941b177 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:22.550698 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17acd9-7c48-41d5-acb1-fb869b6995d0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.551405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7e1da91c-bee5-41b6-9080-91c6a941b177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:22.552564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1e17acd9-7c48-41d5-acb1-fb869b6995d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:22.563818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 925/1892] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:22.567896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1da91c-bee5-41b6-9080-91c6a941b177 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.570036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17acd9-7c48-41d5-acb1-fb869b6995d0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.583788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5d824-9cc1-40f8-97fa-4b530b3f9f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.583788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5d824-9cc1-40f8-97fa-4b530b3f9f44 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.583788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5d824-9cc1-40f8-97fa-4b530b3f9f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.583788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5d824-9cc1-40f8-97fa-4b530b3f9f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.590352 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5d824-9cc1-40f8-97fa-4b530b3f9f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:22.592246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5d824-9cc1-40f8-97fa-4b530b3f9f44 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:22.593698 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1da91c-bee5-41b6-9080-91c6a941b177 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.601155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c15da-55d5-41e6-b019-adb162e20ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.602300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c15da-55d5-41e6-b019-adb162e20ecd admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.602909 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c15da-55d5-41e6-b019-adb162e20ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.603402 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c15da-55d5-41e6-b019-adb162e20ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.604370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c15da-55d5-41e6-b019-adb162e20ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:22.605137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c15da-55d5-41e6-b019-adb162e20ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:22.607408 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c15da-55d5-41e6-b019-adb162e20ecd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:22.608987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 968/1893] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:22.641843 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 926/1894] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:22.647584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5d824-9cc1-40f8-97fa-4b530b3f9f44 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.671471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5d824-9cc1-40f8-97fa-4b530b3f9f44 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.683676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ff0b2-8785-494e-916d-72569b242384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.684641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff0b2-8785-494e-916d-72569b242384 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.684938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff0b2-8785-494e-916d-72569b242384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.685219 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff0b2-8785-494e-916d-72569b242384 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.686379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ff0b2-8785-494e-916d-72569b242384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:22.688337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ff0b2-8785-494e-916d-72569b242384 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:22.724437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 969/1895] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:22 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:22.729452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c15da-55d5-41e6-b019-adb162e20ecd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.744778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c15da-55d5-41e6-b019-adb162e20ecd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.758409 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:22.895251 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb690e25-08d2-42f6-9fac-de5c05b8869c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.899844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb690e25-08d2-42f6-9fac-de5c05b8869c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.900983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb690e25-08d2-42f6-9fac-de5c05b8869c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.903768 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb690e25-08d2-42f6-9fac-de5c05b8869c admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.907625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb690e25-08d2-42f6-9fac-de5c05b8869c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:22.914199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb690e25-08d2-42f6-9fac-de5c05b8869c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:22.942012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 927/1896] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:22 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:22.946390 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ff0b2-8785-494e-916d-72569b242384 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:22.963762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ff0b2-8785-494e-916d-72569b242384 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:22.971263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18715438-caae-463e-b915-5e49d47d93e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:22.972304 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18715438-caae-463e-b915-5e49d47d93e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:22.973035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18715438-caae-463e-b915-5e49d47d93e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:22.973750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18715438-caae-463e-b915-5e49d47d93e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:22.974887 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18715438-caae-463e-b915-5e49d47d93e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:22.976960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18715438-caae-463e-b915-5e49d47d93e0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:22.996565 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 970/1897] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:37:22.998185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb690e25-08d2-42f6-9fac-de5c05b8869c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.019165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18715438-caae-463e-b915-5e49d47d93e0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.021538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-18715438-caae-463e-b915-5e49d47d93e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:23.027284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb690e25-08d2-42f6-9fac-de5c05b8869c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.034190 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd97bb1-8ed1-4a1d-aa65-0571eadda7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.034910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd97bb1-8ed1-4a1d-aa65-0571eadda7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.035199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd97bb1-8ed1-4a1d-aa65-0571eadda7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.035484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd97bb1-8ed1-4a1d-aa65-0571eadda7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.036288 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd97bb1-8ed1-4a1d-aa65-0571eadda7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.039960 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd97bb1-8ed1-4a1d-aa65-0571eadda7e2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.056489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 928/1898] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:23.056670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18715438-caae-463e-b915-5e49d47d93e0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.057516 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd97bb1-8ed1-4a1d-aa65-0571eadda7e2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.065443 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.066712 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.067422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.068401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] PATH_INFO: `/v3/projects/4501a21c4d8847f39addaf603e4f06ee` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.071210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4501a21c4d8847f39addaf603e4f06ee)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.073622 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.073954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd97bb1-8ed1-4a1d-aa65-0571eadda7e2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.079062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd56c20-493b-44b2-9b83-63cf1673b8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.080137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd56c20-493b-44b2-9b83-63cf1673b8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.080569 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd56c20-493b-44b2-9b83-63cf1673b8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.080931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd56c20-493b-44b2-9b83-63cf1673b8f9 admin admin] PATH_INFO: `/v3/projects/43d92a89d4124d739f2d81964837d00a/users/14c3e541eb4f4d68b67b59ae77a9ca93/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.117495 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd56c20-493b-44b2-9b83-63cf1673b8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d92a89d4124d739f2d81964837d00a, user_id=14c3e541eb4f4d68b67b59ae77a9ca93, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.120337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd56c20-493b-44b2-9b83-63cf1673b8f9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.138949 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 929/1899] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:23 2022] PUT /identity/v3/projects/43d92a89d4124d739f2d81964837d00a/users/14c3e541eb4f4d68b67b59ae77a9ca93/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:23.156067 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d18f6c-1708-4997-8834-1a7c74c700e3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.156594 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d18f6c-1708-4997-8834-1a7c74c700e3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.157051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d18f6c-1708-4997-8834-1a7c74c700e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.162600 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4501a21c4d8847f39addaf603e4f06ee', 'request_id': 'req-3c7deb41-1ab3-45c5-9c12-8450132e8d19'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.172214 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4501a21c4d8847f39addaf603e4f06ee', 'request_id': 'req-3c7deb41-1ab3-45c5-9c12-8450132e8d19'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.180273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4501a21c4d8847f39addaf603e4f06ee', 'request_id': 'req-3c7deb41-1ab3-45c5-9c12-8450132e8d19'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.182748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:23.207002 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] The token cache is being invalidate because project 4501a21c4d8847f39addaf603e4f06ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:23.207468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.207832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-01d18f6c-1708-4997-8834-1a7c74c700e3 None None] MFA Rules not processed for user `14c3e541eb4f4d68b67b59ae77a9ca93`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:23.208316 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.209713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-01d18f6c-1708-4997-8834-1a7c74c700e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:23.211923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 971/1900] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:23 2022] DELETE /identity/v3/projects/4501a21c4d8847f39addaf603e4f06ee => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:23.215650 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.218098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:23.296556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 930/1901] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:23.307912 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d18f6c-1708-4997-8834-1a7c74c700e3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.308552 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7deb41-1ab3-45c5-9c12-8450132e8d19 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.310988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-01d18f6c-1708-4997-8834-1a7c74c700e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:23.315103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b7705-31ea-4c3a-aa94-ad1c6f377472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.316450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b7705-31ea-4c3a-aa94-ad1c6f377472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.316927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b7705-31ea-4c3a-aa94-ad1c6f377472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.317290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b7705-31ea-4c3a-aa94-ad1c6f377472 admin admin] PATH_INFO: `/v3/users/221f091ceaf241fe8384547f70fc479d` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.318907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b7705-31ea-4c3a-aa94-ad1c6f377472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=221f091ceaf241fe8384547f70fc479d)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.321213 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b7705-31ea-4c3a-aa94-ad1c6f377472 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.395956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a84b7705-31ea-4c3a-aa94-ad1c6f377472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221f091ceaf241fe8384547f70fc479d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.400079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d18f6c-1708-4997-8834-1a7c74c700e3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.404658 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6c536-41c5-4b16-b3de-5e91ddb613d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.405385 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6c536-41c5-4b16-b3de-5e91ddb613d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.405753 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6c536-41c5-4b16-b3de-5e91ddb613d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.406003 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6c536-41c5-4b16-b3de-5e91ddb613d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.410066 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a84b7705-31ea-4c3a-aa94-ad1c6f377472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221f091ceaf241fe8384547f70fc479d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.417708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6c536-41c5-4b16-b3de-5e91ddb613d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.419752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6c536-41c5-4b16-b3de-5e91ddb613d7 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.425193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a84b7705-31ea-4c3a-aa94-ad1c6f377472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221f091ceaf241fe8384547f70fc479d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.426017 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:23.428657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a84b7705-31ea-4c3a-aa94-ad1c6f377472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221f091ceaf241fe8384547f70fc479d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.433200 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 931/1902] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:23.434371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6c536-41c5-4b16-b3de-5e91ddb613d7 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.436351 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1fa6c536-41c5-4b16-b3de-5e91ddb613d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:23.469589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a84b7705-31ea-4c3a-aa94-ad1c6f377472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221f091ceaf241fe8384547f70fc479d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.472810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6c536-41c5-4b16-b3de-5e91ddb613d7 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.479972 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 972/1903] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:23 2022] DELETE /identity/v3/users/221f091ceaf241fe8384547f70fc479d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:23.490357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.491235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.491517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.491792 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] PATH_INFO: `/v3/projects/dbcc816fc48e468a89ea76e2cf9ab75b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.496076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbcc816fc48e468a89ea76e2cf9ab75b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.498158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.623479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbcc816fc48e468a89ea76e2cf9ab75b', 'request_id': 'req-93a0087b-d393-4e00-b25e-b32ea5f7d660'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.635773 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbcc816fc48e468a89ea76e2cf9ab75b', 'request_id': 'req-93a0087b-d393-4e00-b25e-b32ea5f7d660'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.647500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbcc816fc48e468a89ea76e2cf9ab75b', 'request_id': 'req-93a0087b-d393-4e00-b25e-b32ea5f7d660'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.662585 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] The token cache is being invalidate because project dbcc816fc48e468a89ea76e2cf9ab75b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:23.663006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.663880 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:23.666781 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 932/1904] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:23 2022] DELETE /identity/v3/projects/dbcc816fc48e468a89ea76e2cf9ab75b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:23.671256 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b7705-31ea-4c3a-aa94-ad1c6f377472 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.674502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a84b7705-31ea-4c3a-aa94-ad1c6f377472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:23.821454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b7705-31ea-4c3a-aa94-ad1c6f377472 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.839371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:23.924641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:23.926189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:23.945106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcfe40-325b-487b-9650-3677c7bc9f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.946417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcfe40-325b-487b-9650-3677c7bc9f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.946877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcfe40-325b-487b-9650-3677c7bc9f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.947305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcfe40-325b-487b-9650-3677c7bc9f14 admin admin] PATH_INFO: `/v3/users/18bcfbbb711c43dd857cf08be17fef52` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.951897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcfe40-325b-487b-9650-3677c7bc9f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18bcfbbb711c43dd857cf08be17fef52)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.961087 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcfe40-325b-487b-9650-3677c7bc9f14 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:23.964124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0087b-d393-4e00-b25e-b32ea5f7d660 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:23.976715 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af897d-4360-4c89-bbfb-b5621f0439d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:23.978966 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af897d-4360-4c89-bbfb-b5621f0439d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:23.979531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af897d-4360-4c89-bbfb-b5621f0439d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:23.980068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af897d-4360-4c89-bbfb-b5621f0439d4 admin admin] PATH_INFO: `/v3/users/3680bdfdcaa84140ae9352a111b2fe40` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:23.982582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af897d-4360-4c89-bbfb-b5621f0439d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3680bdfdcaa84140ae9352a111b2fe40)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:23.987714 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af897d-4360-4c89-bbfb-b5621f0439d4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:24.105619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b8dcfe40-325b-487b-9650-3677c7bc9f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18bcfbbb711c43dd857cf08be17fef52'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.116737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-44af897d-4360-4c89-bbfb-b5621f0439d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3680bdfdcaa84140ae9352a111b2fe40'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.118767 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b8dcfe40-325b-487b-9650-3677c7bc9f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18bcfbbb711c43dd857cf08be17fef52'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.132710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b8dcfe40-325b-487b-9650-3677c7bc9f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18bcfbbb711c43dd857cf08be17fef52'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.134162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b8dcfe40-325b-487b-9650-3677c7bc9f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18bcfbbb711c43dd857cf08be17fef52'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.137126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-44af897d-4360-4c89-bbfb-b5621f0439d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3680bdfdcaa84140ae9352a111b2fe40'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.137886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-44af897d-4360-4c89-bbfb-b5621f0439d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3680bdfdcaa84140ae9352a111b2fe40'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.149054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-44af897d-4360-4c89-bbfb-b5621f0439d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3680bdfdcaa84140ae9352a111b2fe40'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.149860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-44af897d-4360-4c89-bbfb-b5621f0439d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3680bdfdcaa84140ae9352a111b2fe40'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.154955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b8dcfe40-325b-487b-9650-3677c7bc9f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18bcfbbb711c43dd857cf08be17fef52'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.168430 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 973/1905] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:23 2022] DELETE /identity/v3/users/18bcfbbb711c43dd857cf08be17fef52 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:24.170422 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 933/1906] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:23 2022] DELETE /identity/v3/users/3680bdfdcaa84140ae9352a111b2fe40 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:24.175691 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf6e66-cc1b-4cc1-be0b-1734f0c7bbf1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.175991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf6e66-cc1b-4cc1-be0b-1734f0c7bbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:24.176281 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf6e66-cc1b-4cc1-be0b-1734f0c7bbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.212085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-40bf6e66-cc1b-4cc1-be0b-1734f0c7bbf1 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:24.213538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-40bf6e66-cc1b-4cc1-be0b-1734f0c7bbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:24.298159 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 974/1907] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:24.313709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af897d-4360-4c89-bbfb-b5621f0439d4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:24.323504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-44af897d-4360-4c89-bbfb-b5621f0439d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:24.423318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af897d-4360-4c89-bbfb-b5621f0439d4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:24.452345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2bf01-a5fa-4825-b580-9b3d1bfe6bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:24.453053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2bf01-a5fa-4825-b580-9b3d1bfe6bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.453341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2bf01-a5fa-4825-b580-9b3d1bfe6bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:24.453623 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2bf01-a5fa-4825-b580-9b3d1bfe6bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.465432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2bf01-a5fa-4825-b580-9b3d1bfe6bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:24.466639 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2bf01-a5fa-4825-b580-9b3d1bfe6bc2 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:24.471680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:24.480029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 934/1908] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:24.558156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf6e66-cc1b-4cc1-be0b-1734f0c7bbf1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:24.559724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-40bf6e66-cc1b-4cc1-be0b-1734f0c7bbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:24.574332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf6e66-cc1b-4cc1-be0b-1734f0c7bbf1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:24.582802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda30db5-b18f-4119-b902-202b52d7f3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:24.583770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda30db5-b18f-4119-b902-202b52d7f3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.584220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda30db5-b18f-4119-b902-202b52d7f3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:24.584606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda30db5-b18f-4119-b902-202b52d7f3d8 admin admin] PATH_INFO: `/v3/projects/5a6f184719a7428a8f31e2b2aaed1ceb` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.586737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda30db5-b18f-4119-b902-202b52d7f3d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6f184719a7428a8f31e2b2aaed1ceb)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:24.590622 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda30db5-b18f-4119-b902-202b52d7f3d8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:24.622939 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2bf01-a5fa-4825-b580-9b3d1bfe6bc2 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:24.624654 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-45d2bf01-a5fa-4825-b580-9b3d1bfe6bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:24.654489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2bf01-a5fa-4825-b580-9b3d1bfe6bc2 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:24.656106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:24.687415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-eda30db5-b18f-4119-b902-202b52d7f3d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6f184719a7428a8f31e2b2aaed1ceb', 'request_id': 'req-eda30db5-b18f-4119-b902-202b52d7f3d8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.695958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-eda30db5-b18f-4119-b902-202b52d7f3d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6f184719a7428a8f31e2b2aaed1ceb', 'request_id': 'req-eda30db5-b18f-4119-b902-202b52d7f3d8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.702963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-eda30db5-b18f-4119-b902-202b52d7f3d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6f184719a7428a8f31e2b2aaed1ceb', 'request_id': 'req-eda30db5-b18f-4119-b902-202b52d7f3d8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.720100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-eda30db5-b18f-4119-b902-202b52d7f3d8 admin admin] The token cache is being invalidate because project 5a6f184719a7428a8f31e2b2aaed1ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:24.720476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-eda30db5-b18f-4119-b902-202b52d7f3d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.721394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-eda30db5-b18f-4119-b902-202b52d7f3d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.723464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 975/1909] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:24 2022] DELETE /identity/v3/projects/5a6f184719a7428a8f31e2b2aaed1ceb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:24.728644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7ae5-4a75-4b52-aa95-7b41d19c50f6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.728812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb322df8-d7f7-4d03-9114-28d4cd047b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:24.728948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7ae5-4a75-4b52-aa95-7b41d19c50f6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:24.728948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7ae5-4a75-4b52-aa95-7b41d19c50f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.729592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb322df8-d7f7-4d03-9114-28d4cd047b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.730143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb322df8-d7f7-4d03-9114-28d4cd047b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:24.730245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb322df8-d7f7-4d03-9114-28d4cd047b98 admin admin] PATH_INFO: `/v3/projects/a603355120014504a92d7fd3ae4ad713` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.731520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb322df8-d7f7-4d03-9114-28d4cd047b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a603355120014504a92d7fd3ae4ad713)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:24.733538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb322df8-d7f7-4d03-9114-28d4cd047b98 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:24.750602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ad5b7ae5-4a75-4b52-aa95-7b41d19c50f6 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:24.751849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ad5b7ae5-4a75-4b52-aa95-7b41d19c50f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:24.764591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 976/1910] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:24.778607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb2bb7-0102-4934-a83f-0bd5140d8f95 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.780520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb2bb7-0102-4934-a83f-0bd5140d8f95 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:24.781069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb2bb7-0102-4934-a83f-0bd5140d8f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.798141 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eb322df8-d7f7-4d03-9114-28d4cd047b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a603355120014504a92d7fd3ae4ad713', 'request_id': 'req-eb322df8-d7f7-4d03-9114-28d4cd047b98'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.808339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eb322df8-d7f7-4d03-9114-28d4cd047b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a603355120014504a92d7fd3ae4ad713', 'request_id': 'req-eb322df8-d7f7-4d03-9114-28d4cd047b98'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.816887 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eb322df8-d7f7-4d03-9114-28d4cd047b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a603355120014504a92d7fd3ae4ad713', 'request_id': 'req-eb322df8-d7f7-4d03-9114-28d4cd047b98'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.823546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e1fb2bb7-0102-4934-a83f-0bd5140d8f95 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:24.825488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e1fb2bb7-0102-4934-a83f-0bd5140d8f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:24.832260 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eb322df8-d7f7-4d03-9114-28d4cd047b98 admin admin] The token cache is being invalidate because project a603355120014504a92d7fd3ae4ad713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:24.832605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eb322df8-d7f7-4d03-9114-28d4cd047b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.833840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eb322df8-d7f7-4d03-9114-28d4cd047b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:24.840183 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 935/1911] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:24 2022] DELETE /identity/v3/projects/a603355120014504a92d7fd3ae4ad713 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:24.841792 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eee31-871e-4c65-b3e7-de434cd7d01a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.842138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eee31-871e-4c65-b3e7-de434cd7d01a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:24.842777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eee31-871e-4c65-b3e7-de434cd7d01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.865017 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-978eee31-871e-4c65-b3e7-de434cd7d01a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:24.866222 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-978eee31-871e-4c65-b3e7-de434cd7d01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:24.941427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 977/1912] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:24.943923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb2bb7-0102-4934-a83f-0bd5140d8f95 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:24.959877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 936/1913] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:24.960689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb2bb7-0102-4934-a83f-0bd5140d8f95 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:24.960831 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eee31-871e-4c65-b3e7-de434cd7d01a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:24.962287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-978eee31-871e-4c65-b3e7-de434cd7d01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:24.967289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebc22f-69ae-4ce1-8717-ae45e05461f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:24.968278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebc22f-69ae-4ce1-8717-ae45e05461f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.968895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebc22f-69ae-4ce1-8717-ae45e05461f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:24.969420 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebc22f-69ae-4ce1-8717-ae45e05461f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.970424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebc22f-69ae-4ce1-8717-ae45e05461f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:24.971571 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebc22f-69ae-4ce1-8717-ae45e05461f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:24.974216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebc22f-69ae-4ce1-8717-ae45e05461f9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:24.976125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eee31-871e-4c65-b3e7-de434cd7d01a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:24.982171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:24.983038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.983503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:24.983790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] PATH_INFO: `/v3/projects/bb1e84e6e80246b290316380d5cd7bad` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:24.985917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1e84e6e80246b290316380d5cd7bad)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:24.989595 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:24.997263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 978/1914] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:24.999023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e833f-0b22-4585-bedb-65e897dff49b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:24.999675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e833f-0b22-4585-bedb-65e897dff49b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:25.000164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e833f-0b22-4585-bedb-65e897dff49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:25.029518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:25.080479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1e84e6e80246b290316380d5cd7bad', 'request_id': 'req-77061143-55db-4d10-b828-15379fb21020'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:25.092260 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1e84e6e80246b290316380d5cd7bad', 'request_id': 'req-77061143-55db-4d10-b828-15379fb21020'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:25.094192 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f33e833f-0b22-4585-bedb-65e897dff49b None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:25.098056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f33e833f-0b22-4585-bedb-65e897dff49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:25.109893 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1e84e6e80246b290316380d5cd7bad', 'request_id': 'req-77061143-55db-4d10-b828-15379fb21020'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:25.135001 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] The token cache is being invalidate because project bb1e84e6e80246b290316380d5cd7bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:25.135294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:25.139959 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:25.143165 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 937/1915] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:24 2022] DELETE /identity/v3/projects/bb1e84e6e80246b290316380d5cd7bad => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:25.143763 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:25.152221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:25.236138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 979/1916] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:25.238050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e833f-0b22-4585-bedb-65e897dff49b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:25.240533 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f33e833f-0b22-4585-bedb-65e897dff49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:25.269813 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e833f-0b22-4585-bedb-65e897dff49b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:25.276062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50600f-9fe6-4685-bdf4-d5fef20878a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:25.277167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50600f-9fe6-4685-bdf4-d5fef20878a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:25.278795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50600f-9fe6-4685-bdf4-d5fef20878a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:25.278795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50600f-9fe6-4685-bdf4-d5fef20878a4 admin admin] PATH_INFO: `/v3/users/f0ec99488ae54c959c5dae9192eebcdc` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:25.280202 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50600f-9fe6-4685-bdf4-d5fef20878a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ec99488ae54c959c5dae9192eebcdc)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:25.282850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50600f-9fe6-4685-bdf4-d5fef20878a4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:25.293811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77061143-55db-4d10-b828-15379fb21020 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:25.311297 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe28e5-3032-49ad-ae4b-ff97f2a20740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:25.312703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe28e5-3032-49ad-ae4b-ff97f2a20740 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:25.313131 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe28e5-3032-49ad-ae4b-ff97f2a20740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:25.313568 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe28e5-3032-49ad-ae4b-ff97f2a20740 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:25.314679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe28e5-3032-49ad-ae4b-ff97f2a20740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:25.317690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe28e5-3032-49ad-ae4b-ff97f2a20740 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:25.376695 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:25.384097 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 938/1917] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:25 2022] POST /identity/v3/projects => generated 373 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:25.384537 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe28e5-3032-49ad-ae4b-ff97f2a20740 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:25.398617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-be50600f-9fe6-4685-bdf4-d5fef20878a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ec99488ae54c959c5dae9192eebcdc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:25.419817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-be50600f-9fe6-4685-bdf4-d5fef20878a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ec99488ae54c959c5dae9192eebcdc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:25.441439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-be50600f-9fe6-4685-bdf4-d5fef20878a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ec99488ae54c959c5dae9192eebcdc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:25.443509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-be50600f-9fe6-4685-bdf4-d5fef20878a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ec99488ae54c959c5dae9192eebcdc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:25.478239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-be50600f-9fe6-4685-bdf4-d5fef20878a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ec99488ae54c959c5dae9192eebcdc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:25.489341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 980/1918] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:25 2022] DELETE /identity/v3/users/f0ec99488ae54c959c5dae9192eebcdc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:25.489341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50600f-9fe6-4685-bdf4-d5fef20878a4 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:25.492743 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-be50600f-9fe6-4685-bdf4-d5fef20878a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:25.589505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe28e5-3032-49ad-ae4b-ff97f2a20740 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:25.686610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50600f-9fe6-4685-bdf4-d5fef20878a4 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:25.698415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb85436-f9e4-4e95-8b5a-c8a3fe03cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:25.699113 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb85436-f9e4-4e95-8b5a-c8a3fe03cddb admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:25.699456 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb85436-f9e4-4e95-8b5a-c8a3fe03cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:25.699740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb85436-f9e4-4e95-8b5a-c8a3fe03cddb admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:25.700473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb85436-f9e4-4e95-8b5a-c8a3fe03cddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:25.703117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb85436-f9e4-4e95-8b5a-c8a3fe03cddb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:25.706723 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:25.733078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb695c5-2dfc-4c95-9db5-3e1af14f0d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:25.734479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb695c5-2dfc-4c95-9db5-3e1af14f0d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:25.735067 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb695c5-2dfc-4c95-9db5-3e1af14f0d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:25.735555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb695c5-2dfc-4c95-9db5-3e1af14f0d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:25.737293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb695c5-2dfc-4c95-9db5-3e1af14f0d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:25.737856 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb695c5-2dfc-4c95-9db5-3e1af14f0d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:25.741026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb695c5-2dfc-4c95-9db5-3e1af14f0d58 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:25.754852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 981/1919] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:25 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:25.759091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb85436-f9e4-4e95-8b5a-c8a3fe03cddb admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:25.761793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 939/1920] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:25.765321 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb695c5-2dfc-4c95-9db5-3e1af14f0d58 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:25.768427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eeb695c5-2dfc-4c95-9db5-3e1af14f0d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:25.787761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb85436-f9e4-4e95-8b5a-c8a3fe03cddb admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:25.804635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9b079-2f4c-4e1c-8186-828aeb227357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:25.808652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9b079-2f4c-4e1c-8186-828aeb227357 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:25.808652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9b079-2f4c-4e1c-8186-828aeb227357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:25.808652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9b079-2f4c-4e1c-8186-828aeb227357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:25.808981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb695c5-2dfc-4c95-9db5-3e1af14f0d58 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:25.809078 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9b079-2f4c-4e1c-8186-828aeb227357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:25.809078 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9b079-2f4c-4e1c-8186-828aeb227357 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:25.822260 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90308e91-5095-49a9-95fb-fcaa52afd7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:25.822940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90308e91-5095-49a9-95fb-fcaa52afd7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:25.823666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90308e91-5095-49a9-95fb-fcaa52afd7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:25.823666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90308e91-5095-49a9-95fb-fcaa52afd7a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:25.824318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90308e91-5095-49a9-95fb-fcaa52afd7a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:25.826284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90308e91-5095-49a9-95fb-fcaa52afd7a1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:25.836523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 982/1921] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:37:25.839389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9b079-2f4c-4e1c-8186-828aeb227357 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:25.858868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9b079-2f4c-4e1c-8186-828aeb227357 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:25.873569 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa3922-e4e3-48b2-87a8-31ffe94c33b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:25.873939 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa3922-e4e3-48b2-87a8-31ffe94c33b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:25.874231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa3922-e4e3-48b2-87a8-31ffe94c33b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:25.874511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa3922-e4e3-48b2-87a8-31ffe94c33b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:25.875395 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa3922-e4e3-48b2-87a8-31ffe94c33b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:25.878732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa3922-e4e3-48b2-87a8-31ffe94c33b7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:25.883192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 940/1922] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:25 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:25.887498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90308e91-5095-49a9-95fb-fcaa52afd7a1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:25.927685 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 983/1923] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:25.929921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa3922-e4e3-48b2-87a8-31ffe94c33b7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:25.953315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa3922-e4e3-48b2-87a8-31ffe94c33b7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.018678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90308e91-5095-49a9-95fb-fcaa52afd7a1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.024307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae294d-d98b-4a61-a748-48238d46c511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.025444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae294d-d98b-4a61-a748-48238d46c511 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.025939 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae294d-d98b-4a61-a748-48238d46c511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.026427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae294d-d98b-4a61-a748-48238d46c511 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.027460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae294d-d98b-4a61-a748-48238d46c511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.030061 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae294d-d98b-4a61-a748-48238d46c511 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.049669 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083d023-b483-47db-86c4-95cb7f8e9977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.051255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083d023-b483-47db-86c4-95cb7f8e9977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.051544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083d023-b483-47db-86c4-95cb7f8e9977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.051824 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083d023-b483-47db-86c4-95cb7f8e9977 admin admin] PATH_INFO: `/v3/projects/c74043c0161a41cbad50e1b5dc636e2e/users/d137315902174a859da3a058d3024496/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.061109 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 941/1924] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:25 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:26.062655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae294d-d98b-4a61-a748-48238d46c511 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.070875 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083d023-b483-47db-86c4-95cb7f8e9977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74043c0161a41cbad50e1b5dc636e2e, user_id=d137315902174a859da3a058d3024496, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.073609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083d023-b483-47db-86c4-95cb7f8e9977 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.090365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae294d-d98b-4a61-a748-48238d46c511 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.091800 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 984/1925] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:25 2022] PUT /identity/v3/projects/c74043c0161a41cbad50e1b5dc636e2e/users/d137315902174a859da3a058d3024496/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:26.099253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e989d-ad28-441f-854b-b9a83264bd5c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.099558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e989d-ad28-441f-854b-b9a83264bd5c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.099890 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e989d-ad28-441f-854b-b9a83264bd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.109920 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:26.126045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-978e989d-ad28-441f-854b-b9a83264bd5c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:26.127898 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-978e989d-ad28-441f-854b-b9a83264bd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:26.173202 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbc865-8ef0-4ef6-b96f-882fba715dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.173735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbc865-8ef0-4ef6-b96f-882fba715dce admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.174218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbc865-8ef0-4ef6-b96f-882fba715dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.174503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbc865-8ef0-4ef6-b96f-882fba715dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.175247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbc865-8ef0-4ef6-b96f-882fba715dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.176950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbc865-8ef0-4ef6-b96f-882fba715dce admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.187688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 942/1926] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:26.188555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbc865-8ef0-4ef6-b96f-882fba715dce admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.190375 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-17dbc865-8ef0-4ef6-b96f-882fba715dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:26.203529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbc865-8ef0-4ef6-b96f-882fba715dce admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.208996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.209911 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.210144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.210421 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] PATH_INFO: `/v3/projects/34371c32d22a450bbb520ae96c27e8b4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.211624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34371c32d22a450bbb520ae96c27e8b4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.212290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 985/1927] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:26.215634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.217939 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e989d-ad28-441f-854b-b9a83264bd5c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.231766 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e989d-ad28-441f-854b-b9a83264bd5c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.238977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df064b1f-69ec-44ff-8190-a3c707c138a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.239960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df064b1f-69ec-44ff-8190-a3c707c138a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.240600 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df064b1f-69ec-44ff-8190-a3c707c138a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.240706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df064b1f-69ec-44ff-8190-a3c707c138a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.241551 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df064b1f-69ec-44ff-8190-a3c707c138a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.243678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df064b1f-69ec-44ff-8190-a3c707c138a4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.256929 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 986/1928] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:26.257931 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df064b1f-69ec-44ff-8190-a3c707c138a4 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.259879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-df064b1f-69ec-44ff-8190-a3c707c138a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:26.269204 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:26.281027 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34371c32d22a450bbb520ae96c27e8b4', 'request_id': 'req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:26.291571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34371c32d22a450bbb520ae96c27e8b4', 'request_id': 'req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:26.301797 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34371c32d22a450bbb520ae96c27e8b4', 'request_id': 'req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:26.313695 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] The token cache is being invalidate because project 34371c32d22a450bbb520ae96c27e8b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:26.314065 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:26.315046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:26.317393 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 943/1929] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:26 2022] DELETE /identity/v3/projects/34371c32d22a450bbb520ae96c27e8b4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:26.317991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.320527 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:26.327747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df064b1f-69ec-44ff-8190-a3c707c138a4 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.383469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb14a5-0da9-4a69-b66c-6296df6cc2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.384341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb14a5-0da9-4a69-b66c-6296df6cc2fb service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.384476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb14a5-0da9-4a69-b66c-6296df6cc2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.384733 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb14a5-0da9-4a69-b66c-6296df6cc2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.387155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0efb14a5-0da9-4a69-b66c-6296df6cc2fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:26.390366 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d1bc6-5a5e-49de-be3e-ad778cb98ce5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.397162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690341f-cc84-4e4b-9ea1-e6052e203c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.398206 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690341f-cc84-4e4b-9ea1-e6052e203c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.398499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690341f-cc84-4e4b-9ea1-e6052e203c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.398778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690341f-cc84-4e4b-9ea1-e6052e203c16 admin admin] PATH_INFO: `/v3/projects/486e488f73f2414cac13112aa4dc7238/users/3891a0ee8ec94115810cc9ed665cc97f/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.400047 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb14a5-0da9-4a69-b66c-6296df6cc2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.401591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb14a5-0da9-4a69-b66c-6296df6cc2fb service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.412645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 987/1930] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:26.413982 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a397cca-3412-46f9-bcbc-48a47246d214 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.414278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a397cca-3412-46f9-bcbc-48a47246d214 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.414553 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a397cca-3412-46f9-bcbc-48a47246d214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.416171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690341f-cc84-4e4b-9ea1-e6052e203c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=486e488f73f2414cac13112aa4dc7238, user_id=3891a0ee8ec94115810cc9ed665cc97f, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.419166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690341f-cc84-4e4b-9ea1-e6052e203c16 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.438070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7a397cca-3412-46f9-bcbc-48a47246d214 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:26.440335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7a397cca-3412-46f9-bcbc-48a47246d214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:26.444480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 944/1931] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:26 2022] PUT /identity/v3/projects/486e488f73f2414cac13112aa4dc7238/users/3891a0ee8ec94115810cc9ed665cc97f/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:26.453017 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312233-6348-44e5-bf81-64f6f2bab982 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.453337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312233-6348-44e5-bf81-64f6f2bab982 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.453729 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312233-6348-44e5-bf81-64f6f2bab982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.516114 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-10312233-6348-44e5-bf81-64f6f2bab982 None None] MFA Rules not processed for user `3891a0ee8ec94115810cc9ed665cc97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:26.525528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-10312233-6348-44e5-bf81-64f6f2bab982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:26.533077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:26.553960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 988/1932] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:26.566937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fb561-3e0c-4b4a-b804-98e62f06e192 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.567280 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fb561-3e0c-4b4a-b804-98e62f06e192 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.567575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fb561-3e0c-4b4a-b804-98e62f06e192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.594707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c01fb561-3e0c-4b4a-b804-98e62f06e192 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:26.596690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c01fb561-3e0c-4b4a-b804-98e62f06e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:26.606644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 989/1933] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:26.611027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fb561-3e0c-4b4a-b804-98e62f06e192 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.621447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fb561-3e0c-4b4a-b804-98e62f06e192 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.626719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 945/1934] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:26.627707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd466b-cdac-49ac-9f2d-b445316fbc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.628692 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd466b-cdac-49ac-9f2d-b445316fbc0e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.628984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd466b-cdac-49ac-9f2d-b445316fbc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.629257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd466b-cdac-49ac-9f2d-b445316fbc0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.630424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd466b-cdac-49ac-9f2d-b445316fbc0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:26.630424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd466b-cdac-49ac-9f2d-b445316fbc0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.632103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd466b-cdac-49ac-9f2d-b445316fbc0e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.632213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10312233-6348-44e5-bf81-64f6f2bab982 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.645757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10312233-6348-44e5-bf81-64f6f2bab982 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.652037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 990/1935] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:26.656457 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd466b-cdac-49ac-9f2d-b445316fbc0e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.662396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957ee5e-a685-4dd3-a63a-6634bfa5dd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.662998 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957ee5e-a685-4dd3-a63a-6634bfa5dd2d admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.663293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957ee5e-a685-4dd3-a63a-6634bfa5dd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.663571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957ee5e-a685-4dd3-a63a-6634bfa5dd2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.664429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957ee5e-a685-4dd3-a63a-6634bfa5dd2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.666322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957ee5e-a685-4dd3-a63a-6634bfa5dd2d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.668757 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd466b-cdac-49ac-9f2d-b445316fbc0e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.676873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc378d56-fb26-40e4-ae25-098188313fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.678016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc378d56-fb26-40e4-ae25-098188313fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.678304 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc378d56-fb26-40e4-ae25-098188313fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.678587 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc378d56-fb26-40e4-ae25-098188313fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.679687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc378d56-fb26-40e4-ae25-098188313fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.681856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc378d56-fb26-40e4-ae25-098188313fe3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.700451 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 946/1936] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:26 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:26.704710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957ee5e-a685-4dd3-a63a-6634bfa5dd2d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.714611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 991/1937] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:26 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:26.718432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc378d56-fb26-40e4-ae25-098188313fe3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.729792 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:26.782454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957ee5e-a685-4dd3-a63a-6634bfa5dd2d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.798353 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc378d56-fb26-40e4-ae25-098188313fe3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.804709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636466fd-ad1d-42c2-8651-87a8494d680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.805565 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636466fd-ad1d-42c2-8651-87a8494d680e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.806145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636466fd-ad1d-42c2-8651-87a8494d680e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.806426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636466fd-ad1d-42c2-8651-87a8494d680e admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.807567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636466fd-ad1d-42c2-8651-87a8494d680e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.822309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636466fd-ad1d-42c2-8651-87a8494d680e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.873479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 992/1938] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:26 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:26.874737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636466fd-ad1d-42c2-8651-87a8494d680e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.893950 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636466fd-ad1d-42c2-8651-87a8494d680e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.900993 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2ed90-4f34-4223-9459-8ddbd95c38de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.906572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2ed90-4f34-4223-9459-8ddbd95c38de admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.906572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2ed90-4f34-4223-9459-8ddbd95c38de admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.906572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2ed90-4f34-4223-9459-8ddbd95c38de admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.906572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2ed90-4f34-4223-9459-8ddbd95c38de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.906572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2ed90-4f34-4223-9459-8ddbd95c38de admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.909514 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc1039-ab64-46b6-817b-24cd1eb221cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.910217 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1039-ab64-46b6-817b-24cd1eb221cb admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.910501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1039-ab64-46b6-817b-24cd1eb221cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.910778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1039-ab64-46b6-817b-24cd1eb221cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.911518 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc1039-ab64-46b6-817b-24cd1eb221cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.913166 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc1039-ab64-46b6-817b-24cd1eb221cb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.937761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 993/1939] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:26.938727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc1039-ab64-46b6-817b-24cd1eb221cb admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.948473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 947/1940] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:26 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:26.951760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc1039-ab64-46b6-817b-24cd1eb221cb admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.953587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2ed90-4f34-4223-9459-8ddbd95c38de admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:26.965183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63b80a-9a74-4951-9582-304ea7e864d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.966110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63b80a-9a74-4951-9582-304ea7e864d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:26.966401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63b80a-9a74-4951-9582-304ea7e864d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:26.966724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63b80a-9a74-4951-9582-304ea7e864d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:26.967505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63b80a-9a74-4951-9582-304ea7e864d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:26.969282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63b80a-9a74-4951-9582-304ea7e864d6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:26.976473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2ed90-4f34-4223-9459-8ddbd95c38de admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:26.999422 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdde33-9a6d-4510-9903-63a79de4721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:26.999621 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 994/1941] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:27.000472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63b80a-9a74-4951-9582-304ea7e864d6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.003414 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdde33-9a6d-4510-9903-63a79de4721f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.005053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdde33-9a6d-4510-9903-63a79de4721f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.005918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdde33-9a6d-4510-9903-63a79de4721f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.007524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdde33-9a6d-4510-9903-63a79de4721f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.011347 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63b80a-9a74-4951-9582-304ea7e864d6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.012936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdde33-9a6d-4510-9903-63a79de4721f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.017284 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da3767-7f46-400b-bdda-c8ed72e10091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.019028 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da3767-7f46-400b-bdda-c8ed72e10091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.019791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da3767-7f46-400b-bdda-c8ed72e10091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.020177 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da3767-7f46-400b-bdda-c8ed72e10091 admin admin] PATH_INFO: `/v3/projects/df70afeb269a485c82a54249acafb713/users/0aece7e536bd4655950f70e9e5359079/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.047360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da3767-7f46-400b-bdda-c8ed72e10091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df70afeb269a485c82a54249acafb713, user_id=0aece7e536bd4655950f70e9e5359079, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.050253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 948/1942] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:37:27.051558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da3767-7f46-400b-bdda-c8ed72e10091 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.055153 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdde33-9a6d-4510-9903-63a79de4721f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.073169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 995/1943] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:26 2022] PUT /identity/v3/projects/df70afeb269a485c82a54249acafb713/users/0aece7e536bd4655950f70e9e5359079/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:27.076117 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdde33-9a6d-4510-9903-63a79de4721f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.082604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9404c1-5e98-45f0-8c97-860690a51ee9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.082888 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9404c1-5e98-45f0-8c97-860690a51ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.083252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9404c1-5e98-45f0-8c97-860690a51ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.141878 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4d9404c1-5e98-45f0-8c97-860690a51ee9 None None] MFA Rules not processed for user `0aece7e536bd4655950f70e9e5359079`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:27.144435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4d9404c1-5e98-45f0-8c97-860690a51ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:27.180121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87415da4-e2b9-485a-928f-bde6b52d7342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.181379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87415da4-e2b9-485a-928f-bde6b52d7342 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.181820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87415da4-e2b9-485a-928f-bde6b52d7342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.182176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87415da4-e2b9-485a-928f-bde6b52d7342 admin admin] PATH_INFO: `/v3/projects/a635edaae74c42a08bb2d8339eab172b/users/cbf03b773235456b8e02f8150733f04a/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.204413 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87415da4-e2b9-485a-928f-bde6b52d7342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a635edaae74c42a08bb2d8339eab172b, user_id=cbf03b773235456b8e02f8150733f04a, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.207165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:27.210651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87415da4-e2b9-485a-928f-bde6b52d7342 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.241799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 949/1944] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:27 2022] PUT /identity/v3/projects/a635edaae74c42a08bb2d8339eab172b/users/cbf03b773235456b8e02f8150733f04a/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:27.241980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 996/1945] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:27.244836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87415da4-e2b9-485a-928f-bde6b52d7342 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.245944 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9404c1-5e98-45f0-8c97-860690a51ee9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.266408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9404c1-5e98-45f0-8c97-860690a51ee9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.299584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:27.370177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87415da4-e2b9-485a-928f-bde6b52d7342 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.374584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bdbbd-4306-48b9-905b-5dcb741f897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.375267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bdbbd-4306-48b9-905b-5dcb741f897d admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.375560 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bdbbd-4306-48b9-905b-5dcb741f897d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.376231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bdbbd-4306-48b9-905b-5dcb741f897d admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.376641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bdbbd-4306-48b9-905b-5dcb741f897d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.378203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4defd-ff4a-4356-9993-fa650db1fad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.379676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bdbbd-4306-48b9-905b-5dcb741f897d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.380045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4defd-ff4a-4356-9993-fa650db1fad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.380635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4defd-ff4a-4356-9993-fa650db1fad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.381119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4defd-ff4a-4356-9993-fa650db1fad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.382513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4defd-ff4a-4356-9993-fa650db1fad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.385675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4defd-ff4a-4356-9993-fa650db1fad2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.406359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 950/1946] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:27.408047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313012-dc86-4fcd-baf0-5a08250bec0a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.408988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313012-dc86-4fcd-baf0-5a08250bec0a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.409341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313012-dc86-4fcd-baf0-5a08250bec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.426748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 997/1947] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:27 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:27.427885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bdbbd-4306-48b9-905b-5dcb741f897d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.449608 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3a313012-dc86-4fcd-baf0-5a08250bec0a None None] MFA Rules not processed for user `d137315902174a859da3a058d3024496`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:27.451489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3a313012-dc86-4fcd-baf0-5a08250bec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:27.585688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bdbbd-4306-48b9-905b-5dcb741f897d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.598491 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 951/1948] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:27.599703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a313012-dc86-4fcd-baf0-5a08250bec0a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.603932 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ef0e4-560a-4281-8064-58dfbb5d393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.605355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ef0e4-560a-4281-8064-58dfbb5d393f admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.605649 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ef0e4-560a-4281-8064-58dfbb5d393f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.605993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ef0e4-560a-4281-8064-58dfbb5d393f admin admin] PATH_INFO: `/v3/projects/a635edaae74c42a08bb2d8339eab172b/users/cbf03b773235456b8e02f8150733f04a/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.610472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ef0e4-560a-4281-8064-58dfbb5d393f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a635edaae74c42a08bb2d8339eab172b, user_id=cbf03b773235456b8e02f8150733f04a, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.614121 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ef0e4-560a-4281-8064-58dfbb5d393f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.633086 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a313012-dc86-4fcd-baf0-5a08250bec0a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.635131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 998/1949] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:27 2022] PUT /identity/v3/projects/a635edaae74c42a08bb2d8339eab172b/users/cbf03b773235456b8e02f8150733f04a/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:27.636150 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ef0e4-560a-4281-8064-58dfbb5d393f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.638265 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-038ef0e4-560a-4281-8064-58dfbb5d393f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:27.717233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ef0e4-560a-4281-8064-58dfbb5d393f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.724467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eae5c8-5014-41e5-897c-c62f6f459aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.725275 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eae5c8-5014-41e5-897c-c62f6f459aca admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.725577 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eae5c8-5014-41e5-897c-c62f6f459aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.725870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eae5c8-5014-41e5-897c-c62f6f459aca admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.726691 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eae5c8-5014-41e5-897c-c62f6f459aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.728707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eae5c8-5014-41e5-897c-c62f6f459aca admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.739108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e59b6-1594-4fa6-8945-a029fe16ac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.739802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e59b6-1594-4fa6-8945-a029fe16ac56 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.740086 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e59b6-1594-4fa6-8945-a029fe16ac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.740363 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e59b6-1594-4fa6-8945-a029fe16ac56 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.740864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:27.741093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e59b6-1594-4fa6-8945-a029fe16ac56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.744226 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e59b6-1594-4fa6-8945-a029fe16ac56 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.768625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 999/1950] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:27 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:27.770425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694621f-4b33-4629-9aa1-591f0a3a9cfa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.770779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694621f-4b33-4629-9aa1-591f0a3a9cfa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.771293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694621f-4b33-4629-9aa1-591f0a3a9cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.784257 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 952/1951] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:27 2022] POST /identity/v3/users => generated 295 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:27.784257 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e59b6-1594-4fa6-8945-a029fe16ac56 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.796754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e59b6-1594-4fa6-8945-a029fe16ac56 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.804518 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1694621f-4b33-4629-9aa1-591f0a3a9cfa None None] MFA Rules not processed for user `cbf03b773235456b8e02f8150733f04a`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:27.806544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1694621f-4b33-4629-9aa1-591f0a3a9cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:27.839637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:27.866436 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf35c7-7c85-4e2f-9c00-74a349bdb671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.867152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf35c7-7c85-4e2f-9c00-74a349bdb671 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.867452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf35c7-7c85-4e2f-9c00-74a349bdb671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.867709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf35c7-7c85-4e2f-9c00-74a349bdb671 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.868517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf35c7-7c85-4e2f-9c00-74a349bdb671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.870864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf35c7-7c85-4e2f-9c00-74a349bdb671 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.885433 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1000/1952] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:27.886581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694621f-4b33-4629-9aa1-591f0a3a9cfa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.898815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694621f-4b33-4629-9aa1-591f0a3a9cfa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.899987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 953/1953] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:27 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:27.900905 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf35c7-7c85-4e2f-9c00-74a349bdb671 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.902488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6bbf35c7-7c85-4e2f-9c00-74a349bdb671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:27.904127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a996c33-13cc-4525-8e5e-fddae1096a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.904907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a996c33-13cc-4525-8e5e-fddae1096a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.905246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a996c33-13cc-4525-8e5e-fddae1096a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.905482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a996c33-13cc-4525-8e5e-fddae1096a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.906267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a996c33-13cc-4525-8e5e-fddae1096a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.907848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a996c33-13cc-4525-8e5e-fddae1096a1b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.922773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1001/1954] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:27.922773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a996c33-13cc-4525-8e5e-fddae1096a1b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.931354 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a996c33-13cc-4525-8e5e-fddae1096a1b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.936142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3bf52-e325-4ddb-9f54-8c16484b9e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.936852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3bf52-e325-4ddb-9f54-8c16484b9e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.937144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3bf52-e325-4ddb-9f54-8c16484b9e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.937423 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3bf52-e325-4ddb-9f54-8c16484b9e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.938149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3bf52-e325-4ddb-9f54-8c16484b9e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.940333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3bf52-e325-4ddb-9f54-8c16484b9e68 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.950755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1002/1955] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:27.951380 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3bf52-e325-4ddb-9f54-8c16484b9e68 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:27.962358 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3bf52-e325-4ddb-9f54-8c16484b9e68 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.966749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf35c7-7c85-4e2f-9c00-74a349bdb671 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:27.967436 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377be303-29c9-4d8e-b890-fa39957fe2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.968360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377be303-29c9-4d8e-b890-fa39957fe2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.968656 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377be303-29c9-4d8e-b890-fa39957fe2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.968937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377be303-29c9-4d8e-b890-fa39957fe2d2 admin admin] PATH_INFO: `/v3/projects/fd0ff74e2016423f9dda814820239ede/users/6e6a164c51424f629b2df26f608ac21f/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.970459 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac733a-f693-4d41-8ce0-9b583b48367b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:27.971671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac733a-f693-4d41-8ce0-9b583b48367b service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:27.972155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac733a-f693-4d41-8ce0-9b583b48367b service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:27.972501 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac733a-f693-4d41-8ce0-9b583b48367b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:27.982175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac733a-f693-4d41-8ce0-9b583b48367b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.983709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac733a-f693-4d41-8ce0-9b583b48367b service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.984798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377be303-29c9-4d8e-b890-fa39957fe2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0ff74e2016423f9dda814820239ede, user_id=6e6a164c51424f629b2df26f608ac21f, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:27.988666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377be303-29c9-4d8e-b890-fa39957fe2d2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:27.994419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 954/1956] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:27 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:27.995319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac733a-f693-4d41-8ce0-9b583b48367b service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:28.003854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1003/1957] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:27 2022] PUT /identity/v3/projects/fd0ff74e2016423f9dda814820239ede/users/6e6a164c51424f629b2df26f608ac21f/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:28.007202 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac733a-f693-4d41-8ce0-9b583b48367b service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:28.007535 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377be303-29c9-4d8e-b890-fa39957fe2d2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:28.074263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429be5c-5648-4880-bfa9-5c5d5c156737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:28.075246 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429be5c-5648-4880-bfa9-5c5d5c156737 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.075556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429be5c-5648-4880-bfa9-5c5d5c156737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.075770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429be5c-5648-4880-bfa9-5c5d5c156737 admin admin] PATH_INFO: `/v3/projects/b2f37298e2e34074aa43062e6575c62d/users/438c48d11f0149da87f3b4d3a83b4351/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.075877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377be303-29c9-4d8e-b890-fa39957fe2d2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:28.080652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d6a9d-4a4b-4b68-b159-309ddc1a082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:28.081332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d6a9d-4a4b-4b68-b159-309ddc1a082b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.081621 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d6a9d-4a4b-4b68-b159-309ddc1a082b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.081900 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d6a9d-4a4b-4b68-b159-309ddc1a082b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.082633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d6a9d-4a4b-4b68-b159-309ddc1a082b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:28.084258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d6a9d-4a4b-4b68-b159-309ddc1a082b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:28.090818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429be5c-5648-4880-bfa9-5c5d5c156737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f37298e2e34074aa43062e6575c62d, user_id=438c48d11f0149da87f3b4d3a83b4351, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:28.093534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429be5c-5648-4880-bfa9-5c5d5c156737 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:28.094427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1004/1958] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:37:28.095243 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d6a9d-4a4b-4b68-b159-309ddc1a082b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:28.099910 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d48d6a9d-4a4b-4b68-b159-309ddc1a082b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:28.110257 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 955/1959] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:27 2022] PUT /identity/v3/projects/b2f37298e2e34074aa43062e6575c62d/users/438c48d11f0149da87f3b4d3a83b4351/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:28.112653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429be5c-5648-4880-bfa9-5c5d5c156737 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:28.131422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:28.181585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d6a9d-4a4b-4b68-b159-309ddc1a082b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:28.189908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:28.195155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429be5c-5648-4880-bfa9-5c5d5c156737 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:28.201179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f224c2e-a204-45f6-be58-8dfe988a1d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:28.202221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f224c2e-a204-45f6-be58-8dfe988a1d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.202507 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f224c2e-a204-45f6-be58-8dfe988a1d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.202787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f224c2e-a204-45f6-be58-8dfe988a1d53 admin admin] PATH_INFO: `/v3/projects/fd0ff74e2016423f9dda814820239ede/users/6e6a164c51424f629b2df26f608ac21f/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.204831 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f224c2e-a204-45f6-be58-8dfe988a1d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0ff74e2016423f9dda814820239ede, user_id=6e6a164c51424f629b2df26f608ac21f, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:28.207683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f224c2e-a204-45f6-be58-8dfe988a1d53 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:28.218760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 956/1960] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:28 2022] PUT /identity/v3/projects/fd0ff74e2016423f9dda814820239ede/users/6e6a164c51424f629b2df26f608ac21f/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:28.219378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f224c2e-a204-45f6-be58-8dfe988a1d53 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:28.251359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38974-a796-4e16-9ba0-90c96b82918b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:28.252754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38974-a796-4e16-9ba0-90c96b82918b service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.254135 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38974-a796-4e16-9ba0-90c96b82918b service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.254462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38974-a796-4e16-9ba0-90c96b82918b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.309686 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f224c2e-a204-45f6-be58-8dfe988a1d53 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:28.314817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d1c9d-208f-40b4-8156-f7ae4b19162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:28.315501 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d1c9d-208f-40b4-8156-f7ae4b19162b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.315784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d1c9d-208f-40b4-8156-f7ae4b19162b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.316064 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d1c9d-208f-40b4-8156-f7ae4b19162b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.316839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d1c9d-208f-40b4-8156-f7ae4b19162b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:28.318532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d1c9d-208f-40b4-8156-f7ae4b19162b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:28.329061 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 957/1961] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:28.330666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd61e-3f43-4379-9b68-d46d22e05ad2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.330955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd61e-3f43-4379-9b68-d46d22e05ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.331234 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd61e-3f43-4379-9b68-d46d22e05ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.333732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f38974-a796-4e16-9ba0-90c96b82918b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:28.335965 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f38974-a796-4e16-9ba0-90c96b82918b service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:28.349019 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1005/1962] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:28.349688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38974-a796-4e16-9ba0-90c96b82918b service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:28.360701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ec2fd61e-3f43-4379-9b68-d46d22e05ad2 None None] MFA Rules not processed for user `6e6a164c51424f629b2df26f608ac21f`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:28.363454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ec2fd61e-3f43-4379-9b68-d46d22e05ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:28.379003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38974-a796-4e16-9ba0-90c96b82918b service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:28.401161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0b49-a8b1-4858-a8d1-5fb920773456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:28.402324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0b49-a8b1-4858-a8d1-5fb920773456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.403283 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0b49-a8b1-4858-a8d1-5fb920773456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.403698 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0b49-a8b1-4858-a8d1-5fb920773456 admin admin] PATH_INFO: `/v3/projects/b2f37298e2e34074aa43062e6575c62d/users/438c48d11f0149da87f3b4d3a83b4351/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.406984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0b49-a8b1-4858-a8d1-5fb920773456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f37298e2e34074aa43062e6575c62d, user_id=438c48d11f0149da87f3b4d3a83b4351, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:28.411274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0b49-a8b1-4858-a8d1-5fb920773456 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:28.437630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1006/1963] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:28 2022] PUT /identity/v3/projects/b2f37298e2e34074aa43062e6575c62d/users/438c48d11f0149da87f3b4d3a83b4351/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:28.465181 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 958/1964] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:28.477930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0b49-a8b1-4858-a8d1-5fb920773456 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:28.590962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0b49-a8b1-4858-a8d1-5fb920773456 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:28.601109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f84555-b056-49fc-840e-48c71a7732b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:28.601839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f84555-b056-49fc-840e-48c71a7732b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:28.602196 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f84555-b056-49fc-840e-48c71a7732b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:28.602424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f84555-b056-49fc-840e-48c71a7732b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:28.671593 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:28.710528 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f84555-b056-49fc-840e-48c71a7732b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:28.712206 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f84555-b056-49fc-840e-48c71a7732b4 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:28.723888 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1007/1965] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:29.518408 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288482bc-92e1-4d46-9c34-2e3eeb455992 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:29.519873 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288482bc-92e1-4d46-9c34-2e3eeb455992 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:29.521851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288482bc-92e1-4d46-9c34-2e3eeb455992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:29.588735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-288482bc-92e1-4d46-9c34-2e3eeb455992 None None] MFA Rules not processed for user `438c48d11f0149da87f3b4d3a83b4351`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:29.590471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-288482bc-92e1-4d46-9c34-2e3eeb455992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:29.671382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:29.685881 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 959/1966] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:29.697800 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f84555-b056-49fc-840e-48c71a7732b4 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:29.709581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f84555-b056-49fc-840e-48c71a7732b4 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:29.717281 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38f62f-1b13-4e42-8305-843c07db0faf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:29.718257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38f62f-1b13-4e42-8305-843c07db0faf service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:29.718945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38f62f-1b13-4e42-8305-843c07db0faf service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:29.719604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38f62f-1b13-4e42-8305-843c07db0faf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:29.790428 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38f62f-1b13-4e42-8305-843c07db0faf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:29.791899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38f62f-1b13-4e42-8305-843c07db0faf service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:29.803329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1008/1967] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:32.015105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288482bc-92e1-4d46-9c34-2e3eeb455992 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:32.084509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288482bc-92e1-4d46-9c34-2e3eeb455992 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:32.089891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25540164-8a79-4c02-be54-d5180c115cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:32.090872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25540164-8a79-4c02-be54-d5180c115cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.091234 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25540164-8a79-4c02-be54-d5180c115cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.091539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25540164-8a79-4c02-be54-d5180c115cbd admin admin] PATH_INFO: `/v3/users/3891a0ee8ec94115810cc9ed665cc97f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.092894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25540164-8a79-4c02-be54-d5180c115cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3891a0ee8ec94115810cc9ed665cc97f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:32.095026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25540164-8a79-4c02-be54-d5180c115cbd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:32.146476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-25540164-8a79-4c02-be54-d5180c115cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3891a0ee8ec94115810cc9ed665cc97f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.160290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-25540164-8a79-4c02-be54-d5180c115cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3891a0ee8ec94115810cc9ed665cc97f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.161113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-25540164-8a79-4c02-be54-d5180c115cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3891a0ee8ec94115810cc9ed665cc97f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.169451 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-25540164-8a79-4c02-be54-d5180c115cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3891a0ee8ec94115810cc9ed665cc97f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.170167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-25540164-8a79-4c02-be54-d5180c115cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3891a0ee8ec94115810cc9ed665cc97f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.188479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 960/1968] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:32 2022] DELETE /identity/v3/users/3891a0ee8ec94115810cc9ed665cc97f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:32.194506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995315-e135-4c47-b3e1-30c5ec3cfb74 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.194938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995315-e135-4c47-b3e1-30c5ec3cfb74 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.195025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995315-e135-4c47-b3e1-30c5ec3cfb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.216090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-13995315-e135-4c47-b3e1-30c5ec3cfb74 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:32.217794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-13995315-e135-4c47-b3e1-30c5ec3cfb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:32.282028 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1009/1969] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:32.289326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25540164-8a79-4c02-be54-d5180c115cbd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:32.290729 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-25540164-8a79-4c02-be54-d5180c115cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:32.353499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25540164-8a79-4c02-be54-d5180c115cbd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:32.357718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd9e43-c07a-4a6c-98ee-2b5f9d21b1f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:32.358395 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9e43-c07a-4a6c-98ee-2b5f9d21b1f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.358742 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9e43-c07a-4a6c-98ee-2b5f9d21b1f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.359052 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9e43-c07a-4a6c-98ee-2b5f9d21b1f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.370226 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd9e43-c07a-4a6c-98ee-2b5f9d21b1f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:32.371868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd9e43-c07a-4a6c-98ee-2b5f9d21b1f9 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:32.383125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 961/1970] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:32.701823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13995315-e135-4c47-b3e1-30c5ec3cfb74 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:32.703349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-13995315-e135-4c47-b3e1-30c5ec3cfb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:32.716969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13995315-e135-4c47-b3e1-30c5ec3cfb74 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:32.732331 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:32.733562 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.733854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.734136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] PATH_INFO: `/v3/projects/486e488f73f2414cac13112aa4dc7238` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.735393 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=486e488f73f2414cac13112aa4dc7238)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:32.740084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:32.795145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '486e488f73f2414cac13112aa4dc7238', 'request_id': 'req-712d08fa-dcd4-45a4-9ad9-b18d938667b7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.802037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '486e488f73f2414cac13112aa4dc7238', 'request_id': 'req-712d08fa-dcd4-45a4-9ad9-b18d938667b7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.807805 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '486e488f73f2414cac13112aa4dc7238', 'request_id': 'req-712d08fa-dcd4-45a4-9ad9-b18d938667b7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.816629 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:32.822058 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] The token cache is being invalidate because project 486e488f73f2414cac13112aa4dc7238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:32.822415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.823334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.825666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1010/1971] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:32 2022] DELETE /identity/v3/projects/486e488f73f2414cac13112aa4dc7238 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:32.829665 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd9e43-c07a-4a6c-98ee-2b5f9d21b1f9 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:32.841674 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd9e43-c07a-4a6c-98ee-2b5f9d21b1f9 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:32.856711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:32.907694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a979a9-f188-45da-ba83-bf0d71da40c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:32.909344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a979a9-f188-45da-ba83-bf0d71da40c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:32.909635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a979a9-f188-45da-ba83-bf0d71da40c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:32.909918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a979a9-f188-45da-ba83-bf0d71da40c5 admin admin] PATH_INFO: `/v3/users/cbf03b773235456b8e02f8150733f04a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:32.911121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a979a9-f188-45da-ba83-bf0d71da40c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbf03b773235456b8e02f8150733f04a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:32.913220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a979a9-f188-45da-ba83-bf0d71da40c5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:32.964013 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a5a979a9-f188-45da-ba83-bf0d71da40c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbf03b773235456b8e02f8150733f04a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.976625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a5a979a9-f188-45da-ba83-bf0d71da40c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbf03b773235456b8e02f8150733f04a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.977320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a5a979a9-f188-45da-ba83-bf0d71da40c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbf03b773235456b8e02f8150733f04a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.984306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a5a979a9-f188-45da-ba83-bf0d71da40c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbf03b773235456b8e02f8150733f04a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.984970 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a5a979a9-f188-45da-ba83-bf0d71da40c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbf03b773235456b8e02f8150733f04a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:32.998345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 962/1972] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:32 2022] DELETE /identity/v3/users/cbf03b773235456b8e02f8150733f04a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:33.287014 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:33.289004 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:33.305646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d08fa-dcd4-45a4-9ad9-b18d938667b7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:33.375748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed608b-0b54-4850-9dcc-fabbc3f61896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:33.376803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed608b-0b54-4850-9dcc-fabbc3f61896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.377796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed608b-0b54-4850-9dcc-fabbc3f61896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.378085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed608b-0b54-4850-9dcc-fabbc3f61896 admin admin] PATH_INFO: `/v3/projects/a635edaae74c42a08bb2d8339eab172b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.379536 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed608b-0b54-4850-9dcc-fabbc3f61896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a635edaae74c42a08bb2d8339eab172b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:33.381922 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed608b-0b54-4850-9dcc-fabbc3f61896 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:33.438479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c3ed608b-0b54-4850-9dcc-fabbc3f61896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a635edaae74c42a08bb2d8339eab172b', 'request_id': 'req-c3ed608b-0b54-4850-9dcc-fabbc3f61896'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:33.451882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c3ed608b-0b54-4850-9dcc-fabbc3f61896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a635edaae74c42a08bb2d8339eab172b', 'request_id': 'req-c3ed608b-0b54-4850-9dcc-fabbc3f61896'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:33.463879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c3ed608b-0b54-4850-9dcc-fabbc3f61896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a635edaae74c42a08bb2d8339eab172b', 'request_id': 'req-c3ed608b-0b54-4850-9dcc-fabbc3f61896'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:33.489278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c3ed608b-0b54-4850-9dcc-fabbc3f61896 admin admin] The token cache is being invalidate because project a635edaae74c42a08bb2d8339eab172b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:33.489615 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c3ed608b-0b54-4850-9dcc-fabbc3f61896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:33.491632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c3ed608b-0b54-4850-9dcc-fabbc3f61896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:33.493439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1011/1973] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:33 2022] DELETE /identity/v3/projects/a635edaae74c42a08bb2d8339eab172b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:33.498691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f04569-3b64-4536-8c50-33959449e531 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.499237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f04569-3b64-4536-8c50-33959449e531 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.499431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f04569-3b64-4536-8c50-33959449e531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.525935 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-73f04569-3b64-4536-8c50-33959449e531 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:33.527185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-73f04569-3b64-4536-8c50-33959449e531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:33.604305 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 963/1974] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:33.609053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a614a-af63-4401-a140-7fd9109fa169 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.609350 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a614a-af63-4401-a140-7fd9109fa169 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.609631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a614a-af63-4401-a140-7fd9109fa169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.628020 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-dc9a614a-af63-4401-a140-7fd9109fa169 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:33.629259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dc9a614a-af63-4401-a140-7fd9109fa169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:33.637091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1012/1975] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:33.641298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f04569-3b64-4536-8c50-33959449e531 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:33.651710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f04569-3b64-4536-8c50-33959449e531 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:33.656229 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a32c3-a0ec-4d97-a1f0-553d8d115680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:33.656915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a32c3-a0ec-4d97-a1f0-553d8d115680 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.657195 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a32c3-a0ec-4d97-a1f0-553d8d115680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.657469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a32c3-a0ec-4d97-a1f0-553d8d115680 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.658824 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a32c3-a0ec-4d97-a1f0-553d8d115680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:33.659126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a32c3-a0ec-4d97-a1f0-553d8d115680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:33.660744 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a32c3-a0ec-4d97-a1f0-553d8d115680 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:33.672552 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 964/1976] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:33.677029 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a614a-af63-4401-a140-7fd9109fa169 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:33.686218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a614a-af63-4401-a140-7fd9109fa169 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:33.690960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94f001-a66b-4e47-b9d9-224b8155dc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:33.691610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94f001-a66b-4e47-b9d9-224b8155dc9a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.691897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94f001-a66b-4e47-b9d9-224b8155dc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.692177 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94f001-a66b-4e47-b9d9-224b8155dc9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.692917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94f001-a66b-4e47-b9d9-224b8155dc9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:33.694821 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94f001-a66b-4e47-b9d9-224b8155dc9a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:33.723979 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1013/1977] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:33 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:33.728096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a32c3-a0ec-4d97-a1f0-553d8d115680 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:33.738435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a32c3-a0ec-4d97-a1f0-553d8d115680 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:33.760476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:33.799282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abd955-ca4a-4b0a-9c8c-e0ac1672dc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:33.799961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abd955-ca4a-4b0a-9c8c-e0ac1672dc8c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.800236 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abd955-ca4a-4b0a-9c8c-e0ac1672dc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.800544 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abd955-ca4a-4b0a-9c8c-e0ac1672dc8c admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.801244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abd955-ca4a-4b0a-9c8c-e0ac1672dc8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:33.803154 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abd955-ca4a-4b0a-9c8c-e0ac1672dc8c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:33.827181 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 965/1978] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:33 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:33.828454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94f001-a66b-4e47-b9d9-224b8155dc9a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:33.839117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94f001-a66b-4e47-b9d9-224b8155dc9a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:33.843793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361ae2c-1510-4f3c-98f0-ac2d89542b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:33.844489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361ae2c-1510-4f3c-98f0-ac2d89542b2e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.844776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361ae2c-1510-4f3c-98f0-ac2d89542b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.845079 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361ae2c-1510-4f3c-98f0-ac2d89542b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.846132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361ae2c-1510-4f3c-98f0-ac2d89542b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:33.847782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361ae2c-1510-4f3c-98f0-ac2d89542b2e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:33.863143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1014/1979] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:33.864420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abd955-ca4a-4b0a-9c8c-e0ac1672dc8c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:33.874522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abd955-ca4a-4b0a-9c8c-e0ac1672dc8c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:33.879830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60ed48-4da1-4d13-859c-60878ed31d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:33.880535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60ed48-4da1-4d13-859c-60878ed31d09 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.880826 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60ed48-4da1-4d13-859c-60878ed31d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.881104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60ed48-4da1-4d13-859c-60878ed31d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.882085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60ed48-4da1-4d13-859c-60878ed31d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:33.883650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60ed48-4da1-4d13-859c-60878ed31d09 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:33.895465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 966/1980] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:33.899950 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361ae2c-1510-4f3c-98f0-ac2d89542b2e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:33.911913 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361ae2c-1510-4f3c-98f0-ac2d89542b2e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:33.916575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dffa9-dc51-4095-8e2e-08e5bb2f3144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:33.917729 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dffa9-dc51-4095-8e2e-08e5bb2f3144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.918013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dffa9-dc51-4095-8e2e-08e5bb2f3144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.918300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dffa9-dc51-4095-8e2e-08e5bb2f3144 admin admin] PATH_INFO: `/v3/projects/c4f4d44f05f548ddb68c74954ef5cb97/users/d41965f8df484554b03360006633252d/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.936144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dffa9-dc51-4095-8e2e-08e5bb2f3144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f4d44f05f548ddb68c74954ef5cb97, user_id=d41965f8df484554b03360006633252d, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:33.938883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dffa9-dc51-4095-8e2e-08e5bb2f3144 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:33.953522 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1015/1981] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:33 2022] PUT /identity/v3/projects/c4f4d44f05f548ddb68c74954ef5cb97/users/d41965f8df484554b03360006633252d/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:33.964249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eab7d-52a8-418e-8e29-e2e0607fd852 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:33.964578 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eab7d-52a8-418e-8e29-e2e0607fd852 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:33.964866 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eab7d-52a8-418e-8e29-e2e0607fd852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:33.992872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1e6eab7d-52a8-418e-8e29-e2e0607fd852 None None] MFA Rules not processed for user `d41965f8df484554b03360006633252d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:33.994083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1e6eab7d-52a8-418e-8e29-e2e0607fd852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:34.057183 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 967/1982] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:34.061709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dffa9-dc51-4095-8e2e-08e5bb2f3144 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:34.089020 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:34.126424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dffa9-dc51-4095-8e2e-08e5bb2f3144 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:34.131248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b448e-effd-4af7-84d4-c8829fb950a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:34.131908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b448e-effd-4af7-84d4-c8829fb950a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:34.132200 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b448e-effd-4af7-84d4-c8829fb950a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:34.132514 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b448e-effd-4af7-84d4-c8829fb950a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:34.133219 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b448e-effd-4af7-84d4-c8829fb950a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:34.135135 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b448e-effd-4af7-84d4-c8829fb950a6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:34.160168 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1016/1983] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:34 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:34.164244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6eab7d-52a8-418e-8e29-e2e0607fd852 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:34.175886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6eab7d-52a8-418e-8e29-e2e0607fd852 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:34.230161 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e96ca4-a2ed-4c58-a8ec-e23038c00ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:34.230874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e96ca4-a2ed-4c58-a8ec-e23038c00ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:34.231166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e96ca4-a2ed-4c58-a8ec-e23038c00ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:34.231449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e96ca4-a2ed-4c58-a8ec-e23038c00ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:34.232151 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e96ca4-a2ed-4c58-a8ec-e23038c00ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:34.234166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e96ca4-a2ed-4c58-a8ec-e23038c00ac4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:34.258086 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 968/1984] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:34 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:34.262351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b448e-effd-4af7-84d4-c8829fb950a6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:34.274965 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b448e-effd-4af7-84d4-c8829fb950a6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:34.279648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d2769-1ff4-41cc-ac62-9c6f3e79123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:34.280310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d2769-1ff4-41cc-ac62-9c6f3e79123d admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:34.280627 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d2769-1ff4-41cc-ac62-9c6f3e79123d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:34.280909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d2769-1ff4-41cc-ac62-9c6f3e79123d admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:34.281631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d2769-1ff4-41cc-ac62-9c6f3e79123d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:34.283842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d2769-1ff4-41cc-ac62-9c6f3e79123d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:34.294640 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1017/1985] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:34.299372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e96ca4-a2ed-4c58-a8ec-e23038c00ac4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:34.310001 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e96ca4-a2ed-4c58-a8ec-e23038c00ac4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:34.314665 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81fb20-12e5-48dc-b596-5eca79647864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:34.315337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81fb20-12e5-48dc-b596-5eca79647864 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:34.315737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81fb20-12e5-48dc-b596-5eca79647864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:34.315895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81fb20-12e5-48dc-b596-5eca79647864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:34.316660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81fb20-12e5-48dc-b596-5eca79647864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:34.318266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81fb20-12e5-48dc-b596-5eca79647864 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:34.330428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 969/1986] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:34.335886 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d2769-1ff4-41cc-ac62-9c6f3e79123d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:34.348183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d2769-1ff4-41cc-ac62-9c6f3e79123d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:34.353535 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c471dff-3155-4dff-a25c-ef9e714db1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:34.354427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c471dff-3155-4dff-a25c-ef9e714db1cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:34.354711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c471dff-3155-4dff-a25c-ef9e714db1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:34.355072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c471dff-3155-4dff-a25c-ef9e714db1cb admin admin] PATH_INFO: `/v3/projects/768850394cbb4b44a193fa783a562400/users/9d32ecbe783f4e28ace28afc34bf425c/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:34.374861 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c471dff-3155-4dff-a25c-ef9e714db1cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=768850394cbb4b44a193fa783a562400, user_id=9d32ecbe783f4e28ace28afc34bf425c, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:34.377742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c471dff-3155-4dff-a25c-ef9e714db1cb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:34.391673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1018/1987] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:34 2022] PUT /identity/v3/projects/768850394cbb4b44a193fa783a562400/users/9d32ecbe783f4e28ace28afc34bf425c/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:34.404326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80031ac4-e65e-4983-a79b-77abc531891c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:34.404645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80031ac4-e65e-4983-a79b-77abc531891c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:34.404923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80031ac4-e65e-4983-a79b-77abc531891c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:34.424650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:34.432421 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-80031ac4-e65e-4983-a79b-77abc531891c None None] MFA Rules not processed for user `9d32ecbe783f4e28ace28afc34bf425c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:34.433954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-80031ac4-e65e-4983-a79b-77abc531891c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:34.499295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 970/1988] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:34.510274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c471dff-3155-4dff-a25c-ef9e714db1cb admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:34.578955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c471dff-3155-4dff-a25c-ef9e714db1cb admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:34.584644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c923e-1e6d-4efd-a201-d9dd04d76adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:34.585470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c923e-1e6d-4efd-a201-d9dd04d76adb admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:34.585603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c923e-1e6d-4efd-a201-d9dd04d76adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:34.585865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c923e-1e6d-4efd-a201-d9dd04d76adb admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:34.586560 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c923e-1e6d-4efd-a201-d9dd04d76adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:34.588491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c923e-1e6d-4efd-a201-d9dd04d76adb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:34.618748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1019/1989] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:34 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:34.622675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80031ac4-e65e-4983-a79b-77abc531891c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:34.634764 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80031ac4-e65e-4983-a79b-77abc531891c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:34.701135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073e6c9-805d-40df-bbfa-59b4e590ae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:34.701823 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073e6c9-805d-40df-bbfa-59b4e590ae20 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:34.702108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073e6c9-805d-40df-bbfa-59b4e590ae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:34.702387 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073e6c9-805d-40df-bbfa-59b4e590ae20 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:34.703086 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073e6c9-805d-40df-bbfa-59b4e590ae20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:34.705816 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073e6c9-805d-40df-bbfa-59b4e590ae20 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:34.733351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c923e-1e6d-4efd-a201-d9dd04d76adb admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:34.733764 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 971/1990] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:34 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:34.744672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c923e-1e6d-4efd-a201-d9dd04d76adb admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:34.749626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325fee8-31ec-4f14-b379-e0f083e78c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:34.750302 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325fee8-31ec-4f14-b379-e0f083e78c2f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:34.750588 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325fee8-31ec-4f14-b379-e0f083e78c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:34.750867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325fee8-31ec-4f14-b379-e0f083e78c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:34.752171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325fee8-31ec-4f14-b379-e0f083e78c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:34.753849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325fee8-31ec-4f14-b379-e0f083e78c2f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:34.766197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1020/1991] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:34.771398 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073e6c9-805d-40df-bbfa-59b4e590ae20 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:34.781535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073e6c9-805d-40df-bbfa-59b4e590ae20 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:34.786362 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dc564-214c-493e-ad06-dfa5c65992a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:34.787259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dc564-214c-493e-ad06-dfa5c65992a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:34.787542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dc564-214c-493e-ad06-dfa5c65992a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:34.787814 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dc564-214c-493e-ad06-dfa5c65992a6 admin admin] PATH_INFO: `/v3/projects/158f902882564fb9bfae960184ff548d/users/d1263abbb314412b8ae607eb1bd98881/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:34.807084 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dc564-214c-493e-ad06-dfa5c65992a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=158f902882564fb9bfae960184ff548d, user_id=d1263abbb314412b8ae607eb1bd98881, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:34.809871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dc564-214c-493e-ad06-dfa5c65992a6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:34.824832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 972/1992] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:34 2022] PUT /identity/v3/projects/158f902882564fb9bfae960184ff548d/users/d1263abbb314412b8ae607eb1bd98881/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:34.830390 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325fee8-31ec-4f14-b379-e0f083e78c2f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:34.841208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325fee8-31ec-4f14-b379-e0f083e78c2f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:34.890718 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:34.909929 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adee6b-a81e-4873-850f-3de5b0c764ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:34.911029 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adee6b-a81e-4873-850f-3de5b0c764ad admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:34.911754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adee6b-a81e-4873-850f-3de5b0c764ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:34.912109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adee6b-a81e-4873-850f-3de5b0c764ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:34.913072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adee6b-a81e-4873-850f-3de5b0c764ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:34.915205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adee6b-a81e-4873-850f-3de5b0c764ad admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:34.929927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1021/1993] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:34.934185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dc564-214c-493e-ad06-dfa5c65992a6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:34.944900 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dc564-214c-493e-ad06-dfa5c65992a6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:34.949474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472df76-56f4-4618-8a6b-f901a85f9920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:34.950371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472df76-56f4-4618-8a6b-f901a85f9920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:34.950649 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472df76-56f4-4618-8a6b-f901a85f9920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:34.950921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472df76-56f4-4618-8a6b-f901a85f9920 admin admin] PATH_INFO: `/v3/projects/158f902882564fb9bfae960184ff548d/users/d1263abbb314412b8ae607eb1bd98881/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:34.953046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472df76-56f4-4618-8a6b-f901a85f9920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=158f902882564fb9bfae960184ff548d, user_id=d1263abbb314412b8ae607eb1bd98881, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:34.956550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472df76-56f4-4618-8a6b-f901a85f9920 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:34.966811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 973/1994] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:34 2022] PUT /identity/v3/projects/158f902882564fb9bfae960184ff548d/users/d1263abbb314412b8ae607eb1bd98881/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:34.977339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74385d-41da-4005-8f81-8104d0975d43 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:34.977736 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74385d-41da-4005-8f81-8104d0975d43 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:34.978349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74385d-41da-4005-8f81-8104d0975d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:35.006115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0d74385d-41da-4005-8f81-8104d0975d43 None None] MFA Rules not processed for user `d1263abbb314412b8ae607eb1bd98881`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:35.007341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0d74385d-41da-4005-8f81-8104d0975d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:35.079069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1022/1995] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:35.090504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472df76-56f4-4618-8a6b-f901a85f9920 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:35.092223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7472df76-56f4-4618-8a6b-f901a85f9920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:35.150680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472df76-56f4-4618-8a6b-f901a85f9920 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:35.154348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3a051-daad-441a-8af0-20719bc3b8c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:35.154997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a051-daad-441a-8af0-20719bc3b8c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:35.155279 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a051-daad-441a-8af0-20719bc3b8c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:35.155680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a051-daad-441a-8af0-20719bc3b8c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:35.162779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:35.165377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3a051-daad-441a-8af0-20719bc3b8c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:35.167597 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3a051-daad-441a-8af0-20719bc3b8c4 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:35.179435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 974/1996] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:35.724367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74385d-41da-4005-8f81-8104d0975d43 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:35.726504 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0d74385d-41da-4005-8f81-8104d0975d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:35.739895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74385d-41da-4005-8f81-8104d0975d43 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:35.743521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32b041-6a84-452a-9b2b-ebe5950e752b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:35.744182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32b041-6a84-452a-9b2b-ebe5950e752b service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:35.744511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32b041-6a84-452a-9b2b-ebe5950e752b service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:35.744795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32b041-6a84-452a-9b2b-ebe5950e752b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:35.822760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32b041-6a84-452a-9b2b-ebe5950e752b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:35.822760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32b041-6a84-452a-9b2b-ebe5950e752b service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:35.830896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1023/1997] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:36.460601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d5475-f2b4-464e-b1f4-65b2cd3cabb5 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.460601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d5475-f2b4-464e-b1f4-65b2cd3cabb5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.460601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d5475-f2b4-464e-b1f4-65b2cd3cabb5 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.460601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 975/1998] 10.222.0.66 () {54 vars in 921 bytes} [Fri Jul 15 20:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:37:36.470023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be1c0f-8474-4b29-a6b0-cb22acffff8d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.471094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be1c0f-8474-4b29-a6b0-cb22acffff8d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.471488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be1c0f-8474-4b29-a6b0-cb22acffff8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.501383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c0be1c0f-8474-4b29-a6b0-cb22acffff8d None None] MFA Rules not processed for user `b042da9298894712a0a29787a343bf85`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:36.502769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c0be1c0f-8474-4b29-a6b0-cb22acffff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:36.504788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d5475-f2b4-464e-b1f4-65b2cd3cabb5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:36.515728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d5475-f2b4-464e-b1f4-65b2cd3cabb5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:36.521693 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf232d4-6ad8-4285-9872-dfb4308d6fd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:36.522383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf232d4-6ad8-4285-9872-dfb4308d6fd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.522776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf232d4-6ad8-4285-9872-dfb4308d6fd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.523076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf232d4-6ad8-4285-9872-dfb4308d6fd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.525155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3cf232d4-6ad8-4285-9872-dfb4308d6fd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:36.581609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:36.593413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1024/1999] 10.222.0.66 () {58 vars in 1018 bytes} [Fri Jul 15 20:37:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:36.602586 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf232d4-6ad8-4285-9872-dfb4308d6fd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:36.603969 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf232d4-6ad8-4285-9872-dfb4308d6fd1 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:36.616411 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be1c0f-8474-4b29-a6b0-cb22acffff8d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:36.618829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 976/2000] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:37:36.618969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c0be1c0f-8474-4b29-a6b0-cb22acffff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:36.635589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be1c0f-8474-4b29-a6b0-cb22acffff8d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:36.643307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46725b-70a0-4fc8-8f10-8bbea7810194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:36.643977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46725b-70a0-4fc8-8f10-8bbea7810194 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:36.644382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46725b-70a0-4fc8-8f10-8bbea7810194 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:36.645296 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46725b-70a0-4fc8-8f10-8bbea7810194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:36.655971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46725b-70a0-4fc8-8f10-8bbea7810194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:36.657899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46725b-70a0-4fc8-8f10-8bbea7810194 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:36.670760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1025/2001] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:37:41.310298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf232d4-6ad8-4285-9872-dfb4308d6fd1 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:41.317250 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3cf232d4-6ad8-4285-9872-dfb4308d6fd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:41.364603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46725b-70a0-4fc8-8f10-8bbea7810194 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:41.376340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46725b-70a0-4fc8-8f10-8bbea7810194 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.382187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db432e-70ee-42dc-939a-9bdb257cffd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.383056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db432e-70ee-42dc-939a-9bdb257cffd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.383504 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db432e-70ee-42dc-939a-9bdb257cffd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.383830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db432e-70ee-42dc-939a-9bdb257cffd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.385795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-71db432e-70ee-42dc-939a-9bdb257cffd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:41.396250 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf232d4-6ad8-4285-9872-dfb4308d6fd1 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.401767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2432e-6700-4945-917c-46d597c2f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.402646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2432e-6700-4945-917c-46d597c2f5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.402927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2432e-6700-4945-917c-46d597c2f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.403200 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2432e-6700-4945-917c-46d597c2f5e4 admin admin] PATH_INFO: `/v3/users/6086037b56e1480fbb50d0203976850a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.404410 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2432e-6700-4945-917c-46d597c2f5e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6086037b56e1480fbb50d0203976850a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.406507 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2432e-6700-4945-917c-46d597c2f5e4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:41.461783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db432e-70ee-42dc-939a-9bdb257cffd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.463688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db432e-70ee-42dc-939a-9bdb257cffd8 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:41.473462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1e2432e-6700-4945-917c-46d597c2f5e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6086037b56e1480fbb50d0203976850a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:41.476903 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1026/2002] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:37:41.492928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1e2432e-6700-4945-917c-46d597c2f5e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6086037b56e1480fbb50d0203976850a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:41.493998 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1e2432e-6700-4945-917c-46d597c2f5e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6086037b56e1480fbb50d0203976850a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:41.503161 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1e2432e-6700-4945-917c-46d597c2f5e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6086037b56e1480fbb50d0203976850a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:41.503987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1e2432e-6700-4945-917c-46d597c2f5e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6086037b56e1480fbb50d0203976850a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:41.520330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 977/2003] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:41 2022] DELETE /identity/v3/users/6086037b56e1480fbb50d0203976850a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:41.525363 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf81319-e68a-49f4-b0be-dcb14b544dea None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.525721 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf81319-e68a-49f4-b0be-dcb14b544dea None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.526009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf81319-e68a-49f4-b0be-dcb14b544dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.547282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9bf81319-e68a-49f4-b0be-dcb14b544dea None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:41.548774 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9bf81319-e68a-49f4-b0be-dcb14b544dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:41.619658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1027/2004] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:41.629408 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2432e-6700-4945-917c-46d597c2f5e4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:41.630827 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c1e2432e-6700-4945-917c-46d597c2f5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:41.644850 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:41.704820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2432e-6700-4945-917c-46d597c2f5e4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:41.709245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2bc43-27c3-4565-b5bf-2ba2011e8ad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:41.711402 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2bc43-27c3-4565-b5bf-2ba2011e8ad5 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:41.711696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2bc43-27c3-4565-b5bf-2ba2011e8ad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:41.712090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2bc43-27c3-4565-b5bf-2ba2011e8ad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:41.731090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2bc43-27c3-4565-b5bf-2ba2011e8ad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:41.732645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2bc43-27c3-4565-b5bf-2ba2011e8ad5 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:41.748579 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 978/2005] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:42.107490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf81319-e68a-49f4-b0be-dcb14b544dea None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:42.109192 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9bf81319-e68a-49f4-b0be-dcb14b544dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:42.134183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf81319-e68a-49f4-b0be-dcb14b544dea None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:42.139050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:42.139784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:42.140067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:42.140341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] PATH_INFO: `/v3/projects/9cccac33571645499cdd9c45a311a98d` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:42.141590 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cccac33571645499cdd9c45a311a98d)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:42.143777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:42.235157 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cccac33571645499cdd9c45a311a98d', 'request_id': 'req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:42.248759 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cccac33571645499cdd9c45a311a98d', 'request_id': 'req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:42.259638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cccac33571645499cdd9c45a311a98d', 'request_id': 'req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:42.291401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] The token cache is being invalidate because project 9cccac33571645499cdd9c45a311a98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:42.292341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:42.293086 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:42.295077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1028/2006] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:42 2022] DELETE /identity/v3/projects/9cccac33571645499cdd9c45a311a98d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:42.300005 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2bc43-27c3-4565-b5bf-2ba2011e8ad5 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:42.310008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2bc43-27c3-4565-b5bf-2ba2011e8ad5 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:42.561284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9039591-1182-427b-93ed-4c69767a6461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:42.563465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9039591-1182-427b-93ed-4c69767a6461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:42.563756 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9039591-1182-427b-93ed-4c69767a6461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:42.564788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9039591-1182-427b-93ed-4c69767a6461 admin admin] PATH_INFO: `/v3/users/793f2a6c6f8e4e12a6a6c2035ca27938` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:42.566203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9039591-1182-427b-93ed-4c69767a6461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=793f2a6c6f8e4e12a6a6c2035ca27938)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:42.568175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9039591-1182-427b-93ed-4c69767a6461 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:42.639599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f9039591-1182-427b-93ed-4c69767a6461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '793f2a6c6f8e4e12a6a6c2035ca27938'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:42.654689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f9039591-1182-427b-93ed-4c69767a6461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '793f2a6c6f8e4e12a6a6c2035ca27938'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:42.655474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f9039591-1182-427b-93ed-4c69767a6461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '793f2a6c6f8e4e12a6a6c2035ca27938'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:42.663705 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f9039591-1182-427b-93ed-4c69767a6461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '793f2a6c6f8e4e12a6a6c2035ca27938'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:42.664415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f9039591-1182-427b-93ed-4c69767a6461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '793f2a6c6f8e4e12a6a6c2035ca27938'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:42.679474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 979/2007] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:42 2022] DELETE /identity/v3/users/793f2a6c6f8e4e12a6a6c2035ca27938 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:42.985377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:42.987730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:42.997699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:43.003116 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1defce-7c84-4cb2-a05f-558a2a7cffc4 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.063808 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d82bf1-800b-4ec7-834a-3763a93a23b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.064716 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d82bf1-800b-4ec7-834a-3763a93a23b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.065001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d82bf1-800b-4ec7-834a-3763a93a23b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.065274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d82bf1-800b-4ec7-834a-3763a93a23b6 admin admin] PATH_INFO: `/v3/projects/86aa32ffa93942678396a8428a4bf7c0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.066722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d82bf1-800b-4ec7-834a-3763a93a23b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86aa32ffa93942678396a8428a4bf7c0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.068701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d82bf1-800b-4ec7-834a-3763a93a23b6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.119128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a3d82bf1-800b-4ec7-834a-3763a93a23b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86aa32ffa93942678396a8428a4bf7c0', 'request_id': 'req-a3d82bf1-800b-4ec7-834a-3763a93a23b6'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:43.125584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a3d82bf1-800b-4ec7-834a-3763a93a23b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86aa32ffa93942678396a8428a4bf7c0', 'request_id': 'req-a3d82bf1-800b-4ec7-834a-3763a93a23b6'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:43.132115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a3d82bf1-800b-4ec7-834a-3763a93a23b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86aa32ffa93942678396a8428a4bf7c0', 'request_id': 'req-a3d82bf1-800b-4ec7-834a-3763a93a23b6'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:43.144611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a3d82bf1-800b-4ec7-834a-3763a93a23b6 admin admin] The token cache is being invalidate because project 86aa32ffa93942678396a8428a4bf7c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:43.144903 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a3d82bf1-800b-4ec7-834a-3763a93a23b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:43.145552 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a3d82bf1-800b-4ec7-834a-3763a93a23b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:43.147090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1029/2008] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:42 2022] DELETE /identity/v3/projects/86aa32ffa93942678396a8428a4bf7c0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:43.152153 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac956d37-5ec9-42fa-9bff-28deac65ed41 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.152566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac956d37-5ec9-42fa-9bff-28deac65ed41 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.152851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac956d37-5ec9-42fa-9bff-28deac65ed41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.172043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ac956d37-5ec9-42fa-9bff-28deac65ed41 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:43.173863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ac956d37-5ec9-42fa-9bff-28deac65ed41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:43.201786 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:43.237699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 980/2009] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:43.246281 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef43c5-c037-476c-bf0a-f3d9babe1512 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.246582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef43c5-c037-476c-bf0a-f3d9babe1512 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.246887 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef43c5-c037-476c-bf0a-f3d9babe1512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.266520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f8ef43c5-c037-476c-bf0a-f3d9babe1512 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:43.267938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f8ef43c5-c037-476c-bf0a-f3d9babe1512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:43.275983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1030/2010] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:43.280297 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac956d37-5ec9-42fa-9bff-28deac65ed41 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.290648 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac956d37-5ec9-42fa-9bff-28deac65ed41 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.295509 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc9422-597a-4056-a781-e7366cd5797e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.296197 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc9422-597a-4056-a781-e7366cd5797e admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.296521 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc9422-597a-4056-a781-e7366cd5797e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.296807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc9422-597a-4056-a781-e7366cd5797e admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.297536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc9422-597a-4056-a781-e7366cd5797e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:43.297848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc9422-597a-4056-a781-e7366cd5797e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.300172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc9422-597a-4056-a781-e7366cd5797e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.311730 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 981/2011] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:43.316185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef43c5-c037-476c-bf0a-f3d9babe1512 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.326643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef43c5-c037-476c-bf0a-f3d9babe1512 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.332518 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51661f1-257c-49da-9e70-9e7d4f5d423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.333171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51661f1-257c-49da-9e70-9e7d4f5d423d admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.333451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51661f1-257c-49da-9e70-9e7d4f5d423d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.333724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51661f1-257c-49da-9e70-9e7d4f5d423d admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.334408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51661f1-257c-49da-9e70-9e7d4f5d423d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.336338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51661f1-257c-49da-9e70-9e7d4f5d423d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.363554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1031/2012] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:43 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:43.367895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc9422-597a-4056-a781-e7366cd5797e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.378785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc9422-597a-4056-a781-e7366cd5797e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.437447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091c1de-4f8d-457d-81bd-b235c65ef270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.438127 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091c1de-4f8d-457d-81bd-b235c65ef270 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.438415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091c1de-4f8d-457d-81bd-b235c65ef270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.438699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091c1de-4f8d-457d-81bd-b235c65ef270 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.439873 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091c1de-4f8d-457d-81bd-b235c65ef270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.441861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091c1de-4f8d-457d-81bd-b235c65ef270 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.463286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 982/2013] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:43 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:43.467642 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51661f1-257c-49da-9e70-9e7d4f5d423d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.478780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51661f1-257c-49da-9e70-9e7d4f5d423d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.483502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407a4ad-ad01-4898-a726-14fcc7800612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.484171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a4ad-ad01-4898-a726-14fcc7800612 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.484513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a4ad-ad01-4898-a726-14fcc7800612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.484771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a4ad-ad01-4898-a726-14fcc7800612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.485530 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407a4ad-ad01-4898-a726-14fcc7800612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.487164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407a4ad-ad01-4898-a726-14fcc7800612 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.497738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1032/2014] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:43.501748 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091c1de-4f8d-457d-81bd-b235c65ef270 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.511889 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091c1de-4f8d-457d-81bd-b235c65ef270 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.516497 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac273c-7c24-46e1-84ce-d08845d7f0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.517746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac273c-7c24-46e1-84ce-d08845d7f0de admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.518088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac273c-7c24-46e1-84ce-d08845d7f0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.518373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac273c-7c24-46e1-84ce-d08845d7f0de admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.519098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac273c-7c24-46e1-84ce-d08845d7f0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.520718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac273c-7c24-46e1-84ce-d08845d7f0de admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.530808 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 983/2015] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:43.535454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407a4ad-ad01-4898-a726-14fcc7800612 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.545544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407a4ad-ad01-4898-a726-14fcc7800612 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.550317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba96084-33dd-4cce-a988-5974d9470892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.551212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba96084-33dd-4cce-a988-5974d9470892 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.551497 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba96084-33dd-4cce-a988-5974d9470892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.551772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba96084-33dd-4cce-a988-5974d9470892 admin admin] PATH_INFO: `/v3/projects/b7c2d8ee3cd749d98dcc46dbaaf1e0c8/users/c86f5fa47ae14fe18cb35175f61fe690/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.567425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba96084-33dd-4cce-a988-5974d9470892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c2d8ee3cd749d98dcc46dbaaf1e0c8, user_id=c86f5fa47ae14fe18cb35175f61fe690, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.570131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba96084-33dd-4cce-a988-5974d9470892 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.584567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1033/2016] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:43 2022] PUT /identity/v3/projects/b7c2d8ee3cd749d98dcc46dbaaf1e0c8/users/c86f5fa47ae14fe18cb35175f61fe690/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:43.594837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd117ef-5b78-40c4-8d95-fb7a4b19e584 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.595804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd117ef-5b78-40c4-8d95-fb7a4b19e584 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.596223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd117ef-5b78-40c4-8d95-fb7a4b19e584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.624070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cdd117ef-5b78-40c4-8d95-fb7a4b19e584 None None] MFA Rules not processed for user `c86f5fa47ae14fe18cb35175f61fe690`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:43.625333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cdd117ef-5b78-40c4-8d95-fb7a4b19e584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:43.690634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 984/2017] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:43.695129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba96084-33dd-4cce-a988-5974d9470892 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.728666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:43.759681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba96084-33dd-4cce-a988-5974d9470892 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.764958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8481dab-4446-47aa-83e8-483fe04af3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.765623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481dab-4446-47aa-83e8-483fe04af3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.765907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481dab-4446-47aa-83e8-483fe04af3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.766181 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481dab-4446-47aa-83e8-483fe04af3e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.767809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8481dab-4446-47aa-83e8-483fe04af3e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.769462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8481dab-4446-47aa-83e8-483fe04af3e9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.804427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1034/2018] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:43 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:43.806043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd117ef-5b78-40c4-8d95-fb7a4b19e584 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.817510 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd117ef-5b78-40c4-8d95-fb7a4b19e584 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.844512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:43.881866 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501522b-a39e-4de2-82df-89a42bf036ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.882570 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501522b-a39e-4de2-82df-89a42bf036ce admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.882854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501522b-a39e-4de2-82df-89a42bf036ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.883128 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501522b-a39e-4de2-82df-89a42bf036ce admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.883819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501522b-a39e-4de2-82df-89a42bf036ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.885767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501522b-a39e-4de2-82df-89a42bf036ce admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.910059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 985/2019] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:43 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:43.911296 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8481dab-4446-47aa-83e8-483fe04af3e9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.921879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8481dab-4446-47aa-83e8-483fe04af3e9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.926819 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4cf87-87aa-4891-bfc3-753d30524ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.927498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4cf87-87aa-4891-bfc3-753d30524ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.927784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4cf87-87aa-4891-bfc3-753d30524ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.928061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4cf87-87aa-4891-bfc3-753d30524ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.928854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4cf87-87aa-4891-bfc3-753d30524ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.931045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4cf87-87aa-4891-bfc3-753d30524ee3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:43.943537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1035/2020] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:43.948373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501522b-a39e-4de2-82df-89a42bf036ce admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:43.959585 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501522b-a39e-4de2-82df-89a42bf036ce admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:43.964286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730b9b2-d59b-4835-8f73-1e398e77f7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:43.965216 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730b9b2-d59b-4835-8f73-1e398e77f7a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:43.965500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730b9b2-d59b-4835-8f73-1e398e77f7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:43.965777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730b9b2-d59b-4835-8f73-1e398e77f7a4 admin admin] PATH_INFO: `/v3/projects/6d9627dde43c4315bb6ea4a5aba90598/users/9c166391d86c474197467ed54460e549/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:43.991904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730b9b2-d59b-4835-8f73-1e398e77f7a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9627dde43c4315bb6ea4a5aba90598, user_id=9c166391d86c474197467ed54460e549, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:43.994763 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730b9b2-d59b-4835-8f73-1e398e77f7a4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:44.009371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 986/2021] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:43 2022] PUT /identity/v3/projects/6d9627dde43c4315bb6ea4a5aba90598/users/9c166391d86c474197467ed54460e549/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:44.013367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4cf87-87aa-4891-bfc3-753d30524ee3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:44.024338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4cf87-87aa-4891-bfc3-753d30524ee3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:44.082143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b535b8-1507-4282-9fee-cf360777a56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:44.082943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b535b8-1507-4282-9fee-cf360777a56a admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:44.083296 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b535b8-1507-4282-9fee-cf360777a56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:44.083640 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b535b8-1507-4282-9fee-cf360777a56a admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:44.084525 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b535b8-1507-4282-9fee-cf360777a56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:44.086187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b535b8-1507-4282-9fee-cf360777a56a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:44.097309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1036/2022] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:37:44.101492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730b9b2-d59b-4835-8f73-1e398e77f7a4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:44.123667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730b9b2-d59b-4835-8f73-1e398e77f7a4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:44.139421 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab6eba-706b-4e06-a4f6-89a27c50c853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:44.140331 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6eba-706b-4e06-a4f6-89a27c50c853 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:44.140649 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6eba-706b-4e06-a4f6-89a27c50c853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:44.141202 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6eba-706b-4e06-a4f6-89a27c50c853 admin admin] PATH_INFO: `/v3/projects/6d9627dde43c4315bb6ea4a5aba90598/users/9c166391d86c474197467ed54460e549/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:44.143967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab6eba-706b-4e06-a4f6-89a27c50c853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9627dde43c4315bb6ea4a5aba90598, user_id=9c166391d86c474197467ed54460e549, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:44.146673 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab6eba-706b-4e06-a4f6-89a27c50c853 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:44.158980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 987/2023] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:44 2022] PUT /identity/v3/projects/6d9627dde43c4315bb6ea4a5aba90598/users/9c166391d86c474197467ed54460e549/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:44.171003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be746-e5ca-46b6-9f8d-622ea441432e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:44.171474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be746-e5ca-46b6-9f8d-622ea441432e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:44.171836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be746-e5ca-46b6-9f8d-622ea441432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:44.200403 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ea8be746-e5ca-46b6-9f8d-622ea441432e None None] MFA Rules not processed for user `9c166391d86c474197467ed54460e549`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:44.201661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ea8be746-e5ca-46b6-9f8d-622ea441432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:44.281005 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1037/2024] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:44.293647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab6eba-706b-4e06-a4f6-89a27c50c853 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:44.295358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-02ab6eba-706b-4e06-a4f6-89a27c50c853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:44.361667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab6eba-706b-4e06-a4f6-89a27c50c853 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:44.365497 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3d0f6-bdf3-44c8-b835-b328b0c70395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:44.366155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3d0f6-bdf3-44c8-b835-b328b0c70395 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:44.366442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3d0f6-bdf3-44c8-b835-b328b0c70395 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:44.366724 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3d0f6-bdf3-44c8-b835-b328b0c70395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:44.375946 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3d0f6-bdf3-44c8-b835-b328b0c70395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:44.377742 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3d0f6-bdf3-44c8-b835-b328b0c70395 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:44.387285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 988/2025] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:44.418434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8be746-e5ca-46b6-9f8d-622ea441432e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:44.448915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:44.486597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8be746-e5ca-46b6-9f8d-622ea441432e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:44.493490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf136137-b1f2-4929-ad80-411ce9224478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:44.494427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf136137-b1f2-4929-ad80-411ce9224478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:44.494731 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf136137-b1f2-4929-ad80-411ce9224478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:44.495043 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf136137-b1f2-4929-ad80-411ce9224478 admin admin] PATH_INFO: `/v3/users/c86f5fa47ae14fe18cb35175f61fe690` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:44.496251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf136137-b1f2-4929-ad80-411ce9224478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86f5fa47ae14fe18cb35175f61fe690)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:44.498226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf136137-b1f2-4929-ad80-411ce9224478 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:44.551578 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cf136137-b1f2-4929-ad80-411ce9224478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86f5fa47ae14fe18cb35175f61fe690'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:44.558871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cf136137-b1f2-4929-ad80-411ce9224478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86f5fa47ae14fe18cb35175f61fe690'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:44.567613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cf136137-b1f2-4929-ad80-411ce9224478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86f5fa47ae14fe18cb35175f61fe690'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:44.568332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cf136137-b1f2-4929-ad80-411ce9224478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86f5fa47ae14fe18cb35175f61fe690'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:44.582082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cf136137-b1f2-4929-ad80-411ce9224478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86f5fa47ae14fe18cb35175f61fe690'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:44.588838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1038/2026] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:44 2022] DELETE /identity/v3/users/c86f5fa47ae14fe18cb35175f61fe690 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:44.594143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958f4a4-7010-43d7-a7f8-1eb30936095a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:44.594444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958f4a4-7010-43d7-a7f8-1eb30936095a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:44.594816 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958f4a4-7010-43d7-a7f8-1eb30936095a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:44.613570 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9958f4a4-7010-43d7-a7f8-1eb30936095a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:44.614973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9958f4a4-7010-43d7-a7f8-1eb30936095a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:44.678895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 989/2027] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:44.689394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf136137-b1f2-4929-ad80-411ce9224478 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:44.691454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cf136137-b1f2-4929-ad80-411ce9224478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:44.748608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf136137-b1f2-4929-ad80-411ce9224478 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:44.753345 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33f8fb-7b02-424c-9435-663ff5ac9f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:44.754025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33f8fb-7b02-424c-9435-663ff5ac9f72 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:44.754315 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33f8fb-7b02-424c-9435-663ff5ac9f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:44.754597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33f8fb-7b02-424c-9435-663ff5ac9f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:44.763543 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33f8fb-7b02-424c-9435-663ff5ac9f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:44.765026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33f8fb-7b02-424c-9435-663ff5ac9f72 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:44.775540 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1039/2028] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:45.050016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958f4a4-7010-43d7-a7f8-1eb30936095a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:45.051579 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9958f4a4-7010-43d7-a7f8-1eb30936095a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:45.069706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958f4a4-7010-43d7-a7f8-1eb30936095a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:45.075178 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:45.076108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:45.076425 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:45.076723 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] PATH_INFO: `/v3/projects/b7c2d8ee3cd749d98dcc46dbaaf1e0c8` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:45.077983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c2d8ee3cd749d98dcc46dbaaf1e0c8)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:45.081021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:45.100695 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:45.136532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c2d8ee3cd749d98dcc46dbaaf1e0c8', 'request_id': 'req-97f39706-f8ff-4dec-b502-539497d1a74a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.150644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c2d8ee3cd749d98dcc46dbaaf1e0c8', 'request_id': 'req-97f39706-f8ff-4dec-b502-539497d1a74a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.162094 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c2d8ee3cd749d98dcc46dbaaf1e0c8', 'request_id': 'req-97f39706-f8ff-4dec-b502-539497d1a74a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.181680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] The token cache is being invalidate because project b7c2d8ee3cd749d98dcc46dbaaf1e0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:45.181680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.182373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.184479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 990/2029] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:45 2022] DELETE /identity/v3/projects/b7c2d8ee3cd749d98dcc46dbaaf1e0c8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:45.188079 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33f8fb-7b02-424c-9435-663ff5ac9f72 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:45.200434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33f8fb-7b02-424c-9435-663ff5ac9f72 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:45.260332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:45.273626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c82c5-387a-499e-a084-d58d294553d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:45.275269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c82c5-387a-499e-a084-d58d294553d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:45.275269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c82c5-387a-499e-a084-d58d294553d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:45.275530 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c82c5-387a-499e-a084-d58d294553d2 admin admin] PATH_INFO: `/v3/users/9c166391d86c474197467ed54460e549` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:45.276962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c82c5-387a-499e-a084-d58d294553d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c166391d86c474197467ed54460e549)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:45.279100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c82c5-387a-499e-a084-d58d294553d2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:45.330512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ba2c82c5-387a-499e-a084-d58d294553d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c166391d86c474197467ed54460e549'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.338919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ba2c82c5-387a-499e-a084-d58d294553d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c166391d86c474197467ed54460e549'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.347775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ba2c82c5-387a-499e-a084-d58d294553d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c166391d86c474197467ed54460e549'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.348735 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ba2c82c5-387a-499e-a084-d58d294553d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c166391d86c474197467ed54460e549'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.364420 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ba2c82c5-387a-499e-a084-d58d294553d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c166391d86c474197467ed54460e549'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.371409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1040/2030] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:45 2022] DELETE /identity/v3/users/9c166391d86c474197467ed54460e549 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:45.649871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:45.651342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:45.668524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f39706-f8ff-4dec-b502-539497d1a74a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:45.728419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:45.729415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:45.729706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:45.729984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e admin admin] PATH_INFO: `/v3/projects/6d9627dde43c4315bb6ea4a5aba90598` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:45.731194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9627dde43c4315bb6ea4a5aba90598)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:45.733150 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:45.779886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9627dde43c4315bb6ea4a5aba90598', 'request_id': 'req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.787887 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9627dde43c4315bb6ea4a5aba90598', 'request_id': 'req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.794362 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9627dde43c4315bb6ea4a5aba90598', 'request_id': 'req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.804961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e admin admin] The token cache is being invalidate because project 6d9627dde43c4315bb6ea4a5aba90598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:45.805245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.805872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1c1d84e-1f44-466c-b6ea-6abe277efc6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:45.807409 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 991/2031] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:45 2022] DELETE /identity/v3/projects/6d9627dde43c4315bb6ea4a5aba90598 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:45.812482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f0daf-5af3-4329-9804-a665598ff2ab None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:45.812786 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f0daf-5af3-4329-9804-a665598ff2ab None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:45.813071 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f0daf-5af3-4329-9804-a665598ff2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:45.831526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3b6f0daf-5af3-4329-9804-a665598ff2ab None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:45.832776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3b6f0daf-5af3-4329-9804-a665598ff2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:45.891883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1041/2032] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:45.899825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c12b7a-7d23-48b0-b9e0-ee11e68e179b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:45.900125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c12b7a-7d23-48b0-b9e0-ee11e68e179b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:45.900456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c12b7a-7d23-48b0-b9e0-ee11e68e179b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:45.919390 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-50c12b7a-7d23-48b0-b9e0-ee11e68e179b None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:45.920624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-50c12b7a-7d23-48b0-b9e0-ee11e68e179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:45.929135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 992/2033] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:45.933244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f0daf-5af3-4329-9804-a665598ff2ab None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:45.943550 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f0daf-5af3-4329-9804-a665598ff2ab None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:45.948164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e359c1-08f0-489f-999f-cf5aa61af463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:45.948839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e359c1-08f0-489f-999f-cf5aa61af463 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:45.949129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e359c1-08f0-489f-999f-cf5aa61af463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:45.949411 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e359c1-08f0-489f-999f-cf5aa61af463 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:45.950143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e359c1-08f0-489f-999f-cf5aa61af463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:45.950453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e359c1-08f0-489f-999f-cf5aa61af463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:45.952051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e359c1-08f0-489f-999f-cf5aa61af463 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:45.964313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1042/2034] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:45.968579 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c12b7a-7d23-48b0-b9e0-ee11e68e179b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:45.978401 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c12b7a-7d23-48b0-b9e0-ee11e68e179b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:45.983061 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e0268-cd23-4b90-ba94-74a3aaa49d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:45.983718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e0268-cd23-4b90-ba94-74a3aaa49d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:45.984011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e0268-cd23-4b90-ba94-74a3aaa49d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:45.984293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e0268-cd23-4b90-ba94-74a3aaa49d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:45.985020 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e0268-cd23-4b90-ba94-74a3aaa49d0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:45.988287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e0268-cd23-4b90-ba94-74a3aaa49d0a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.013780 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 993/2035] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:45 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:46.018067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e359c1-08f0-489f-999f-cf5aa61af463 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.027992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e359c1-08f0-489f-999f-cf5aa61af463 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.077081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:46.084674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d55f6-6bde-4eb7-8374-3a03328b0be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.085484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d55f6-6bde-4eb7-8374-3a03328b0be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.085995 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d55f6-6bde-4eb7-8374-3a03328b0be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.086428 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d55f6-6bde-4eb7-8374-3a03328b0be3 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.087494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d55f6-6bde-4eb7-8374-3a03328b0be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.089574 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d55f6-6bde-4eb7-8374-3a03328b0be3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.109281 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1043/2036] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:46 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:46.114463 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e0268-cd23-4b90-ba94-74a3aaa49d0a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.125006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e0268-cd23-4b90-ba94-74a3aaa49d0a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.129875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457f28d-b385-4129-913a-ab711280ff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.130539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457f28d-b385-4129-913a-ab711280ff01 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.130825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457f28d-b385-4129-913a-ab711280ff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.131108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457f28d-b385-4129-913a-ab711280ff01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.131864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457f28d-b385-4129-913a-ab711280ff01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.133499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457f28d-b385-4129-913a-ab711280ff01 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.134733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:46.145933 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 994/2037] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:46.149250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d55f6-6bde-4eb7-8374-3a03328b0be3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.159575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d55f6-6bde-4eb7-8374-3a03328b0be3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.164156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df282b1-2352-410b-9c82-f1c8fbca96ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.164843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df282b1-2352-410b-9c82-f1c8fbca96ab admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.165129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df282b1-2352-410b-9c82-f1c8fbca96ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.165406 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df282b1-2352-410b-9c82-f1c8fbca96ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.166154 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df282b1-2352-410b-9c82-f1c8fbca96ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.168007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df282b1-2352-410b-9c82-f1c8fbca96ab admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.182244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1044/2038] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:46.183616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457f28d-b385-4129-913a-ab711280ff01 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.194389 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457f28d-b385-4129-913a-ab711280ff01 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.199005 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb4bfc-40a9-4544-866e-07bfb0c46d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.199905 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb4bfc-40a9-4544-866e-07bfb0c46d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.200189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb4bfc-40a9-4544-866e-07bfb0c46d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.200497 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb4bfc-40a9-4544-866e-07bfb0c46d96 admin admin] PATH_INFO: `/v3/projects/c618145272ed41f0bbd8364e7f40eb99/users/77ae7c85aab549c78211b3bbaada5af4/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.216550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb4bfc-40a9-4544-866e-07bfb0c46d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c618145272ed41f0bbd8364e7f40eb99, user_id=77ae7c85aab549c78211b3bbaada5af4, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.219350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb4bfc-40a9-4544-866e-07bfb0c46d96 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.233483 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 995/2039] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:46 2022] PUT /identity/v3/projects/c618145272ed41f0bbd8364e7f40eb99/users/77ae7c85aab549c78211b3bbaada5af4/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:46.244603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c506f53-0c19-4161-9a29-af9ce8ddc5a9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.245136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c506f53-0c19-4161-9a29-af9ce8ddc5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.245232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c506f53-0c19-4161-9a29-af9ce8ddc5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.281936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1c506f53-0c19-4161-9a29-af9ce8ddc5a9 None None] MFA Rules not processed for user `77ae7c85aab549c78211b3bbaada5af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:46.283368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1c506f53-0c19-4161-9a29-af9ce8ddc5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:46.377271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb4bfc-40a9-4544-866e-07bfb0c46d96 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.378612 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1045/2040] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:46.456130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb4bfc-40a9-4544-866e-07bfb0c46d96 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.462351 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851abc9-2e6a-4cec-ac24-95b0a2a0c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.463042 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851abc9-2e6a-4cec-ac24-95b0a2a0c8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.463332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851abc9-2e6a-4cec-ac24-95b0a2a0c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.463619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851abc9-2e6a-4cec-ac24-95b0a2a0c8f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.464328 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851abc9-2e6a-4cec-ac24-95b0a2a0c8f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.466323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851abc9-2e6a-4cec-ac24-95b0a2a0c8f8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.508428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 996/2041] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:46 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:46.510867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c506f53-0c19-4161-9a29-af9ce8ddc5a9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.523541 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c506f53-0c19-4161-9a29-af9ce8ddc5a9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.584605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782cc7b-6b06-4ab1-b455-bdaa1b44a471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.585320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782cc7b-6b06-4ab1-b455-bdaa1b44a471 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.585624 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782cc7b-6b06-4ab1-b455-bdaa1b44a471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.585891 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782cc7b-6b06-4ab1-b455-bdaa1b44a471 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.586603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782cc7b-6b06-4ab1-b455-bdaa1b44a471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.588748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782cc7b-6b06-4ab1-b455-bdaa1b44a471 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.610292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1046/2042] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:46 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:46.614983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851abc9-2e6a-4cec-ac24-95b0a2a0c8f8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.625607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851abc9-2e6a-4cec-ac24-95b0a2a0c8f8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.630912 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc1fe8-d750-4d03-93dc-4cfe28b62007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.631667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc1fe8-d750-4d03-93dc-4cfe28b62007 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.632420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc1fe8-d750-4d03-93dc-4cfe28b62007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.632420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc1fe8-d750-4d03-93dc-4cfe28b62007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.633209 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc1fe8-d750-4d03-93dc-4cfe28b62007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.634872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc1fe8-d750-4d03-93dc-4cfe28b62007 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.646711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 997/2043] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:37:46.650466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782cc7b-6b06-4ab1-b455-bdaa1b44a471 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.661647 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782cc7b-6b06-4ab1-b455-bdaa1b44a471 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.666405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cff36-a30b-4f1c-b704-c16cbb2a9b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.667564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cff36-a30b-4f1c-b704-c16cbb2a9b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.667855 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cff36-a30b-4f1c-b704-c16cbb2a9b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.668133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cff36-a30b-4f1c-b704-c16cbb2a9b22 admin admin] PATH_INFO: `/v3/projects/b7a99c8c8ac449bf8188dc154d7b9ec9/users/b619408ca147478db3b3692aaa01c204/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.682665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cff36-a30b-4f1c-b704-c16cbb2a9b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a99c8c8ac449bf8188dc154d7b9ec9, user_id=b619408ca147478db3b3692aaa01c204, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.685403 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cff36-a30b-4f1c-b704-c16cbb2a9b22 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.698576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1047/2044] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:46 2022] PUT /identity/v3/projects/b7a99c8c8ac449bf8188dc154d7b9ec9/users/b619408ca147478db3b3692aaa01c204/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:46.702450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc1fe8-d750-4d03-93dc-4cfe28b62007 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.713398 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc1fe8-d750-4d03-93dc-4cfe28b62007 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.783067 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00c593-92d4-458e-be86-ae88f47d1e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.783746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c593-92d4-458e-be86-ae88f47d1e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.784041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c593-92d4-458e-be86-ae88f47d1e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.784485 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c593-92d4-458e-be86-ae88f47d1e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.785295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00c593-92d4-458e-be86-ae88f47d1e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.787170 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00c593-92d4-458e-be86-ae88f47d1e8c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.798992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 998/2045] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:46.804973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cff36-a30b-4f1c-b704-c16cbb2a9b22 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.816740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cff36-a30b-4f1c-b704-c16cbb2a9b22 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:46.821566 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e766e5-1977-4a31-9277-4fa884b48e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:46.822461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e766e5-1977-4a31-9277-4fa884b48e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.822752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e766e5-1977-4a31-9277-4fa884b48e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.823025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e766e5-1977-4a31-9277-4fa884b48e12 admin admin] PATH_INFO: `/v3/projects/b7a99c8c8ac449bf8188dc154d7b9ec9/users/b619408ca147478db3b3692aaa01c204/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.825051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e766e5-1977-4a31-9277-4fa884b48e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a99c8c8ac449bf8188dc154d7b9ec9, user_id=b619408ca147478db3b3692aaa01c204, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:46.827710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e766e5-1977-4a31-9277-4fa884b48e12 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:46.843625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1048/2046] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:46 2022] PUT /identity/v3/projects/b7a99c8c8ac449bf8188dc154d7b9ec9/users/b619408ca147478db3b3692aaa01c204/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:46.855083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094486ca-4b99-4824-9005-b5a6ff2d8f08 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:46.855376 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094486ca-4b99-4824-9005-b5a6ff2d8f08 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:46.855662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094486ca-4b99-4824-9005-b5a6ff2d8f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:46.883639 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-094486ca-4b99-4824-9005-b5a6ff2d8f08 None None] MFA Rules not processed for user `b619408ca147478db3b3692aaa01c204`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:46.884915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-094486ca-4b99-4824-9005-b5a6ff2d8f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:46.918438 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:46.958812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 999/2047] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:46.969189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e766e5-1977-4a31-9277-4fa884b48e12 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:46.971123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d9e766e5-1977-4a31-9277-4fa884b48e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:46.990520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:47.035346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e766e5-1977-4a31-9277-4fa884b48e12 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:47.039072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3ad66-696b-4aac-8cf4-820233da35e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:47.039728 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3ad66-696b-4aac-8cf4-820233da35e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.040013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3ad66-696b-4aac-8cf4-820233da35e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.040290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3ad66-696b-4aac-8cf4-820233da35e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.050479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3ad66-696b-4aac-8cf4-820233da35e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:47.051905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3ad66-696b-4aac-8cf4-820233da35e5 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:47.061198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1049/2048] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:47.156226 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094486ca-4b99-4824-9005-b5a6ff2d8f08 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:47.166101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094486ca-4b99-4824-9005-b5a6ff2d8f08 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:47.169936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15796854-79ab-44ed-a551-61a3f64ba5a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:47.170516 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15796854-79ab-44ed-a551-61a3f64ba5a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:47.170796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15796854-79ab-44ed-a551-61a3f64ba5a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:47.171069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15796854-79ab-44ed-a551-61a3f64ba5a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:47.228772 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15796854-79ab-44ed-a551-61a3f64ba5a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:47.230231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15796854-79ab-44ed-a551-61a3f64ba5a6 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:47.239044 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1000/2049] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:48.956416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3ad66-696b-4aac-8cf4-820233da35e5 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:48.957887 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-82f3ad66-696b-4aac-8cf4-820233da35e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:48.969408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3ad66-696b-4aac-8cf4-820233da35e5 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:48.988359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67711f-b250-4103-846c-b5b6bddfed58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:48.989081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67711f-b250-4103-846c-b5b6bddfed58 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:48.989375 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67711f-b250-4103-846c-b5b6bddfed58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:48.989736 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67711f-b250-4103-846c-b5b6bddfed58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:48.992324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ee67711f-b250-4103-846c-b5b6bddfed58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:49.073252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67711f-b250-4103-846c-b5b6bddfed58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:49.074705 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67711f-b250-4103-846c-b5b6bddfed58 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:49.084717 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1050/2050] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:54.614978 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15796854-79ab-44ed-a551-61a3f64ba5a6 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:54.686594 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15796854-79ab-44ed-a551-61a3f64ba5a6 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:54.692535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763f4a7-c7a3-4a64-9a3a-261e1a545d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:54.693423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763f4a7-c7a3-4a64-9a3a-261e1a545d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:54.693707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763f4a7-c7a3-4a64-9a3a-261e1a545d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:54.693981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763f4a7-c7a3-4a64-9a3a-261e1a545d4c admin admin] PATH_INFO: `/v3/users/77ae7c85aab549c78211b3bbaada5af4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:54.695772 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763f4a7-c7a3-4a64-9a3a-261e1a545d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ae7c85aab549c78211b3bbaada5af4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:54.698860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763f4a7-c7a3-4a64-9a3a-261e1a545d4c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:54.753692 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1763f4a7-c7a3-4a64-9a3a-261e1a545d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ae7c85aab549c78211b3bbaada5af4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:54.776775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1763f4a7-c7a3-4a64-9a3a-261e1a545d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ae7c85aab549c78211b3bbaada5af4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:54.777815 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1763f4a7-c7a3-4a64-9a3a-261e1a545d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ae7c85aab549c78211b3bbaada5af4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:54.780091 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:54.788363 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1763f4a7-c7a3-4a64-9a3a-261e1a545d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ae7c85aab549c78211b3bbaada5af4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:54.789502 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1763f4a7-c7a3-4a64-9a3a-261e1a545d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ae7c85aab549c78211b3bbaada5af4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:54.807199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1001/2051] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:54 2022] DELETE /identity/v3/users/77ae7c85aab549c78211b3bbaada5af4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:54.811618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9906d4-70c8-4a35-813e-fdd1cb399fa7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:54.812111 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9906d4-70c8-4a35-813e-fdd1cb399fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:54.812215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9906d4-70c8-4a35-813e-fdd1cb399fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:54.831180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3a9906d4-70c8-4a35-813e-fdd1cb399fa7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:54.832611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3a9906d4-70c8-4a35-813e-fdd1cb399fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:54.901142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1051/2052] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:54.913179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763f4a7-c7a3-4a64-9a3a-261e1a545d4c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:54.914282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1763f4a7-c7a3-4a64-9a3a-261e1a545d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:54.984815 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763f4a7-c7a3-4a64-9a3a-261e1a545d4c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:54.989495 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47959d08-62d4-41a8-a1ed-402f5d93cc39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:54.990332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47959d08-62d4-41a8-a1ed-402f5d93cc39 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:54.990657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47959d08-62d4-41a8-a1ed-402f5d93cc39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:54.991043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47959d08-62d4-41a8-a1ed-402f5d93cc39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.005033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47959d08-62d4-41a8-a1ed-402f5d93cc39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.006473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47959d08-62d4-41a8-a1ed-402f5d93cc39 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.019530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1002/2053] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:55.059268 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9906d4-70c8-4a35-813e-fdd1cb399fa7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:55.060824 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3a9906d4-70c8-4a35-813e-fdd1cb399fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:55.075088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9906d4-70c8-4a35-813e-fdd1cb399fa7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:55.082852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059ce16-5f2b-42cd-8742-443b080211fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:55.083874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059ce16-5f2b-42cd-8742-443b080211fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.084155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059ce16-5f2b-42cd-8742-443b080211fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.084494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059ce16-5f2b-42cd-8742-443b080211fe admin admin] PATH_INFO: `/v3/users/d41965f8df484554b03360006633252d` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.086841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059ce16-5f2b-42cd-8742-443b080211fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41965f8df484554b03360006633252d)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.090566 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059ce16-5f2b-42cd-8742-443b080211fe admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.161820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f059ce16-5f2b-42cd-8742-443b080211fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41965f8df484554b03360006633252d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.166505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:55.172513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f059ce16-5f2b-42cd-8742-443b080211fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41965f8df484554b03360006633252d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.185738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f059ce16-5f2b-42cd-8742-443b080211fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41965f8df484554b03360006633252d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.187663 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f059ce16-5f2b-42cd-8742-443b080211fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41965f8df484554b03360006633252d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.218530 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f059ce16-5f2b-42cd-8742-443b080211fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41965f8df484554b03360006633252d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.227584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1052/2054] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:55 2022] DELETE /identity/v3/users/d41965f8df484554b03360006633252d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:55.231818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3ac9a-379d-43f4-bb8c-7ab0e824a13a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.232101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3ac9a-379d-43f4-bb8c-7ab0e824a13a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.232408 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3ac9a-379d-43f4-bb8c-7ab0e824a13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.255277 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ead3ac9a-379d-43f4-bb8c-7ab0e824a13a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:55.256549 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ead3ac9a-379d-43f4-bb8c-7ab0e824a13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:55.353508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059ce16-5f2b-42cd-8742-443b080211fe admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:55.354788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1003/2055] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:55.358144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f059ce16-5f2b-42cd-8742-443b080211fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:55.370796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3ac9a-379d-43f4-bb8c-7ab0e824a13a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:55.372304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ead3ac9a-379d-43f4-bb8c-7ab0e824a13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:55.373599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059ce16-5f2b-42cd-8742-443b080211fe admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:55.379723 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:55.380743 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.381085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.381430 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] PATH_INFO: `/v3/projects/c618145272ed41f0bbd8364e7f40eb99` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.382838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c618145272ed41f0bbd8364e7f40eb99)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.385372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.478679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c618145272ed41f0bbd8364e7f40eb99', 'request_id': 'req-d6021fd2-03d3-439d-8691-7a6e77fbea75'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.487300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3ac9a-379d-43f4-bb8c-7ab0e824a13a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:55.496131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c618145272ed41f0bbd8364e7f40eb99', 'request_id': 'req-d6021fd2-03d3-439d-8691-7a6e77fbea75'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.508198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c618145272ed41f0bbd8364e7f40eb99', 'request_id': 'req-d6021fd2-03d3-439d-8691-7a6e77fbea75'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.535085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] The token cache is being invalidate because project c618145272ed41f0bbd8364e7f40eb99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:55.535400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.536329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.543188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1053/2056] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:55 2022] DELETE /identity/v3/projects/c618145272ed41f0bbd8364e7f40eb99 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:55.544418 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:55.546589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:55.549710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:55.560800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d8baf-ed50-4e5a-9646-684153815e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:55.563969 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d8baf-ed50-4e5a-9646-684153815e1d service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.564285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d8baf-ed50-4e5a-9646-684153815e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.565556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d8baf-ed50-4e5a-9646-684153815e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.568638 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-749d8baf-ed50-4e5a-9646-684153815e1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:55.662329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6021fd2-03d3-439d-8691-7a6e77fbea75 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:55.667435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245ab6-0c77-467c-b70a-dc364e18c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:55.668323 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245ab6-0c77-467c-b70a-dc364e18c0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:55.668720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245ab6-0c77-467c-b70a-dc364e18c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:55.669008 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245ab6-0c77-467c-b70a-dc364e18c0c1 admin admin] PATH_INFO: `/v3/users/b619408ca147478db3b3692aaa01c204` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:55.670241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22245ab6-0c77-467c-b70a-dc364e18c0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b619408ca147478db3b3692aaa01c204)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.672383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22245ab6-0c77-467c-b70a-dc364e18c0c1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.683818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d8baf-ed50-4e5a-9646-684153815e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:55.686273 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d8baf-ed50-4e5a-9646-684153815e1d service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:55.702649 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1004/2057] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:37:55.754524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-22245ab6-0c77-467c-b70a-dc364e18c0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b619408ca147478db3b3692aaa01c204'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.768960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-22245ab6-0c77-467c-b70a-dc364e18c0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b619408ca147478db3b3692aaa01c204'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.770511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:55.782130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-22245ab6-0c77-467c-b70a-dc364e18c0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b619408ca147478db3b3692aaa01c204'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.784073 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-22245ab6-0c77-467c-b70a-dc364e18c0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b619408ca147478db3b3692aaa01c204'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.804468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-22245ab6-0c77-467c-b70a-dc364e18c0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b619408ca147478db3b3692aaa01c204'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:55.811884 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1054/2058] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:55 2022] DELETE /identity/v3/users/b619408ca147478db3b3692aaa01c204 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:56.317755 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d8baf-ed50-4e5a-9646-684153815e1d service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:56.319377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-749d8baf-ed50-4e5a-9646-684153815e1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:56.333370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d8baf-ed50-4e5a-9646-684153815e1d service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:56.397332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:56.397992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:56.398287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:56.398624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] PATH_INFO: `/v3/projects/c4f4d44f05f548ddb68c74954ef5cb97` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:56.399835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f4d44f05f548ddb68c74954ef5cb97)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:56.401982 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:56.458639 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f4d44f05f548ddb68c74954ef5cb97', 'request_id': 'req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.467837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f4d44f05f548ddb68c74954ef5cb97', 'request_id': 'req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.474846 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f4d44f05f548ddb68c74954ef5cb97', 'request_id': 'req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.485442 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245ab6-0c77-467c-b70a-dc364e18c0c1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:56.487083 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-22245ab6-0c77-467c-b70a-dc364e18c0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:56.487195 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] The token cache is being invalidate because project c4f4d44f05f548ddb68c74954ef5cb97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:56.487405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.488091 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.489836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1005/2059] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:56 2022] DELETE /identity/v3/projects/c4f4d44f05f548ddb68c74954ef5cb97 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:56.493467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:56.494871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:56.503850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245ab6-0c77-467c-b70a-dc364e18c0c1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:56.528882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:56.564981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec91d8-8f3d-4895-ba46-c79af8396caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:56.565860 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec91d8-8f3d-4895-ba46-c79af8396caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:56.566147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec91d8-8f3d-4895-ba46-c79af8396caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:56.566430 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec91d8-8f3d-4895-ba46-c79af8396caa admin admin] PATH_INFO: `/v3/projects/b7a99c8c8ac449bf8188dc154d7b9ec9` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:56.567693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec91d8-8f3d-4895-ba46-c79af8396caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a99c8c8ac449bf8188dc154d7b9ec9)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:56.569272 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d47ed-2e94-4b78-9b1f-644b5d08ee36 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:56.569694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec91d8-8f3d-4895-ba46-c79af8396caa admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:56.574411 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfab060-61b3-4f64-b9f7-eed3c63bb340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:56.575295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfab060-61b3-4f64-b9f7-eed3c63bb340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:56.575577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfab060-61b3-4f64-b9f7-eed3c63bb340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:56.575853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfab060-61b3-4f64-b9f7-eed3c63bb340 admin admin] PATH_INFO: `/v3/users/9d32ecbe783f4e28ace28afc34bf425c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:56.577104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfab060-61b3-4f64-b9f7-eed3c63bb340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d32ecbe783f4e28ace28afc34bf425c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:56.579111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfab060-61b3-4f64-b9f7-eed3c63bb340 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:56.618247 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-daec91d8-8f3d-4895-ba46-c79af8396caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a99c8c8ac449bf8188dc154d7b9ec9', 'request_id': 'req-daec91d8-8f3d-4895-ba46-c79af8396caa'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.624636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-daec91d8-8f3d-4895-ba46-c79af8396caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a99c8c8ac449bf8188dc154d7b9ec9', 'request_id': 'req-daec91d8-8f3d-4895-ba46-c79af8396caa'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.630942 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-daec91d8-8f3d-4895-ba46-c79af8396caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a99c8c8ac449bf8188dc154d7b9ec9', 'request_id': 'req-daec91d8-8f3d-4895-ba46-c79af8396caa'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.632885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1cfab060-61b3-4f64-b9f7-eed3c63bb340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d32ecbe783f4e28ace28afc34bf425c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.645224 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-daec91d8-8f3d-4895-ba46-c79af8396caa admin admin] The token cache is being invalidate because project b7a99c8c8ac449bf8188dc154d7b9ec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:56.645752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-daec91d8-8f3d-4895-ba46-c79af8396caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.646627 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-daec91d8-8f3d-4895-ba46-c79af8396caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.648092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1cfab060-61b3-4f64-b9f7-eed3c63bb340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d32ecbe783f4e28ace28afc34bf425c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.648813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1cfab060-61b3-4f64-b9f7-eed3c63bb340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d32ecbe783f4e28ace28afc34bf425c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.649197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1055/2060] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:56 2022] DELETE /identity/v3/projects/b7a99c8c8ac449bf8188dc154d7b9ec9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:56.655268 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4cf8-a0b8-42d7-a117-df9162bb914f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:56.655640 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4cf8-a0b8-42d7-a117-df9162bb914f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:56.655993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4cf8-a0b8-42d7-a117-df9162bb914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:56.657625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1cfab060-61b3-4f64-b9f7-eed3c63bb340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d32ecbe783f4e28ace28afc34bf425c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.658400 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1cfab060-61b3-4f64-b9f7-eed3c63bb340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d32ecbe783f4e28ace28afc34bf425c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:56.673016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1006/2061] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:56 2022] DELETE /identity/v3/users/9d32ecbe783f4e28ace28afc34bf425c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:56.675012 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-922a4cf8-a0b8-42d7-a117-df9162bb914f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:56.676235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-922a4cf8-a0b8-42d7-a117-df9162bb914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:56.739577 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1056/2062] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:56.747832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcaf56-89b0-4ca9-9348-5ab053fca55c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:56.748334 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcaf56-89b0-4ca9-9348-5ab053fca55c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:56.748579 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcaf56-89b0-4ca9-9348-5ab053fca55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:56.768177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cbbcaf56-89b0-4ca9-9348-5ab053fca55c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:56.769439 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cbbcaf56-89b0-4ca9-9348-5ab053fca55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:56.777666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1007/2063] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:56.781862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a4cf8-a0b8-42d7-a117-df9162bb914f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:56.786946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:56.793967 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a4cf8-a0b8-42d7-a117-df9162bb914f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:56.800636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e65e2-8027-4d17-bcc5-45e93a2589f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:56.801309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e65e2-8027-4d17-bcc5-45e93a2589f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:56.801608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e65e2-8027-4d17-bcc5-45e93a2589f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:56.801871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e65e2-8027-4d17-bcc5-45e93a2589f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:56.802610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e65e2-8027-4d17-bcc5-45e93a2589f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:56.802935 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e65e2-8027-4d17-bcc5-45e93a2589f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:56.804551 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e65e2-8027-4d17-bcc5-45e93a2589f3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:56.817376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1057/2064] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:56.824095 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcaf56-89b0-4ca9-9348-5ab053fca55c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:56.834345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcaf56-89b0-4ca9-9348-5ab053fca55c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:56.840644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9b103-d09f-477d-8083-b67cbc29be07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:56.841387 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9b103-d09f-477d-8083-b67cbc29be07 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:56.841799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9b103-d09f-477d-8083-b67cbc29be07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:56.842171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9b103-d09f-477d-8083-b67cbc29be07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:56.843049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9b103-d09f-477d-8083-b67cbc29be07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:56.845261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9b103-d09f-477d-8083-b67cbc29be07 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:56.877925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1008/2065] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:56 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:56.885078 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e65e2-8027-4d17-bcc5-45e93a2589f3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:56.900193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e65e2-8027-4d17-bcc5-45e93a2589f3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:56.977840 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3933e-8a75-4914-9770-a9be93b88973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:56.978744 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3933e-8a75-4914-9770-a9be93b88973 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:56.979091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3933e-8a75-4914-9770-a9be93b88973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:56.979379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3933e-8a75-4914-9770-a9be93b88973 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:56.980288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3933e-8a75-4914-9770-a9be93b88973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:56.982427 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3933e-8a75-4914-9770-a9be93b88973 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:56.990461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9b103-d09f-477d-8083-b67cbc29be07 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:56.992699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1be9b103-d09f-477d-8083-b67cbc29be07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:57.027618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1058/2066] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:56 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:57.028742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3933e-8a75-4914-9770-a9be93b88973 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:57.050370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9b103-d09f-477d-8083-b67cbc29be07 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:57.051271 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3933e-8a75-4914-9770-a9be93b88973 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:57.056542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da75daa-5b67-4e17-8e49-6d253e0700d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:57.057242 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:57.057395 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da75daa-5b67-4e17-8e49-6d253e0700d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.057715 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da75daa-5b67-4e17-8e49-6d253e0700d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.058059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da75daa-5b67-4e17-8e49-6d253e0700d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.058683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.058920 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da75daa-5b67-4e17-8e49-6d253e0700d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:57.059280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.059708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] PATH_INFO: `/v3/projects/768850394cbb4b44a193fa783a562400` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.060906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da75daa-5b67-4e17-8e49-6d253e0700d0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:57.061228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=768850394cbb4b44a193fa783a562400)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:57.064529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:57.080413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1059/2067] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:57.084446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da75daa-5b67-4e17-8e49-6d253e0700d0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:57.099243 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da75daa-5b67-4e17-8e49-6d253e0700d0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:57.106419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8508c6a-b094-4844-b0c8-1e2fcca5d481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:57.107970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8508c6a-b094-4844-b0c8-1e2fcca5d481 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.108832 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8508c6a-b094-4844-b0c8-1e2fcca5d481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.109276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8508c6a-b094-4844-b0c8-1e2fcca5d481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.111631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8508c6a-b094-4844-b0c8-1e2fcca5d481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:57.114173 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8508c6a-b094-4844-b0c8-1e2fcca5d481 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:57.130150 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768850394cbb4b44a193fa783a562400', 'request_id': 'req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.133899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1060/2068] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:37:57.133899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8508c6a-b094-4844-b0c8-1e2fcca5d481 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:57.134218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b8508c6a-b094-4844-b0c8-1e2fcca5d481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:57.146733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768850394cbb4b44a193fa783a562400', 'request_id': 'req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.150125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8508c6a-b094-4844-b0c8-1e2fcca5d481 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:57.156105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768850394cbb4b44a193fa783a562400', 'request_id': 'req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.164500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:57.170335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] The token cache is being invalidate because project 768850394cbb4b44a193fa783a562400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:57.171208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.172244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.175284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1009/2069] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:56 2022] DELETE /identity/v3/projects/768850394cbb4b44a193fa783a562400 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:57.177968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:57.179136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:57.246688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50103704-b259-4f00-a762-bf09b0a46829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:57.247720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50103704-b259-4f00-a762-bf09b0a46829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.248235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50103704-b259-4f00-a762-bf09b0a46829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.248692 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50103704-b259-4f00-a762-bf09b0a46829 admin admin] PATH_INFO: `/v3/users/14c3e541eb4f4d68b67b59ae77a9ca93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.250157 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50103704-b259-4f00-a762-bf09b0a46829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c3e541eb4f4d68b67b59ae77a9ca93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:57.254413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50103704-b259-4f00-a762-bf09b0a46829 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:57.273175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e089dab-5bb6-4e13-aac8-2c2d9f7b4cf0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:57.281987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb591555-46ea-4f91-97d6-a0aa0907fd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:57.283453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb591555-46ea-4f91-97d6-a0aa0907fd74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.283763 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb591555-46ea-4f91-97d6-a0aa0907fd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.283991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb591555-46ea-4f91-97d6-a0aa0907fd74 admin admin] PATH_INFO: `/v3/projects/adf025024dbe4fd38d00f4549e017ec7/users/580d5c78946047d388e8b75b579d62cc/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.310399 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb591555-46ea-4f91-97d6-a0aa0907fd74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf025024dbe4fd38d00f4549e017ec7, user_id=580d5c78946047d388e8b75b579d62cc, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:57.314011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb591555-46ea-4f91-97d6-a0aa0907fd74 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:57.316766 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-50103704-b259-4f00-a762-bf09b0a46829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c3e541eb4f4d68b67b59ae77a9ca93'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.325097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-50103704-b259-4f00-a762-bf09b0a46829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c3e541eb4f4d68b67b59ae77a9ca93'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.332445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1010/2070] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:57 2022] PUT /identity/v3/projects/adf025024dbe4fd38d00f4549e017ec7/users/580d5c78946047d388e8b75b579d62cc/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:57.332445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb591555-46ea-4f91-97d6-a0aa0907fd74 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:57.333372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:57.335344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fb591555-46ea-4f91-97d6-a0aa0907fd74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:57.338940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-50103704-b259-4f00-a762-bf09b0a46829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c3e541eb4f4d68b67b59ae77a9ca93'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.340120 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-50103704-b259-4f00-a762-bf09b0a46829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c3e541eb4f4d68b67b59ae77a9ca93'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.365763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-50103704-b259-4f00-a762-bf09b0a46829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c3e541eb4f4d68b67b59ae77a9ca93'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.374920 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1061/2071] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:57 2022] DELETE /identity/v3/users/14c3e541eb4f4d68b67b59ae77a9ca93 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:57.377349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f742-6fda-45c2-96d9-0dfb367214b6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.377797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f742-6fda-45c2-96d9-0dfb367214b6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.378374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f742-6fda-45c2-96d9-0dfb367214b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.413725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1145f742-6fda-45c2-96d9-0dfb367214b6 None None] MFA Rules not processed for user `580d5c78946047d388e8b75b579d62cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:57.415899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1145f742-6fda-45c2-96d9-0dfb367214b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:57.432923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb591555-46ea-4f91-97d6-a0aa0907fd74 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:57.503470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1062/2072] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:57.505074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf14414-085d-4c30-906c-c57c14f82cca None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.505375 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf14414-085d-4c30-906c-c57c14f82cca None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.506067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf14414-085d-4c30-906c-c57c14f82cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.521177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed4d20-08bb-4e3e-aeb2-6e12a15eeee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:57.522065 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4d20-08bb-4e3e-aeb2-6e12a15eeee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.522419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4d20-08bb-4e3e-aeb2-6e12a15eeee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.522773 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4d20-08bb-4e3e-aeb2-6e12a15eeee8 admin admin] PATH_INFO: `/v3/users/d1263abbb314412b8ae607eb1bd98881` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.524058 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed4d20-08bb-4e3e-aeb2-6e12a15eeee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1263abbb314412b8ae607eb1bd98881)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:57.525475 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-adf14414-085d-4c30-906c-c57c14f82cca None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:57.526082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed4d20-08bb-4e3e-aeb2-6e12a15eeee8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:57.526679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-adf14414-085d-4c30-906c-c57c14f82cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:57.536958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1063/2073] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:57.540604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf14414-085d-4c30-906c-c57c14f82cca None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:57.540604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-adf14414-085d-4c30-906c-c57c14f82cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:57.572485 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:57.590746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-46ed4d20-08bb-4e3e-aeb2-6e12a15eeee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1263abbb314412b8ae607eb1bd98881'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.605928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-46ed4d20-08bb-4e3e-aeb2-6e12a15eeee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1263abbb314412b8ae607eb1bd98881'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.607328 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-46ed4d20-08bb-4e3e-aeb2-6e12a15eeee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1263abbb314412b8ae607eb1bd98881'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.614605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf14414-085d-4c30-906c-c57c14f82cca None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:57.618909 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-46ed4d20-08bb-4e3e-aeb2-6e12a15eeee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1263abbb314412b8ae607eb1bd98881'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.619050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b0f2c-369e-404a-b9c4-110617fa6427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:57.619512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-46ed4d20-08bb-4e3e-aeb2-6e12a15eeee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1263abbb314412b8ae607eb1bd98881'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.619678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b0f2c-369e-404a-b9c4-110617fa6427 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.619938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b0f2c-369e-404a-b9c4-110617fa6427 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.620225 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b0f2c-369e-404a-b9c4-110617fa6427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.622242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-690b0f2c-369e-404a-b9c4-110617fa6427 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:57.634975 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b0f2c-369e-404a-b9c4-110617fa6427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:57.636372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1011/2074] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:57 2022] DELETE /identity/v3/users/d1263abbb314412b8ae607eb1bd98881 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:57.636570 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b0f2c-369e-404a-b9c4-110617fa6427 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:57.640364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed4d20-08bb-4e3e-aeb2-6e12a15eeee8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:57.643062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-46ed4d20-08bb-4e3e-aeb2-6e12a15eeee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:57.653579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1064/2075] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:57.675645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b0f2c-369e-404a-b9c4-110617fa6427 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:57.680583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-690b0f2c-369e-404a-b9c4-110617fa6427 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:57.699057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b0f2c-369e-404a-b9c4-110617fa6427 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:57.726745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed4d20-08bb-4e3e-aeb2-6e12a15eeee8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:57.730813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5d240-77c5-4a1f-9253-4e96075b387b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:57.731472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5d240-77c5-4a1f-9253-4e96075b387b service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.731755 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5d240-77c5-4a1f-9253-4e96075b387b service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.732464 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5d240-77c5-4a1f-9253-4e96075b387b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.734664 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e3a5d240-77c5-4a1f-9253-4e96075b387b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:57.769710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2f22a-37e7-49c1-a96f-ff5bec639cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:57.770589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2f22a-37e7-49c1-a96f-ff5bec639cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.771231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2f22a-37e7-49c1-a96f-ff5bec639cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.771231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2f22a-37e7-49c1-a96f-ff5bec639cff admin admin] PATH_INFO: `/v3/users/580d5c78946047d388e8b75b579d62cc` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.772336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2f22a-37e7-49c1-a96f-ff5bec639cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=580d5c78946047d388e8b75b579d62cc)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:57.774340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2f22a-37e7-49c1-a96f-ff5bec639cff admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:57.777463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:57.821424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5d240-77c5-4a1f-9253-4e96075b387b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:57.822929 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5d240-77c5-4a1f-9253-4e96075b387b service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:57.834646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1012/2076] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:57.836482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3ba2f22a-37e7-49c1-a96f-ff5bec639cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580d5c78946047d388e8b75b579d62cc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.847652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3ba2f22a-37e7-49c1-a96f-ff5bec639cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580d5c78946047d388e8b75b579d62cc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.857669 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3ba2f22a-37e7-49c1-a96f-ff5bec639cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580d5c78946047d388e8b75b579d62cc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.858746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3ba2f22a-37e7-49c1-a96f-ff5bec639cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580d5c78946047d388e8b75b579d62cc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.880588 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3ba2f22a-37e7-49c1-a96f-ff5bec639cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580d5c78946047d388e8b75b579d62cc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:57.887614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1065/2077] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:37:57 2022] DELETE /identity/v3/users/580d5c78946047d388e8b75b579d62cc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:57.893019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e1df3-11e6-4be4-94ab-135da917526b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:57.893435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e1df3-11e6-4be4-94ab-135da917526b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:57.894872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e1df3-11e6-4be4-94ab-135da917526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:57.916193 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-066e1df3-11e6-4be4-94ab-135da917526b None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:57.918018 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-066e1df3-11e6-4be4-94ab-135da917526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:57.955514 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2f22a-37e7-49c1-a96f-ff5bec639cff admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:57.957448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3ba2f22a-37e7-49c1-a96f-ff5bec639cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.011009 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:58.024790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1013/2078] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:58.035908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e1df3-11e6-4be4-94ab-135da917526b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.037420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-066e1df3-11e6-4be4-94ab-135da917526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.080513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2f22a-37e7-49c1-a96f-ff5bec639cff admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.085461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5add6-45ad-47d3-8134-382f28583edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.086454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5add6-45ad-47d3-8134-382f28583edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.086847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5add6-45ad-47d3-8134-382f28583edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.087609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5add6-45ad-47d3-8134-382f28583edb admin admin] PATH_INFO: `/v3/projects/158f902882564fb9bfae960184ff548d` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.088693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5add6-45ad-47d3-8134-382f28583edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=158f902882564fb9bfae960184ff548d)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.091414 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5add6-45ad-47d3-8134-382f28583edb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.120301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e1df3-11e6-4be4-94ab-135da917526b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.124847 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15877d6c-8271-4834-a125-3c7fb42d3577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.125505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15877d6c-8271-4834-a125-3c7fb42d3577 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.126330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15877d6c-8271-4834-a125-3c7fb42d3577 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.127000 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15877d6c-8271-4834-a125-3c7fb42d3577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.136944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15877d6c-8271-4834-a125-3c7fb42d3577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.138539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15877d6c-8271-4834-a125-3c7fb42d3577 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.150284 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e2e5add6-45ad-47d3-8134-382f28583edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '158f902882564fb9bfae960184ff548d', 'request_id': 'req-e2e5add6-45ad-47d3-8134-382f28583edb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.152441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1014/2079] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:37:58.167234 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e2e5add6-45ad-47d3-8134-382f28583edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '158f902882564fb9bfae960184ff548d', 'request_id': 'req-e2e5add6-45ad-47d3-8134-382f28583edb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.170217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15877d6c-8271-4834-a125-3c7fb42d3577 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.171971 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-15877d6c-8271-4834-a125-3c7fb42d3577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.187011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e2e5add6-45ad-47d3-8134-382f28583edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '158f902882564fb9bfae960184ff548d', 'request_id': 'req-e2e5add6-45ad-47d3-8134-382f28583edb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.195859 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15877d6c-8271-4834-a125-3c7fb42d3577 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.203747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e2e5add6-45ad-47d3-8134-382f28583edb admin admin] The token cache is being invalidate because project 158f902882564fb9bfae960184ff548d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:58.204201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e2e5add6-45ad-47d3-8134-382f28583edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.205342 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e2e5add6-45ad-47d3-8134-382f28583edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.207260 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1066/2080] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:57 2022] DELETE /identity/v3/projects/158f902882564fb9bfae960184ff548d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:58.215366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ea474-fc5a-41ef-8232-dc12e654509e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.215650 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ea474-fc5a-41ef-8232-dc12e654509e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.215938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ea474-fc5a-41ef-8232-dc12e654509e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.237220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-177ea474-fc5a-41ef-8232-dc12e654509e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:58.238620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-177ea474-fc5a-41ef-8232-dc12e654509e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.244916 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:58.281472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0446d-c0db-46da-8b1a-515d23e83875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.283595 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0446d-c0db-46da-8b1a-515d23e83875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.284421 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0446d-c0db-46da-8b1a-515d23e83875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.284872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0446d-c0db-46da-8b1a-515d23e83875 admin admin] PATH_INFO: `/v3/projects/43d92a89d4124d739f2d81964837d00a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.286527 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0446d-c0db-46da-8b1a-515d23e83875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d92a89d4124d739f2d81964837d00a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.290093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0446d-c0db-46da-8b1a-515d23e83875 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.323536 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1067/2081] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:58.334715 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb537-b25d-4680-b801-b946bc905a44 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.335013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb537-b25d-4680-b801-b946bc905a44 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.335287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb537-b25d-4680-b801-b946bc905a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.355378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ea4eb537-b25d-4680-b801-b946bc905a44 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:58.356696 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ea4eb537-b25d-4680-b801-b946bc905a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.373751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1068/2082] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:58.379209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eb537-b25d-4680-b801-b946bc905a44 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.379917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4fb0446d-c0db-46da-8b1a-515d23e83875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d92a89d4124d739f2d81964837d00a', 'request_id': 'req-4fb0446d-c0db-46da-8b1a-515d23e83875'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.392984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4fb0446d-c0db-46da-8b1a-515d23e83875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d92a89d4124d739f2d81964837d00a', 'request_id': 'req-4fb0446d-c0db-46da-8b1a-515d23e83875'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.394197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eb537-b25d-4680-b801-b946bc905a44 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.410557 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4fb0446d-c0db-46da-8b1a-515d23e83875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d92a89d4124d739f2d81964837d00a', 'request_id': 'req-4fb0446d-c0db-46da-8b1a-515d23e83875'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.427701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4fb0446d-c0db-46da-8b1a-515d23e83875 admin admin] The token cache is being invalidate because project 43d92a89d4124d739f2d81964837d00a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:58.428097 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4fb0446d-c0db-46da-8b1a-515d23e83875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.436198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4fb0446d-c0db-46da-8b1a-515d23e83875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.444658 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1015/2083] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:58 2022] DELETE /identity/v3/projects/43d92a89d4124d739f2d81964837d00a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:58.446654 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f0c1-b10b-4678-ab8a-c332d950697e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.447065 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f0c1-b10b-4678-ab8a-c332d950697e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.447482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f0c1-b10b-4678-ab8a-c332d950697e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.471447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1911f0c1-b10b-4678-ab8a-c332d950697e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:58.473364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1911f0c1-b10b-4678-ab8a-c332d950697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.475827 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67410f0f-b012-4805-9ec8-45c94c3aacd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.476537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67410f0f-b012-4805-9ec8-45c94c3aacd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.476860 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67410f0f-b012-4805-9ec8-45c94c3aacd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.477136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67410f0f-b012-4805-9ec8-45c94c3aacd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.477875 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67410f0f-b012-4805-9ec8-45c94c3aacd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:58.478183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67410f0f-b012-4805-9ec8-45c94c3aacd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.479827 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67410f0f-b012-4805-9ec8-45c94c3aacd6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.485769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1016/2084] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:58.493009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1069/2085] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:58.494840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3b031-aff0-4d3f-b683-732962a108ca None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.495137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3b031-aff0-4d3f-b683-732962a108ca None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.495419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3b031-aff0-4d3f-b683-732962a108ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.497267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67410f0f-b012-4805-9ec8-45c94c3aacd6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.499109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-67410f0f-b012-4805-9ec8-45c94c3aacd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.513654 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67410f0f-b012-4805-9ec8-45c94c3aacd6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.518077 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-03b3b031-aff0-4d3f-b683-732962a108ca None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:58.519208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce5275-eef1-40ba-8287-0a127587bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.519456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-03b3b031-aff0-4d3f-b683-732962a108ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.519908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce5275-eef1-40ba-8287-0a127587bb0a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.520198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce5275-eef1-40ba-8287-0a127587bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.520514 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce5275-eef1-40ba-8287-0a127587bb0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.521319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce5275-eef1-40ba-8287-0a127587bb0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.523329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce5275-eef1-40ba-8287-0a127587bb0a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.537000 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1017/2086] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:58.540913 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3b031-aff0-4d3f-b683-732962a108ca None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.551556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3b031-aff0-4d3f-b683-732962a108ca None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.553334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1070/2087] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:58 2022] POST /identity/v3/projects => generated 401 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:58.559311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce5275-eef1-40ba-8287-0a127587bb0a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.569094 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:58.622869 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c6fd0-ac83-4609-96cc-b783a68db2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.623543 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6fd0-ac83-4609-96cc-b783a68db2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.623830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6fd0-ac83-4609-96cc-b783a68db2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.624109 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6fd0-ac83-4609-96cc-b783a68db2bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.624882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c6fd0-ac83-4609-96cc-b783a68db2bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:58.625193 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c6fd0-ac83-4609-96cc-b783a68db2bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.627768 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c6fd0-ac83-4609-96cc-b783a68db2bc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.630684 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce5275-eef1-40ba-8287-0a127587bb0a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.635359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c079e08-e9fe-4ae1-a304-4811eee6007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.636018 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079e08-e9fe-4ae1-a304-4811eee6007a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.636311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079e08-e9fe-4ae1-a304-4811eee6007a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.636632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079e08-e9fe-4ae1-a304-4811eee6007a admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.637326 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c079e08-e9fe-4ae1-a304-4811eee6007a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.639244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c079e08-e9fe-4ae1-a304-4811eee6007a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.639616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1018/2088] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:37:58.640467 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c6fd0-ac83-4609-96cc-b783a68db2bc admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.642750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ad8c6fd0-ac83-4609-96cc-b783a68db2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.655775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c6fd0-ac83-4609-96cc-b783a68db2bc admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.662349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.663165 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.663583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.663873 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] PATH_INFO: `/v3/projects/adf025024dbe4fd38d00f4549e017ec7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.665138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf025024dbe4fd38d00f4549e017ec7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.666741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1071/2089] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:58 2022] POST /identity/v3/users => generated 301 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:58.667310 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.667888 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c079e08-e9fe-4ae1-a304-4811eee6007a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.680659 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c079e08-e9fe-4ae1-a304-4811eee6007a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.685840 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d12b3-dff6-4cf0-951d-b46fda699fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.686582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d12b3-dff6-4cf0-951d-b46fda699fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.686971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d12b3-dff6-4cf0-951d-b46fda699fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.687318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d12b3-dff6-4cf0-951d-b46fda699fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.689730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d12b3-dff6-4cf0-951d-b46fda699fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.690808 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d12b3-dff6-4cf0-951d-b46fda699fb5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.694238 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:58.728619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1072/2090] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:58 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:58.729665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d12b3-dff6-4cf0-951d-b46fda699fb5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.733053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf025024dbe4fd38d00f4549e017ec7', 'request_id': 'req-b68bd8c3-1394-41b1-8f1d-c5629101d456'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.742146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf025024dbe4fd38d00f4549e017ec7', 'request_id': 'req-b68bd8c3-1394-41b1-8f1d-c5629101d456'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.749971 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf025024dbe4fd38d00f4549e017ec7', 'request_id': 'req-b68bd8c3-1394-41b1-8f1d-c5629101d456'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.762052 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] The token cache is being invalidate because project adf025024dbe4fd38d00f4549e017ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:37:58.762465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.763155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:37:58.764769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1019/2091] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:37:58 2022] DELETE /identity/v3/projects/adf025024dbe4fd38d00f4549e017ec7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:58.768940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.770335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.813000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d12b3-dff6-4cf0-951d-b46fda699fb5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.820324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb2bd6-a0dd-453c-8949-d36522309386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.821043 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb2bd6-a0dd-453c-8949-d36522309386 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.821333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb2bd6-a0dd-453c-8949-d36522309386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.821618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb2bd6-a0dd-453c-8949-d36522309386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.822367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb2bd6-a0dd-453c-8949-d36522309386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.824015 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb2bd6-a0dd-453c-8949-d36522309386 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.835042 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1073/2092] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:58.836330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2907-4586-480d-996f-dcf14f6a705a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.836657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2907-4586-480d-996f-dcf14f6a705a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.837187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2907-4586-480d-996f-dcf14f6a705a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.841018 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bd8c3-1394-41b1-8f1d-c5629101d456 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.845942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3a3e7-f271-4519-a4ce-6816e96f1098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.846611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3a3e7-f271-4519-a4ce-6816e96f1098 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.846893 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3a3e7-f271-4519-a4ce-6816e96f1098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.847922 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3a3e7-f271-4519-a4ce-6816e96f1098 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.847922 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3a3e7-f271-4519-a4ce-6816e96f1098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.849805 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3a3e7-f271-4519-a4ce-6816e96f1098 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.858891 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1efb2907-4586-480d-996f-dcf14f6a705a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:58.860180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1efb2907-4586-480d-996f-dcf14f6a705a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.870424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1074/2093] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:58.870680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1020/2094] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:58 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:58.873293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb2907-4586-480d-996f-dcf14f6a705a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.874676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3a3e7-f271-4519-a4ce-6816e96f1098 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.880674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1efb2907-4586-480d-996f-dcf14f6a705a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.889313 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3a3e7-f271-4519-a4ce-6816e96f1098 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.893186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb2907-4586-480d-996f-dcf14f6a705a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.895067 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f735258-e5b8-479e-b99d-52f85ad60c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.895741 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f735258-e5b8-479e-b99d-52f85ad60c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.896047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f735258-e5b8-479e-b99d-52f85ad60c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.896292 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f735258-e5b8-479e-b99d-52f85ad60c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.897424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f735258-e5b8-479e-b99d-52f85ad60c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.898598 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fc58a-0f18-4d39-bc82-fdeca22a57b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.899061 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f735258-e5b8-479e-b99d-52f85ad60c9d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.899254 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fc58a-0f18-4d39-bc82-fdeca22a57b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.899540 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fc58a-0f18-4d39-bc82-fdeca22a57b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.899819 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fc58a-0f18-4d39-bc82-fdeca22a57b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.900624 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fc58a-0f18-4d39-bc82-fdeca22a57b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.902219 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fc58a-0f18-4d39-bc82-fdeca22a57b2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.915805 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1021/2095] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:37:58.915805 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ceb6c-b36f-4820-9d3b-48799a98fd5a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.915805 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ceb6c-b36f-4820-9d3b-48799a98fd5a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.915805 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ceb6c-b36f-4820-9d3b-48799a98fd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.916228 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1075/2096] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:58.917387 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fc58a-0f18-4d39-bc82-fdeca22a57b2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.929269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fc58a-0f18-4d39-bc82-fdeca22a57b2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.933621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-af7ceb6c-b36f-4820-9d3b-48799a98fd5a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:58.934837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970db48-7011-413b-babd-815d1c10e22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.935011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-af7ceb6c-b36f-4820-9d3b-48799a98fd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:58.935511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970db48-7011-413b-babd-815d1c10e22f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.935800 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970db48-7011-413b-babd-815d1c10e22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.936079 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970db48-7011-413b-babd-815d1c10e22f admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.936841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970db48-7011-413b-babd-815d1c10e22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.939196 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970db48-7011-413b-babd-815d1c10e22f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.943719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1022/2097] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:58.944528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ceb6c-b36f-4820-9d3b-48799a98fd5a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.950877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1076/2098] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:58.951720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970db48-7011-413b-babd-815d1c10e22f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.954104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ceb6c-b36f-4820-9d3b-48799a98fd5a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.959095 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be0688-4b70-4793-9cf9-1912dda2ea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.959980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be0688-4b70-4793-9cf9-1912dda2ea41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.960259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be0688-4b70-4793-9cf9-1912dda2ea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.960587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be0688-4b70-4793-9cf9-1912dda2ea41 admin admin] PATH_INFO: `/v3/projects/36f630f1bb504862834d80e32f62db85/users/66caaebd846242c5b7d9e2215bb668f3/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.963025 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:58.963811 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970db48-7011-413b-babd-815d1c10e22f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:58.968635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe0446-e1c2-4b93-8e9f-9acb1fed9338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:58.969298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe0446-e1c2-4b93-8e9f-9acb1fed9338 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:58.969708 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe0446-e1c2-4b93-8e9f-9acb1fed9338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:58.970159 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe0446-e1c2-4b93-8e9f-9acb1fed9338 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:58.970898 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe0446-e1c2-4b93-8e9f-9acb1fed9338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:37:58.971215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe0446-e1c2-4b93-8e9f-9acb1fed9338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.973490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe0446-e1c2-4b93-8e9f-9acb1fed9338 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.978769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be0688-4b70-4793-9cf9-1912dda2ea41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f630f1bb504862834d80e32f62db85, user_id=66caaebd846242c5b7d9e2215bb668f3, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:58.981534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be0688-4b70-4793-9cf9-1912dda2ea41 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:58.987730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1077/2099] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:37:58.992241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe0446-e1c2-4b93-8e9f-9acb1fed9338 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:58.995112 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1023/2100] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:58 2022] PUT /identity/v3/projects/36f630f1bb504862834d80e32f62db85/users/66caaebd846242c5b7d9e2215bb668f3/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:59.004955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe0446-e1c2-4b93-8e9f-9acb1fed9338 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.006031 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be0688-4b70-4793-9cf9-1912dda2ea41 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.066518 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa99834-b3f0-43b0-82d1-05672c6e8cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.067686 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa99834-b3f0-43b0-82d1-05672c6e8cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.067976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa99834-b3f0-43b0-82d1-05672c6e8cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.068254 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa99834-b3f0-43b0-82d1-05672c6e8cbf admin admin] PATH_INFO: `/v3/projects/3129a35d484445db9e141028b2e77497/users/932ad1f03da24593a6ad444f6cb95e6d/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.072142 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be0688-4b70-4793-9cf9-1912dda2ea41 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.076417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973079b-8027-4836-b763-840f72489d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.077174 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973079b-8027-4836-b763-840f72489d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.077460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973079b-8027-4836-b763-840f72489d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.077738 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973079b-8027-4836-b763-840f72489d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.078437 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973079b-8027-4836-b763-840f72489d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.081496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973079b-8027-4836-b763-840f72489d5e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.083780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa99834-b3f0-43b0-82d1-05672c6e8cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3129a35d484445db9e141028b2e77497, user_id=932ad1f03da24593a6ad444f6cb95e6d, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.086530 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa99834-b3f0-43b0-82d1-05672c6e8cbf admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.104718 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1078/2101] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:58 2022] PUT /identity/v3/projects/3129a35d484445db9e141028b2e77497/users/932ad1f03da24593a6ad444f6cb95e6d/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:59.105842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a750e-14f1-4950-b221-027a0235e728 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.106131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a750e-14f1-4950-b221-027a0235e728 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.106442 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a750e-14f1-4950-b221-027a0235e728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.115347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1024/2102] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:58 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:59.116680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fa692-04c6-4267-8fb8-a2ff80d45a4a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.116974 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fa692-04c6-4267-8fb8-a2ff80d45a4a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.117260 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fa692-04c6-4267-8fb8-a2ff80d45a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.135847 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ed9fa692-04c6-4267-8fb8-a2ff80d45a4a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:59.136940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ed9fa692-04c6-4267-8fb8-a2ff80d45a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:59.141534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0a0a750e-14f1-4950-b221-027a0235e728 None None] MFA Rules not processed for user `66caaebd846242c5b7d9e2215bb668f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:59.142790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0a0a750e-14f1-4950-b221-027a0235e728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:59.152580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:59.204465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1025/2103] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:59.204465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fa692-04c6-4267-8fb8-a2ff80d45a4a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.214907 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fa692-04c6-4267-8fb8-a2ff80d45a4a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.220081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4d1c7-24df-4d3f-b8de-e20b0f11092e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.221013 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4d1c7-24df-4d3f-b8de-e20b0f11092e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.221460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4d1c7-24df-4d3f-b8de-e20b0f11092e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.222323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4d1c7-24df-4d3f-b8de-e20b0f11092e admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.223122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4d1c7-24df-4d3f-b8de-e20b0f11092e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.223650 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1079/2104] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:59.224698 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a750e-14f1-4950-b221-027a0235e728 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.225872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4d1c7-24df-4d3f-b8de-e20b0f11092e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.226110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0a0a750e-14f1-4950-b221-027a0235e728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:59.257237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1026/2105] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:59 2022] POST /identity/v3/users => generated 288 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:59.258034 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4d1c7-24df-4d3f-b8de-e20b0f11092e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.270802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4d1c7-24df-4d3f-b8de-e20b0f11092e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.275586 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d8abd-9035-486d-8799-837b67cea254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.276310 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d8abd-9035-486d-8799-837b67cea254 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.276583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d8abd-9035-486d-8799-837b67cea254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.276925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d8abd-9035-486d-8799-837b67cea254 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.277717 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d8abd-9035-486d-8799-837b67cea254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.279819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d8abd-9035-486d-8799-837b67cea254 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.301218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a750e-14f1-4950-b221-027a0235e728 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.305237 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa070d-e21b-43c6-8e7c-7d6e1af56f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.305892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa070d-e21b-43c6-8e7c-7d6e1af56f2f service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.306179 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa070d-e21b-43c6-8e7c-7d6e1af56f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.306455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa070d-e21b-43c6-8e7c-7d6e1af56f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.309019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1027/2106] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:59 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:59.310156 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d8abd-9035-486d-8799-837b67cea254 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.317561 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa070d-e21b-43c6-8e7c-7d6e1af56f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.319025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa070d-e21b-43c6-8e7c-7d6e1af56f2f service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.329696 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1080/2107] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:37:59.330519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa070d-e21b-43c6-8e7c-7d6e1af56f2f service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.340682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa070d-e21b-43c6-8e7c-7d6e1af56f2f service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.343230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:59.389337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d8abd-9035-486d-8799-837b67cea254 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.397837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291fbc-ec57-44b9-a800-9cd7708bfc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.398522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291fbc-ec57-44b9-a800-9cd7708bfc7f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.398807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291fbc-ec57-44b9-a800-9cd7708bfc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.399088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291fbc-ec57-44b9-a800-9cd7708bfc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.399820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d291fbc-ec57-44b9-a800-9cd7708bfc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.401496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d291fbc-ec57-44b9-a800-9cd7708bfc7f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.406088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa88c41-545e-4a5f-a3f2-6c3481f1f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.406807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa88c41-545e-4a5f-a3f2-6c3481f1f949 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.407200 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa88c41-545e-4a5f-a3f2-6c3481f1f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.408124 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa88c41-545e-4a5f-a3f2-6c3481f1f949 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.408962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa88c41-545e-4a5f-a3f2-6c3481f1f949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.411244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa88c41-545e-4a5f-a3f2-6c3481f1f949 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.413338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1028/2108] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:37:59.417445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291fbc-ec57-44b9-a800-9cd7708bfc7f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.429626 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291fbc-ec57-44b9-a800-9cd7708bfc7f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.435791 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae557a55-3d25-4335-a8c8-3fa28e209e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.436485 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae557a55-3d25-4335-a8c8-3fa28e209e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.436770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae557a55-3d25-4335-a8c8-3fa28e209e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.437053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae557a55-3d25-4335-a8c8-3fa28e209e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.437759 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae557a55-3d25-4335-a8c8-3fa28e209e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.439756 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae557a55-3d25-4335-a8c8-3fa28e209e71 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.442434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1081/2109] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:59 2022] POST /identity/v3/users => generated 306 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:37:59.446094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa88c41-545e-4a5f-a3f2-6c3481f1f949 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.453175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1029/2110] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:37:59.457810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae557a55-3d25-4335-a8c8-3fa28e209e71 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.458906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa88c41-545e-4a5f-a3f2-6c3481f1f949 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.476574 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae557a55-3d25-4335-a8c8-3fa28e209e71 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.477325 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69faa192-75d3-410a-848a-fe8084bde5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.478014 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faa192-75d3-410a-848a-fe8084bde5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.478304 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faa192-75d3-410a-848a-fe8084bde5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.478847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faa192-75d3-410a-848a-fe8084bde5e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.479520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69faa192-75d3-410a-848a-fe8084bde5e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.481393 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69faa192-75d3-410a-848a-fe8084bde5e7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.488734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbe23b-5534-4205-9cba-04932b16d580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.491054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbe23b-5534-4205-9cba-04932b16d580 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.491673 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbe23b-5534-4205-9cba-04932b16d580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.492354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbe23b-5534-4205-9cba-04932b16d580 admin admin] PATH_INFO: `/v3/projects/18f6583cb4084a589280478719d80438/users/dd2e213f15c540e0975921aa16e4983d/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.497614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1082/2111] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:37:59.502618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69faa192-75d3-410a-848a-fe8084bde5e7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.511865 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbe23b-5534-4205-9cba-04932b16d580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f6583cb4084a589280478719d80438, user_id=dd2e213f15c540e0975921aa16e4983d, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.517284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbe23b-5534-4205-9cba-04932b16d580 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.520864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69faa192-75d3-410a-848a-fe8084bde5e7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.527330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a55321-dc31-4403-9e8c-111e7d0f2067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.529347 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a55321-dc31-4403-9e8c-111e7d0f2067 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.529347 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a55321-dc31-4403-9e8c-111e7d0f2067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.529924 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a55321-dc31-4403-9e8c-111e7d0f2067 admin admin] PATH_INFO: `/v3/projects/612d37a4a4c846168b7565b3e3983426/users/c05396b5c6ba47fda834b02a83cfc02d/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.534937 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1030/2112] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:59 2022] PUT /identity/v3/projects/18f6583cb4084a589280478719d80438/users/dd2e213f15c540e0975921aa16e4983d/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:37:59.546543 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32943b-9ee5-4386-abb0-60013fbad13f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.546819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32943b-9ee5-4386-abb0-60013fbad13f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.547100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32943b-9ee5-4386-abb0-60013fbad13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.551162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a55321-dc31-4403-9e8c-111e7d0f2067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=612d37a4a4c846168b7565b3e3983426, user_id=c05396b5c6ba47fda834b02a83cfc02d, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.554909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a55321-dc31-4403-9e8c-111e7d0f2067 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.577051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1083/2113] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:59 2022] PUT /identity/v3/projects/612d37a4a4c846168b7565b3e3983426/users/c05396b5c6ba47fda834b02a83cfc02d/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:59.586305 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bb32943b-9ee5-4386-abb0-60013fbad13f None None] MFA Rules not processed for user `dd2e213f15c540e0975921aa16e4983d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:59.586842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a55321-dc31-4403-9e8c-111e7d0f2067 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.587559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bb32943b-9ee5-4386-abb0-60013fbad13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:59.604080 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:59.684200 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1031/2114] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:37:59.689085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32943b-9ee5-4386-abb0-60013fbad13f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.692310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a55321-dc31-4403-9e8c-111e7d0f2067 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.697664 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b7e35-7d09-4df3-b608-db657dfdb213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.698557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b7e35-7d09-4df3-b608-db657dfdb213 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.699187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b7e35-7d09-4df3-b608-db657dfdb213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.699579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b7e35-7d09-4df3-b608-db657dfdb213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.700637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b7e35-7d09-4df3-b608-db657dfdb213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.701190 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32943b-9ee5-4386-abb0-60013fbad13f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.702609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b7e35-7d09-4df3-b608-db657dfdb213 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.707709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2859fbb-6f7e-46c1-a480-9bdd938c3bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.708290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2859fbb-6f7e-46c1-a480-9bdd938c3bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.708610 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2859fbb-6f7e-46c1-a480-9bdd938c3bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.708888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2859fbb-6f7e-46c1-a480-9bdd938c3bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.709576 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2859fbb-6f7e-46c1-a480-9bdd938c3bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.712714 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2859fbb-6f7e-46c1-a480-9bdd938c3bf9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.716565 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1084/2115] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:37:59.725318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b7e35-7d09-4df3-b608-db657dfdb213 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.737463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b7e35-7d09-4df3-b608-db657dfdb213 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.745895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5a176-e3a4-4422-8511-6440fb5946b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.747431 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5a176-e3a4-4422-8511-6440fb5946b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.747840 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5a176-e3a4-4422-8511-6440fb5946b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.748219 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5a176-e3a4-4422-8511-6440fb5946b5 admin admin] PATH_INFO: `/v3/projects/612d37a4a4c846168b7565b3e3983426/users/c05396b5c6ba47fda834b02a83cfc02d/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.751453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5a176-e3a4-4422-8511-6440fb5946b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=612d37a4a4c846168b7565b3e3983426, user_id=c05396b5c6ba47fda834b02a83cfc02d, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.756693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5a176-e3a4-4422-8511-6440fb5946b5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.757527 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1032/2116] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:37:59 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:37:59.763098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2859fbb-6f7e-46c1-a480-9bdd938c3bf9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.773763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1085/2117] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:37:59 2022] PUT /identity/v3/projects/612d37a4a4c846168b7565b3e3983426/users/c05396b5c6ba47fda834b02a83cfc02d/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:37:59.785494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cf78d-b3c7-44b7-8dfe-83f41dda5a4e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.785897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cf78d-b3c7-44b7-8dfe-83f41dda5a4e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.786187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cf78d-b3c7-44b7-8dfe-83f41dda5a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.825689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0c1cf78d-b3c7-44b7-8dfe-83f41dda5a4e None None] MFA Rules not processed for user `c05396b5c6ba47fda834b02a83cfc02d`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:37:59.827085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0c1cf78d-b3c7-44b7-8dfe-83f41dda5a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:59.853668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:59.861678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2859fbb-6f7e-46c1-a480-9bdd938c3bf9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:37:59.956771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1086/2118] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:37:59 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:37:59.965460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cf78d-b3c7-44b7-8dfe-83f41dda5a4e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:37:59.966613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbce11-1ed3-4f70-b316-7d8ede8a1ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:37:59.966754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbce11-1ed3-4f70-b316-7d8ede8a1ddb admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:37:59.966960 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbce11-1ed3-4f70-b316-7d8ede8a1ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:37:59.967354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbce11-1ed3-4f70-b316-7d8ede8a1ddb admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:37:59.968307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbce11-1ed3-4f70-b316-7d8ede8a1ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:37:59.969153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0c1cf78d-b3c7-44b7-8dfe-83f41dda5a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:37:59.970577 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbce11-1ed3-4f70-b316-7d8ede8a1ddb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:37:59.999654 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1033/2119] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:37:59 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:00.000719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbce11-1ed3-4f70-b316-7d8ede8a1ddb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:00.011691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbce11-1ed3-4f70-b316-7d8ede8a1ddb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:00.018263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715756b-1de6-45ed-8d64-b087cc657cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:00.019631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715756b-1de6-45ed-8d64-b087cc657cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:00.019631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715756b-1de6-45ed-8d64-b087cc657cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:00.019631 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715756b-1de6-45ed-8d64-b087cc657cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:00.021009 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715756b-1de6-45ed-8d64-b087cc657cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:00.023295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715756b-1de6-45ed-8d64-b087cc657cd0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:00.035004 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1034/2120] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:00.040899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715756b-1de6-45ed-8d64-b087cc657cd0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:00.052657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cf78d-b3c7-44b7-8dfe-83f41dda5a4e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:00.057742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83f593-a5c6-46d5-b1cb-38072ef31e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:00.058495 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83f593-a5c6-46d5-b1cb-38072ef31e0b service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:00.058793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83f593-a5c6-46d5-b1cb-38072ef31e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:00.059230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83f593-a5c6-46d5-b1cb-38072ef31e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:00.060232 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715756b-1de6-45ed-8d64-b087cc657cd0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:00.066473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cac935-57f6-4174-9880-e5b4e8835198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:00.071116 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83f593-a5c6-46d5-b1cb-38072ef31e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:00.072868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83f593-a5c6-46d5-b1cb-38072ef31e0b service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:00.073635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cac935-57f6-4174-9880-e5b4e8835198 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:00.074539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cac935-57f6-4174-9880-e5b4e8835198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:00.075033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cac935-57f6-4174-9880-e5b4e8835198 admin admin] PATH_INFO: `/v3/projects/e075a17d75144ad28cc8991086d2ee97/users/da381f4b535a420e8dc14f66898e9383/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:00.098811 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1087/2121] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:37:59 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:38:00.099379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cac935-57f6-4174-9880-e5b4e8835198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e075a17d75144ad28cc8991086d2ee97, user_id=da381f4b535a420e8dc14f66898e9383, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:00.103612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cac935-57f6-4174-9880-e5b4e8835198 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:00.130436 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1035/2122] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:00 2022] PUT /identity/v3/projects/e075a17d75144ad28cc8991086d2ee97/users/da381f4b535a420e8dc14f66898e9383/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:00.134392 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83f593-a5c6-46d5-b1cb-38072ef31e0b service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:00.154996 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83f593-a5c6-46d5-b1cb-38072ef31e0b service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:00.184503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:00.201085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cac935-57f6-4174-9880-e5b4e8835198 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:00.202859 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-47cac935-57f6-4174-9880-e5b4e8835198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:00.305884 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bebb9-77ad-4f7c-b7b8-c62b9718bec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:00.306581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bebb9-77ad-4f7c-b7b8-c62b9718bec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:00.306866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bebb9-77ad-4f7c-b7b8-c62b9718bec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:00.307151 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bebb9-77ad-4f7c-b7b8-c62b9718bec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:00.308492 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bebb9-77ad-4f7c-b7b8-c62b9718bec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:00.310111 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bebb9-77ad-4f7c-b7b8-c62b9718bec8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:00.342803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1088/2123] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:00.345247 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d3df6-fd67-4eba-ae75-23d619d41d73 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:00.345741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d3df6-fd67-4eba-ae75-23d619d41d73 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:00.346051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d3df6-fd67-4eba-ae75-23d619d41d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:00.346869 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cac935-57f6-4174-9880-e5b4e8835198 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:00.359605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412da58-3e29-48c2-8235-bbcda43ab74c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:00.362726 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412da58-3e29-48c2-8235-bbcda43ab74c service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:00.362726 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412da58-3e29-48c2-8235-bbcda43ab74c service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:00.362934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412da58-3e29-48c2-8235-bbcda43ab74c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:00.383550 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b02d3df6-fd67-4eba-ae75-23d619d41d73 None None] MFA Rules not processed for user `932ad1f03da24593a6ad444f6cb95e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:00.386341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b02d3df6-fd67-4eba-ae75-23d619d41d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:00.446472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412da58-3e29-48c2-8235-bbcda43ab74c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:00.448378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412da58-3e29-48c2-8235-bbcda43ab74c service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:00.460307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1036/2124] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:00.461787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412da58-3e29-48c2-8235-bbcda43ab74c service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:00.474541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412da58-3e29-48c2-8235-bbcda43ab74c service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:00.483572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baafe48-b17e-4138-b210-1b9a889ee5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:00.485833 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baafe48-b17e-4138-b210-1b9a889ee5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:00.486317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baafe48-b17e-4138-b210-1b9a889ee5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:00.486768 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baafe48-b17e-4138-b210-1b9a889ee5ad admin admin] PATH_INFO: `/v3/projects/e075a17d75144ad28cc8991086d2ee97/users/da381f4b535a420e8dc14f66898e9383/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:00.489760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baafe48-b17e-4138-b210-1b9a889ee5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e075a17d75144ad28cc8991086d2ee97, user_id=da381f4b535a420e8dc14f66898e9383, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:00.493375 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baafe48-b17e-4138-b210-1b9a889ee5ad admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:00.503924 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:00.513939 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1037/2125] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:00 2022] PUT /identity/v3/projects/e075a17d75144ad28cc8991086d2ee97/users/da381f4b535a420e8dc14f66898e9383/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:00.525868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe7228-94da-46a4-88ae-9adcc39fd186 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:00.526543 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe7228-94da-46a4-88ae-9adcc39fd186 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:00.527019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe7228-94da-46a4-88ae-9adcc39fd186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:00.535940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1089/2126] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:00.568768 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d3df6-fd67-4eba-ae75-23d619d41d73 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:00.577026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-69fe7228-94da-46a4-88ae-9adcc39fd186 None None] MFA Rules not processed for user `da381f4b535a420e8dc14f66898e9383`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:00.581455 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-69fe7228-94da-46a4-88ae-9adcc39fd186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:00.585685 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d3df6-fd67-4eba-ae75-23d619d41d73 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:00.717369 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1038/2127] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:00.734870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f605901-c251-4d6c-8471-43e2c2e77d39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:00.735607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f605901-c251-4d6c-8471-43e2c2e77d39 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:00.735942 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f605901-c251-4d6c-8471-43e2c2e77d39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:00.736195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f605901-c251-4d6c-8471-43e2c2e77d39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:00.783741 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239fee-1025-4cc4-8dc5-76664c05f1cf None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:00.784130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239fee-1025-4cc4-8dc5-76664c05f1cf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:00.784431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239fee-1025-4cc4-8dc5-76664c05f1cf None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:00.786222 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1039/2128] 10.222.0.66 () {54 vars in 921 bytes} [Fri Jul 15 20:38:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:38:00.800679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2d40-45b3-4abe-90bc-752110e02939 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:00.801047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2d40-45b3-4abe-90bc-752110e02939 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:00.801978 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2d40-45b3-4abe-90bc-752110e02939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:00.831109 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-363c2d40-45b3-4abe-90bc-752110e02939 None None] MFA Rules not processed for user `6693dd1ea26049c1ac8460faf1bc9b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:00.833798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-363c2d40-45b3-4abe-90bc-752110e02939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:00.859338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f605901-c251-4d6c-8471-43e2c2e77d39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:00.863606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f605901-c251-4d6c-8471-43e2c2e77d39 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:00.878503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:00.889210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1090/2129] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:38:00.966391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f605901-c251-4d6c-8471-43e2c2e77d39 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:00.976682 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1040/2130] 10.222.0.66 () {58 vars in 1018 bytes} [Fri Jul 15 20:38:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:00.978894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f605901-c251-4d6c-8471-43e2c2e77d39 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:00.983362 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23a37f-e5fe-4402-9545-595fb471e7c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:00.984205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23a37f-e5fe-4402-9545-595fb471e7c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:00.984606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23a37f-e5fe-4402-9545-595fb471e7c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:00.985162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23a37f-e5fe-4402-9545-595fb471e7c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:01.076438 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23a37f-e5fe-4402-9545-595fb471e7c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:01.078293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23a37f-e5fe-4402-9545-595fb471e7c8 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:01.095926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1091/2131] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:38:01.124681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c2d40-45b3-4abe-90bc-752110e02939 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:01.127113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-363c2d40-45b3-4abe-90bc-752110e02939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:01.150609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c2d40-45b3-4abe-90bc-752110e02939 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:01.159955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77001eb8-5084-4c98-b4c1-59a0c0e43038 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6693dd1ea26049c1ac8460faf1bc9b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:01.160928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77001eb8-5084-4c98-b4c1-59a0c0e43038 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:01.161387 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77001eb8-5084-4c98-b4c1-59a0c0e43038 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:01.161743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77001eb8-5084-4c98-b4c1-59a0c0e43038 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:01.179811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77001eb8-5084-4c98-b4c1-59a0c0e43038 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:01.182350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77001eb8-5084-4c98-b4c1-59a0c0e43038 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:01.199192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1041/2132] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:01.667940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23a37f-e5fe-4402-9545-595fb471e7c8 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:01.672385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9f23a37f-e5fe-4402-9545-595fb471e7c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:01.755125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23a37f-e5fe-4402-9545-595fb471e7c8 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:01.760559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98661a-4328-4d66-8eb2-b313168953c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:01.761795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98661a-4328-4d66-8eb2-b313168953c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:01.762255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98661a-4328-4d66-8eb2-b313168953c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:01.762668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98661a-4328-4d66-8eb2-b313168953c2 admin admin] PATH_INFO: `/v3/users/d137315902174a859da3a058d3024496` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:01.764130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98661a-4328-4d66-8eb2-b313168953c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d137315902174a859da3a058d3024496)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:01.766229 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98661a-4328-4d66-8eb2-b313168953c2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:01.819772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2e98661a-4328-4d66-8eb2-b313168953c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd137315902174a859da3a058d3024496'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:01.835319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2e98661a-4328-4d66-8eb2-b313168953c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd137315902174a859da3a058d3024496'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:01.846640 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2e98661a-4328-4d66-8eb2-b313168953c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd137315902174a859da3a058d3024496'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:01.847614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2e98661a-4328-4d66-8eb2-b313168953c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd137315902174a859da3a058d3024496'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:01.862524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2e98661a-4328-4d66-8eb2-b313168953c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd137315902174a859da3a058d3024496'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:01.868926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1092/2133] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:01 2022] DELETE /identity/v3/users/d137315902174a859da3a058d3024496 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:02.053934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77001eb8-5084-4c98-b4c1-59a0c0e43038 service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:02.065059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77001eb8-5084-4c98-b4c1-59a0c0e43038 service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:02.146598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf916b5-0fbe-4f21-a75b-dbd927586c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:02.147481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf916b5-0fbe-4f21-a75b-dbd927586c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:02.147763 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf916b5-0fbe-4f21-a75b-dbd927586c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:02.148046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf916b5-0fbe-4f21-a75b-dbd927586c47 admin admin] PATH_INFO: `/v3/projects/c74043c0161a41cbad50e1b5dc636e2e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:02.149459 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf916b5-0fbe-4f21-a75b-dbd927586c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c74043c0161a41cbad50e1b5dc636e2e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:02.151371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf916b5-0fbe-4f21-a75b-dbd927586c47 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:02.162448 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:02.219465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5cf916b5-0fbe-4f21-a75b-dbd927586c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c74043c0161a41cbad50e1b5dc636e2e', 'request_id': 'req-5cf916b5-0fbe-4f21-a75b-dbd927586c47'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.227990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5cf916b5-0fbe-4f21-a75b-dbd927586c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c74043c0161a41cbad50e1b5dc636e2e', 'request_id': 'req-5cf916b5-0fbe-4f21-a75b-dbd927586c47'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.234601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5cf916b5-0fbe-4f21-a75b-dbd927586c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c74043c0161a41cbad50e1b5dc636e2e', 'request_id': 'req-5cf916b5-0fbe-4f21-a75b-dbd927586c47'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.246615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5cf916b5-0fbe-4f21-a75b-dbd927586c47 admin admin] The token cache is being invalidate because project c74043c0161a41cbad50e1b5dc636e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:02.246900 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5cf916b5-0fbe-4f21-a75b-dbd927586c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.247735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5cf916b5-0fbe-4f21-a75b-dbd927586c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.249203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1042/2134] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:02 2022] DELETE /identity/v3/projects/c74043c0161a41cbad50e1b5dc636e2e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:02.253954 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98661a-4328-4d66-8eb2-b313168953c2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:02.255943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2e98661a-4328-4d66-8eb2-b313168953c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:02.270362 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98661a-4328-4d66-8eb2-b313168953c2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:02.283836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:02.330000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fad9cf-bba1-4416-95bf-ddb932584cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:02.330896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fad9cf-bba1-4416-95bf-ddb932584cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:02.331181 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fad9cf-bba1-4416-95bf-ddb932584cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:02.331460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fad9cf-bba1-4416-95bf-ddb932584cfd admin admin] PATH_INFO: `/v3/users/438c48d11f0149da87f3b4d3a83b4351` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:02.332689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fad9cf-bba1-4416-95bf-ddb932584cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=438c48d11f0149da87f3b4d3a83b4351)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:02.334624 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fad9cf-bba1-4416-95bf-ddb932584cfd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:02.384021 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c5fad9cf-bba1-4416-95bf-ddb932584cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '438c48d11f0149da87f3b4d3a83b4351'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.392277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c5fad9cf-bba1-4416-95bf-ddb932584cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '438c48d11f0149da87f3b4d3a83b4351'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.399588 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c5fad9cf-bba1-4416-95bf-ddb932584cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '438c48d11f0149da87f3b4d3a83b4351'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.400335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c5fad9cf-bba1-4416-95bf-ddb932584cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '438c48d11f0149da87f3b4d3a83b4351'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.413529 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c5fad9cf-bba1-4416-95bf-ddb932584cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '438c48d11f0149da87f3b4d3a83b4351'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.419868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1093/2135] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:02 2022] DELETE /identity/v3/users/438c48d11f0149da87f3b4d3a83b4351 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:02.539735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec6b80-0a7e-4602-b445-b0d19ca48528 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:02.540036 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec6b80-0a7e-4602-b445-b0d19ca48528 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:02.540322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec6b80-0a7e-4602-b445-b0d19ca48528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:02.563624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1eec6b80-0a7e-4602-b445-b0d19ca48528 None None] MFA Rules not processed for user `932ad1f03da24593a6ad444f6cb95e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:02.566043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1eec6b80-0a7e-4602-b445-b0d19ca48528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:02.657592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fad9cf-bba1-4416-95bf-ddb932584cfd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:02.660134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c5fad9cf-bba1-4416-95bf-ddb932584cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:02.670468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1043/2136] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:02.781034 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fad9cf-bba1-4416-95bf-ddb932584cfd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:02.807423 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef65ed-427e-4d9c-9afe-8630f4749dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:02.808309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef65ed-427e-4d9c-9afe-8630f4749dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:02.808683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef65ed-427e-4d9c-9afe-8630f4749dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:02.808912 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef65ed-427e-4d9c-9afe-8630f4749dd5 admin admin] PATH_INFO: `/v3/projects/b2f37298e2e34074aa43062e6575c62d` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:02.810585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef65ed-427e-4d9c-9afe-8630f4749dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f37298e2e34074aa43062e6575c62d)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:02.813582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef65ed-427e-4d9c-9afe-8630f4749dd5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:02.878132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:02.901004 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-79ef65ed-427e-4d9c-9afe-8630f4749dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f37298e2e34074aa43062e6575c62d', 'request_id': 'req-79ef65ed-427e-4d9c-9afe-8630f4749dd5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.914830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-79ef65ed-427e-4d9c-9afe-8630f4749dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f37298e2e34074aa43062e6575c62d', 'request_id': 'req-79ef65ed-427e-4d9c-9afe-8630f4749dd5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.925082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-79ef65ed-427e-4d9c-9afe-8630f4749dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f37298e2e34074aa43062e6575c62d', 'request_id': 'req-79ef65ed-427e-4d9c-9afe-8630f4749dd5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.948651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-79ef65ed-427e-4d9c-9afe-8630f4749dd5 admin admin] The token cache is being invalidate because project b2f37298e2e34074aa43062e6575c62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:02.949340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-79ef65ed-427e-4d9c-9afe-8630f4749dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.950512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-79ef65ed-427e-4d9c-9afe-8630f4749dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:02.954469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1094/2137] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:02 2022] DELETE /identity/v3/projects/b2f37298e2e34074aa43062e6575c62d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:02.962127 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c64806-8399-47c4-994d-f0953f7195fc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:02.962724 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c64806-8399-47c4-994d-f0953f7195fc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:02.963554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c64806-8399-47c4-994d-f0953f7195fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:02.989487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c5c64806-8399-47c4-994d-f0953f7195fc None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:02.990707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c5c64806-8399-47c4-994d-f0953f7195fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:03.059449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1044/2138] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:03.067809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3446-2ebf-4979-8d81-c914659b4c68 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:03.068312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3446-2ebf-4979-8d81-c914659b4c68 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:03.068739 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3446-2ebf-4979-8d81-c914659b4c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:03.088828 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-81dc3446-2ebf-4979-8d81-c914659b4c68 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:03.090101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-81dc3446-2ebf-4979-8d81-c914659b4c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:03.099906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1095/2139] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:03.104068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c64806-8399-47c4-994d-f0953f7195fc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:03.113951 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c64806-8399-47c4-994d-f0953f7195fc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:03.118599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2f9a0-ae90-4ea0-b873-fdd3305f62db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:03.119263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2f9a0-ae90-4ea0-b873-fdd3305f62db admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:03.119546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2f9a0-ae90-4ea0-b873-fdd3305f62db admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:03.119822 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2f9a0-ae90-4ea0-b873-fdd3305f62db admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:03.120677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2f9a0-ae90-4ea0-b873-fdd3305f62db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:03.120986 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2f9a0-ae90-4ea0-b873-fdd3305f62db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:03.122588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2f9a0-ae90-4ea0-b873-fdd3305f62db admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:03.138111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1045/2140] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:03.139209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc3446-2ebf-4979-8d81-c914659b4c68 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:03.148994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc3446-2ebf-4979-8d81-c914659b4c68 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:03.153999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f859d-9d83-42a5-a62d-991602bb5778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:03.154660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f859d-9d83-42a5-a62d-991602bb5778 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:03.154945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f859d-9d83-42a5-a62d-991602bb5778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:03.155220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f859d-9d83-42a5-a62d-991602bb5778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:03.155910 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f859d-9d83-42a5-a62d-991602bb5778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:03.158539 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f859d-9d83-42a5-a62d-991602bb5778 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:03.195134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1096/2141] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:03 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:03.196930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2f9a0-ae90-4ea0-b873-fdd3305f62db admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:03.208801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2f9a0-ae90-4ea0-b873-fdd3305f62db admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:03.243919 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:03.297170 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b172af-62a8-4090-a4a2-dbb927831f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:03.298121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b172af-62a8-4090-a4a2-dbb927831f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:03.298628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b172af-62a8-4090-a4a2-dbb927831f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:03.299121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b172af-62a8-4090-a4a2-dbb927831f68 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:03.300011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b172af-62a8-4090-a4a2-dbb927831f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:03.302224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b172af-62a8-4090-a4a2-dbb927831f68 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:03.327823 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1046/2142] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:03 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:03.329557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f859d-9d83-42a5-a62d-991602bb5778 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:03.342147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f859d-9d83-42a5-a62d-991602bb5778 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:03.348704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefc457-0939-45e1-9e10-97928baec97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:03.349511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefc457-0939-45e1-9e10-97928baec97a admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:03.349903 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefc457-0939-45e1-9e10-97928baec97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:03.350288 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefc457-0939-45e1-9e10-97928baec97a admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:03.351220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefc457-0939-45e1-9e10-97928baec97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:03.353012 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefc457-0939-45e1-9e10-97928baec97a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:03.365255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1097/2143] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:38:03.369575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b172af-62a8-4090-a4a2-dbb927831f68 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:03.382627 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b172af-62a8-4090-a4a2-dbb927831f68 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:03.389431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187a017-64cb-45d5-9789-1bf42735bedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:03.390423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187a017-64cb-45d5-9789-1bf42735bedf admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:03.390738 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187a017-64cb-45d5-9789-1bf42735bedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:03.391551 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187a017-64cb-45d5-9789-1bf42735bedf admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:03.392640 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187a017-64cb-45d5-9789-1bf42735bedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:03.394730 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187a017-64cb-45d5-9789-1bf42735bedf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:03.410801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1047/2144] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:03.415936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefc457-0939-45e1-9e10-97928baec97a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:03.429865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefc457-0939-45e1-9e10-97928baec97a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:03.434865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79f710-706a-428b-b44b-9df0c450b3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:03.435853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79f710-706a-428b-b44b-9df0c450b3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:03.436236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79f710-706a-428b-b44b-9df0c450b3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:03.436652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79f710-706a-428b-b44b-9df0c450b3f9 admin admin] PATH_INFO: `/v3/projects/b3f51114a89748ef9a1dce6fe5e4e97f/users/be49b6c404234866989cfca0db6a9792/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:03.462088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79f710-706a-428b-b44b-9df0c450b3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f51114a89748ef9a1dce6fe5e4e97f, user_id=be49b6c404234866989cfca0db6a9792, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:03.465062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79f710-706a-428b-b44b-9df0c450b3f9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:03.480564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1098/2145] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:03 2022] PUT /identity/v3/projects/b3f51114a89748ef9a1dce6fe5e4e97f/users/be49b6c404234866989cfca0db6a9792/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:03.491492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c3f84-9076-442d-b929-ec8f04420898 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:03.491788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c3f84-9076-442d-b929-ec8f04420898 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:03.492038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c3f84-9076-442d-b929-ec8f04420898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:03.524102 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-913c3f84-9076-442d-b929-ec8f04420898 None None] MFA Rules not processed for user `be49b6c404234866989cfca0db6a9792`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:03.525351 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-913c3f84-9076-442d-b929-ec8f04420898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:03.599638 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1048/2146] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:03.606849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79f710-706a-428b-b44b-9df0c450b3f9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:03.608536 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5b79f710-706a-428b-b44b-9df0c450b3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:03.668507 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79f710-706a-428b-b44b-9df0c450b3f9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:03.674317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51c223-94d5-4b50-888e-5528189b0621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:03.674971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51c223-94d5-4b50-888e-5528189b0621 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:03.675275 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51c223-94d5-4b50-888e-5528189b0621 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:03.675521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51c223-94d5-4b50-888e-5528189b0621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:03.686619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51c223-94d5-4b50-888e-5528189b0621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:03.688199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51c223-94d5-4b50-888e-5528189b0621 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:03.698200 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1099/2147] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:06.134415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c3f84-9076-442d-b929-ec8f04420898 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:06.135861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-913c3f84-9076-442d-b929-ec8f04420898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:06.207432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c3f84-9076-442d-b929-ec8f04420898 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:06.212754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e34c5a-a440-4ffd-8f89-b8388aa830b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:06.213664 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e34c5a-a440-4ffd-8f89-b8388aa830b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:06.213961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e34c5a-a440-4ffd-8f89-b8388aa830b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:06.214243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e34c5a-a440-4ffd-8f89-b8388aa830b8 admin admin] PATH_INFO: `/v3/users/dd2e213f15c540e0975921aa16e4983d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:06.215709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e34c5a-a440-4ffd-8f89-b8388aa830b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2e213f15c540e0975921aa16e4983d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:06.217888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e34c5a-a440-4ffd-8f89-b8388aa830b8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:06.303588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:06.315516 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b1e34c5a-a440-4ffd-8f89-b8388aa830b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2e213f15c540e0975921aa16e4983d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:06.328029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b1e34c5a-a440-4ffd-8f89-b8388aa830b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2e213f15c540e0975921aa16e4983d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:06.329240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b1e34c5a-a440-4ffd-8f89-b8388aa830b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2e213f15c540e0975921aa16e4983d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:06.336433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b1e34c5a-a440-4ffd-8f89-b8388aa830b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2e213f15c540e0975921aa16e4983d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:06.337819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b1e34c5a-a440-4ffd-8f89-b8388aa830b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2e213f15c540e0975921aa16e4983d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:06.358651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1049/2148] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:06 2022] DELETE /identity/v3/users/dd2e213f15c540e0975921aa16e4983d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:06.364480 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f81729-dcd9-4b0d-93b0-1c7049261776 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:06.365378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f81729-dcd9-4b0d-93b0-1c7049261776 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:06.366144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f81729-dcd9-4b0d-93b0-1c7049261776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:06.386356 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-43f81729-dcd9-4b0d-93b0-1c7049261776 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:06.387605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-43f81729-dcd9-4b0d-93b0-1c7049261776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:06.448872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e34c5a-a440-4ffd-8f89-b8388aa830b8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:06.450293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b1e34c5a-a440-4ffd-8f89-b8388aa830b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:06.451636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1100/2149] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:06.461918 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f81729-dcd9-4b0d-93b0-1c7049261776 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:06.463098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-43f81729-dcd9-4b0d-93b0-1c7049261776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:06.467112 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e34c5a-a440-4ffd-8f89-b8388aa830b8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:06.473163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df4c0b-04f6-4b42-a8fc-21f751ad1959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:06.473327 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:06.474034 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4c0b-04f6-4b42-a8fc-21f751ad1959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:06.474366 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4c0b-04f6-4b42-a8fc-21f751ad1959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:06.474771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4c0b-04f6-4b42-a8fc-21f751ad1959 admin admin] PATH_INFO: `/v3/users/66caaebd846242c5b7d9e2215bb668f3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:06.476145 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df4c0b-04f6-4b42-a8fc-21f751ad1959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66caaebd846242c5b7d9e2215bb668f3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:06.478172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df4c0b-04f6-4b42-a8fc-21f751ad1959 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:06.526241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f81729-dcd9-4b0d-93b0-1c7049261776 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:06.527174 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-69df4c0b-04f6-4b42-a8fc-21f751ad1959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66caaebd846242c5b7d9e2215bb668f3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:06.530728 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740578e-7f9b-4a1a-9483-6e25f4a26dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:06.531242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740578e-7f9b-4a1a-9483-6e25f4a26dee service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:06.531467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740578e-7f9b-4a1a-9483-6e25f4a26dee service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:06.532286 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740578e-7f9b-4a1a-9483-6e25f4a26dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:06.541460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-69df4c0b-04f6-4b42-a8fc-21f751ad1959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66caaebd846242c5b7d9e2215bb668f3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:06.542344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-69df4c0b-04f6-4b42-a8fc-21f751ad1959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66caaebd846242c5b7d9e2215bb668f3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:06.542851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740578e-7f9b-4a1a-9483-6e25f4a26dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:06.544294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740578e-7f9b-4a1a-9483-6e25f4a26dee service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:06.551940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-69df4c0b-04f6-4b42-a8fc-21f751ad1959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66caaebd846242c5b7d9e2215bb668f3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:06.552896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-69df4c0b-04f6-4b42-a8fc-21f751ad1959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66caaebd846242c5b7d9e2215bb668f3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:06.555078 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1101/2150] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:38:06.568181 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1050/2151] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:06 2022] DELETE /identity/v3/users/66caaebd846242c5b7d9e2215bb668f3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:38:06.573293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c401928-151c-4530-a6c0-b35b78f495ee None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:06.573625 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c401928-151c-4530-a6c0-b35b78f495ee None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:06.573877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c401928-151c-4530-a6c0-b35b78f495ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:06.591971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7c401928-151c-4530-a6c0-b35b78f495ee None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:06.593216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7c401928-151c-4530-a6c0-b35b78f495ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:06.663563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1102/2152] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:06.674283 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df4c0b-04f6-4b42-a8fc-21f751ad1959 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:06.675770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-69df4c0b-04f6-4b42-a8fc-21f751ad1959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:06.738339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df4c0b-04f6-4b42-a8fc-21f751ad1959 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:06.742185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e971c48-a33b-4d84-b2d1-cbebcae0bf25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:06.742889 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e971c48-a33b-4d84-b2d1-cbebcae0bf25 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:06.743177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e971c48-a33b-4d84-b2d1-cbebcae0bf25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:06.743455 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e971c48-a33b-4d84-b2d1-cbebcae0bf25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:06.754785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e971c48-a33b-4d84-b2d1-cbebcae0bf25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:06.756257 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e971c48-a33b-4d84-b2d1-cbebcae0bf25 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:06.770908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1051/2153] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:38:07.077463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c401928-151c-4530-a6c0-b35b78f495ee None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:07.079677 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7c401928-151c-4530-a6c0-b35b78f495ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:07.092043 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c401928-151c-4530-a6c0-b35b78f495ee None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:07.098068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:07.099112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:07.099403 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:07.099686 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] PATH_INFO: `/v3/projects/36f630f1bb504862834d80e32f62db85` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:07.101891 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f630f1bb504862834d80e32f62db85)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:07.104451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:07.166582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f630f1bb504862834d80e32f62db85', 'request_id': 'req-16e53774-be4d-414f-b02d-d64ea6d6e9d4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.175219 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f630f1bb504862834d80e32f62db85', 'request_id': 'req-16e53774-be4d-414f-b02d-d64ea6d6e9d4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.185217 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f630f1bb504862834d80e32f62db85', 'request_id': 'req-16e53774-be4d-414f-b02d-d64ea6d6e9d4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.201336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] The token cache is being invalidate because project 36f630f1bb504862834d80e32f62db85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:07.201755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.202540 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.205776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1103/2154] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:07 2022] DELETE /identity/v3/projects/36f630f1bb504862834d80e32f62db85 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:07.209086 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e971c48-a33b-4d84-b2d1-cbebcae0bf25 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:07.220754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e971c48-a33b-4d84-b2d1-cbebcae0bf25 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:07.270629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:07.295608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:07.299467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:07.312323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e0c97-52c7-4570-85d4-cceca47c22f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:07.313512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e0c97-52c7-4570-85d4-cceca47c22f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:07.314030 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e0c97-52c7-4570-85d4-cceca47c22f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:07.314399 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e0c97-52c7-4570-85d4-cceca47c22f5 admin admin] PATH_INFO: `/v3/users/c05396b5c6ba47fda834b02a83cfc02d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:07.316158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e0c97-52c7-4570-85d4-cceca47c22f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c05396b5c6ba47fda834b02a83cfc02d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:07.319145 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e0c97-52c7-4570-85d4-cceca47c22f5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:07.341826 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e53774-be4d-414f-b02d-d64ea6d6e9d4 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:07.349361 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:07.350628 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:07.350848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:07.351103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] PATH_INFO: `/v3/projects/18f6583cb4084a589280478719d80438` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:07.354086 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f6583cb4084a589280478719d80438)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:07.356610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:07.387280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b33e0c97-52c7-4570-85d4-cceca47c22f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c05396b5c6ba47fda834b02a83cfc02d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.399098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:07.406945 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b33e0c97-52c7-4570-85d4-cceca47c22f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c05396b5c6ba47fda834b02a83cfc02d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.407743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b33e0c97-52c7-4570-85d4-cceca47c22f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c05396b5c6ba47fda834b02a83cfc02d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.416448 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b33e0c97-52c7-4570-85d4-cceca47c22f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c05396b5c6ba47fda834b02a83cfc02d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.417530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b33e0c97-52c7-4570-85d4-cceca47c22f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c05396b5c6ba47fda834b02a83cfc02d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.423489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f6583cb4084a589280478719d80438', 'request_id': 'req-f1fbf350-7d6e-4ac1-a240-25b42dad2522'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.431741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f6583cb4084a589280478719d80438', 'request_id': 'req-f1fbf350-7d6e-4ac1-a240-25b42dad2522'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.437824 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1052/2155] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:07 2022] DELETE /identity/v3/users/c05396b5c6ba47fda834b02a83cfc02d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:07.448268 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f6583cb4084a589280478719d80438', 'request_id': 'req-f1fbf350-7d6e-4ac1-a240-25b42dad2522'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.470678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] The token cache is being invalidate because project 18f6583cb4084a589280478719d80438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:07.471018 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.471896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.477516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1104/2156] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:07 2022] DELETE /identity/v3/projects/18f6583cb4084a589280478719d80438 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:38:07.478498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e0c97-52c7-4570-85d4-cceca47c22f5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:07.480020 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b33e0c97-52c7-4570-85d4-cceca47c22f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:07.568659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e0c97-52c7-4570-85d4-cceca47c22f5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:07.575659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3c285-f4dc-4787-869e-e2886460aa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:07.576667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3c285-f4dc-4787-869e-e2886460aa45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:07.577026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3c285-f4dc-4787-869e-e2886460aa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:07.577313 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3c285-f4dc-4787-869e-e2886460aa45 admin admin] PATH_INFO: `/v3/users/da381f4b535a420e8dc14f66898e9383` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:07.578589 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3c285-f4dc-4787-869e-e2886460aa45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da381f4b535a420e8dc14f66898e9383)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:07.580643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3c285-f4dc-4787-869e-e2886460aa45 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:07.652485 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18f3c285-f4dc-4787-869e-e2886460aa45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da381f4b535a420e8dc14f66898e9383'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.659956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:07.674201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18f3c285-f4dc-4787-869e-e2886460aa45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da381f4b535a420e8dc14f66898e9383'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.675608 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18f3c285-f4dc-4787-869e-e2886460aa45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da381f4b535a420e8dc14f66898e9383'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.686760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18f3c285-f4dc-4787-869e-e2886460aa45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da381f4b535a420e8dc14f66898e9383'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.689053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18f3c285-f4dc-4787-869e-e2886460aa45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da381f4b535a420e8dc14f66898e9383'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.712120 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1053/2157] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:07 2022] DELETE /identity/v3/users/da381f4b535a420e8dc14f66898e9383 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:07.767560 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:07.769270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:07.858352 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbf350-7d6e-4ac1-a240-25b42dad2522 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:07.922656 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:07.923389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:07.923670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:07.923949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] PATH_INFO: `/v3/projects/612d37a4a4c846168b7565b3e3983426` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:07.925718 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=612d37a4a4c846168b7565b3e3983426)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:07.927702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:07.978868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '612d37a4a4c846168b7565b3e3983426', 'request_id': 'req-f4676e21-bae7-407f-a259-63f17eb68abf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.986368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '612d37a4a4c846168b7565b3e3983426', 'request_id': 'req-f4676e21-bae7-407f-a259-63f17eb68abf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.993584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '612d37a4a4c846168b7565b3e3983426', 'request_id': 'req-f4676e21-bae7-407f-a259-63f17eb68abf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:07.996892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:08.017166 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] The token cache is being invalidate because project 612d37a4a4c846168b7565b3e3983426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:08.017684 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:08.018854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:08.021544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1105/2158] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:07 2022] DELETE /identity/v3/projects/612d37a4a4c846168b7565b3e3983426 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:08.026838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1950f7-db42-4691-ba44-ca4a2a6e6e61 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.027134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1950f7-db42-4691-ba44-ca4a2a6e6e61 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.027596 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1950f7-db42-4691-ba44-ca4a2a6e6e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.036697 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.038356 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:08.066197 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ab1950f7-db42-4691-ba44-ca4a2a6e6e61 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:08.067483 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ab1950f7-db42-4691-ba44-ca4a2a6e6e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:08.148862 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1054/2159] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:08.155218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4676e21-bae7-407f-a259-63f17eb68abf admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.157306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddbe0e-8f11-466b-af14-c8bddf8c088f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.157759 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddbe0e-8f11-466b-af14-c8bddf8c088f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.157861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddbe0e-8f11-466b-af14-c8bddf8c088f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.161976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.162856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.163141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.163432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab admin admin] PATH_INFO: `/v3/projects/e075a17d75144ad28cc8991086d2ee97` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.164683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab admin admin] RBAC: Authorizing `identity:delete_project(project_id=e075a17d75144ad28cc8991086d2ee97)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.166637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.185614 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3dddbe0e-8f11-466b-af14-c8bddf8c088f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:08.186997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3dddbe0e-8f11-466b-af14-c8bddf8c088f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:08.198995 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1055/2160] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:08.200064 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddbe0e-8f11-466b-af14-c8bddf8c088f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.211060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddbe0e-8f11-466b-af14-c8bddf8c088f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.225353 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e075a17d75144ad28cc8991086d2ee97', 'request_id': 'req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:08.231675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e075a17d75144ad28cc8991086d2ee97', 'request_id': 'req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:08.244012 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e075a17d75144ad28cc8991086d2ee97', 'request_id': 'req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:08.269787 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab admin admin] The token cache is being invalidate because project e075a17d75144ad28cc8991086d2ee97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:08.270079 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:08.270749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-094e5fc7-14e3-4427-a6e1-ed6e5002cdab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:08.272682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1106/2161] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:08 2022] DELETE /identity/v3/projects/e075a17d75144ad28cc8991086d2ee97 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:38:08.277865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2f1b0-5420-4060-84ba-e3c4d630ba7f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.278402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2f1b0-5420-4060-84ba-e3c4d630ba7f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.278817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2f1b0-5420-4060-84ba-e3c4d630ba7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.286007 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa928fa0-03a9-401b-81f4-d99a4e1c97d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.286783 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa928fa0-03a9-401b-81f4-d99a4e1c97d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.287135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa928fa0-03a9-401b-81f4-d99a4e1c97d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.287481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa928fa0-03a9-401b-81f4-d99a4e1c97d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.288323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa928fa0-03a9-401b-81f4-d99a4e1c97d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:08.288748 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa928fa0-03a9-401b-81f4-d99a4e1c97d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.290570 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa928fa0-03a9-401b-81f4-d99a4e1c97d2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.301723 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-51b2f1b0-5420-4060-84ba-e3c4d630ba7f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:08.303027 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-51b2f1b0-5420-4060-84ba-e3c4d630ba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:08.303945 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1056/2162] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:08.308545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa928fa0-03a9-401b-81f4-d99a4e1c97d2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.310643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fa928fa0-03a9-401b-81f4-d99a4e1c97d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:08.315816 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1107/2163] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:08.323252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31d361-e820-4216-8d9b-c1fe38fed8ec None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.323546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31d361-e820-4216-8d9b-c1fe38fed8ec None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.323836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31d361-e820-4216-8d9b-c1fe38fed8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.329274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa928fa0-03a9-401b-81f4-d99a4e1c97d2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.336639 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2413463-5077-4ea7-82d9-0774212068b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.337383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2413463-5077-4ea7-82d9-0774212068b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.337769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2413463-5077-4ea7-82d9-0774212068b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.338117 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2413463-5077-4ea7-82d9-0774212068b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.338892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2413463-5077-4ea7-82d9-0774212068b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.341095 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2413463-5077-4ea7-82d9-0774212068b5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.346118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9f31d361-e820-4216-8d9b-c1fe38fed8ec None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:08.347963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9f31d361-e820-4216-8d9b-c1fe38fed8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:08.362678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1108/2164] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:08.366932 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31d361-e820-4216-8d9b-c1fe38fed8ec None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.377523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31d361-e820-4216-8d9b-c1fe38fed8ec None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.378913 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1057/2165] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:08.382248 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2413463-5077-4ea7-82d9-0774212068b5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.430472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:08.461321 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db62748-d9de-4cc6-8c7b-5498f03c9fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.461838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db62748-d9de-4cc6-8c7b-5498f03c9fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.462117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db62748-d9de-4cc6-8c7b-5498f03c9fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.462390 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db62748-d9de-4cc6-8c7b-5498f03c9fd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.463255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db62748-d9de-4cc6-8c7b-5498f03c9fd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:08.463561 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db62748-d9de-4cc6-8c7b-5498f03c9fd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.464998 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2413463-5077-4ea7-82d9-0774212068b5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.465249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db62748-d9de-4cc6-8c7b-5498f03c9fd9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.470677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbd9ee-b347-4b2d-858f-58746b16f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.471350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbd9ee-b347-4b2d-858f-58746b16f548 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.471636 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbd9ee-b347-4b2d-858f-58746b16f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.471916 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbd9ee-b347-4b2d-858f-58746b16f548 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.472655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbd9ee-b347-4b2d-858f-58746b16f548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.474614 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbd9ee-b347-4b2d-858f-58746b16f548 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.481425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1109/2166] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:38:08.486080 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db62748-d9de-4cc6-8c7b-5498f03c9fd9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.494190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:08.499900 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1058/2167] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:08.500056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db62748-d9de-4cc6-8c7b-5498f03c9fd9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.501599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbd9ee-b347-4b2d-858f-58746b16f548 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.506979 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbf8cd-a497-4634-aabb-b05a38d52602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.508168 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbf8cd-a497-4634-aabb-b05a38d52602 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.508809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbf8cd-a497-4634-aabb-b05a38d52602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.509104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbf8cd-a497-4634-aabb-b05a38d52602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.509815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbf8cd-a497-4634-aabb-b05a38d52602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.511842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbf8cd-a497-4634-aabb-b05a38d52602 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.516714 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbd9ee-b347-4b2d-858f-58746b16f548 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.521461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a14a3-ab33-45b4-a231-cdb071a41647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.522132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a14a3-ab33-45b4-a231-cdb071a41647 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.522420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a14a3-ab33-45b4-a231-cdb071a41647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.522695 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a14a3-ab33-45b4-a231-cdb071a41647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.523418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a14a3-ab33-45b4-a231-cdb071a41647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.525092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a14a3-ab33-45b4-a231-cdb071a41647 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.536810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1059/2168] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:08.543443 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1110/2169] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:08.543699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a14a3-ab33-45b4-a231-cdb071a41647 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.544269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbf8cd-a497-4634-aabb-b05a38d52602 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.551195 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a14a3-ab33-45b4-a231-cdb071a41647 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.607112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbf8cd-a497-4634-aabb-b05a38d52602 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.608795 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cb6ae-f4b0-48fe-8e00-14a07be92586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.609475 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cb6ae-f4b0-48fe-8e00-14a07be92586 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.609760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cb6ae-f4b0-48fe-8e00-14a07be92586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.610071 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cb6ae-f4b0-48fe-8e00-14a07be92586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.610911 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cb6ae-f4b0-48fe-8e00-14a07be92586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.612226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14969b96-ac56-41f5-a14d-5c658dcce160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.612679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cb6ae-f4b0-48fe-8e00-14a07be92586 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.613116 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14969b96-ac56-41f5-a14d-5c658dcce160 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.613411 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14969b96-ac56-41f5-a14d-5c658dcce160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.613692 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14969b96-ac56-41f5-a14d-5c658dcce160 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.614394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14969b96-ac56-41f5-a14d-5c658dcce160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.616310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14969b96-ac56-41f5-a14d-5c658dcce160 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.626402 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1060/2170] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:38:08.627958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cb6ae-f4b0-48fe-8e00-14a07be92586 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.637854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1111/2171] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:08.642479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cb6ae-f4b0-48fe-8e00-14a07be92586 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.642757 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14969b96-ac56-41f5-a14d-5c658dcce160 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.647915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf0fc2-80f0-4fbd-b87b-e3855a29b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.649230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf0fc2-80f0-4fbd-b87b-e3855a29b9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.649675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf0fc2-80f0-4fbd-b87b-e3855a29b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.650062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf0fc2-80f0-4fbd-b87b-e3855a29b9a9 admin admin] PATH_INFO: `/v3/projects/924e4d6ca63a469bb655ed0f984c6a96/users/af3ac28b0dd7400f8bc7d46ead43fc88/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.653268 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14969b96-ac56-41f5-a14d-5c658dcce160 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.658913 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d6735-0246-43e9-9c90-1d72d6fd1950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.659659 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d6735-0246-43e9-9c90-1d72d6fd1950 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.660019 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d6735-0246-43e9-9c90-1d72d6fd1950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.660368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d6735-0246-43e9-9c90-1d72d6fd1950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.661198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d6735-0246-43e9-9c90-1d72d6fd1950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.662889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d6735-0246-43e9-9c90-1d72d6fd1950 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.667152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf0fc2-80f0-4fbd-b87b-e3855a29b9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=924e4d6ca63a469bb655ed0f984c6a96, user_id=af3ac28b0dd7400f8bc7d46ead43fc88, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.669864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf0fc2-80f0-4fbd-b87b-e3855a29b9a9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.673611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1112/2172] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:38:08.677771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d6735-0246-43e9-9c90-1d72d6fd1950 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.685021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1061/2173] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:08 2022] PUT /identity/v3/projects/924e4d6ca63a469bb655ed0f984c6a96/users/af3ac28b0dd7400f8bc7d46ead43fc88/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:08.687744 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d6735-0246-43e9-9c90-1d72d6fd1950 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.696012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b1538-b3c7-421d-ae30-cc6b8647e5de None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.696311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b1538-b3c7-421d-ae30-cc6b8647e5de None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.696940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b1538-b3c7-421d-ae30-cc6b8647e5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.726010 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-503b1538-b3c7-421d-ae30-cc6b8647e5de None None] MFA Rules not processed for user `af3ac28b0dd7400f8bc7d46ead43fc88`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:08.727242 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-503b1538-b3c7-421d-ae30-cc6b8647e5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:08.746758 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda5715-0d43-4245-b14b-2c249ce92c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.747438 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda5715-0d43-4245-b14b-2c249ce92c04 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.747734 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda5715-0d43-4245-b14b-2c249ce92c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.748017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda5715-0d43-4245-b14b-2c249ce92c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.748790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda5715-0d43-4245-b14b-2c249ce92c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.750407 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda5715-0d43-4245-b14b-2c249ce92c04 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.761289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1113/2174] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:38:08.765382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda5715-0d43-4245-b14b-2c249ce92c04 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.781330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda5715-0d43-4245-b14b-2c249ce92c04 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.786778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3599f9d-2fbc-4d19-8f35-c78ba9785a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.787679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3599f9d-2fbc-4d19-8f35-c78ba9785a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.787970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3599f9d-2fbc-4d19-8f35-c78ba9785a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.788284 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3599f9d-2fbc-4d19-8f35-c78ba9785a35 admin admin] PATH_INFO: `/v3/projects/2f46d4b887e549c49393e67d147a13a1/users/65e28eaaa6834d588e92fed6878be973/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.800730 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1062/2175] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:08.807002 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b1538-b3c7-421d-ae30-cc6b8647e5de None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.809991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3599f9d-2fbc-4d19-8f35-c78ba9785a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f46d4b887e549c49393e67d147a13a1, user_id=65e28eaaa6834d588e92fed6878be973, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.812755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3599f9d-2fbc-4d19-8f35-c78ba9785a35 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.818835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b1538-b3c7-421d-ae30-cc6b8647e5de None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.823837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb80feb-4fb9-4510-a218-27e227bfe041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.824689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80feb-4fb9-4510-a218-27e227bfe041 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.825130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80feb-4fb9-4510-a218-27e227bfe041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.825563 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80feb-4fb9-4510-a218-27e227bfe041 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.826535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb80feb-4fb9-4510-a218-27e227bfe041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.826955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1114/2176] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:08 2022] PUT /identity/v3/projects/2f46d4b887e549c49393e67d147a13a1/users/65e28eaaa6834d588e92fed6878be973/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:38:08.831316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb80feb-4fb9-4510-a218-27e227bfe041 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.837983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731194a-6f6f-4fa6-a6d8-a0bc1e7c9c90 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.838279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731194a-6f6f-4fa6-a6d8-a0bc1e7c9c90 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.838559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731194a-6f6f-4fa6-a6d8-a0bc1e7c9c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.847261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:08.864644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1063/2177] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:08.865550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb80feb-4fb9-4510-a218-27e227bfe041 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.868052 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d731194a-6f6f-4fa6-a6d8-a0bc1e7c9c90 None None] MFA Rules not processed for user `65e28eaaa6834d588e92fed6878be973`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:08.869345 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d731194a-6f6f-4fa6-a6d8-a0bc1e7c9c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:08.892012 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:08.930648 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb80feb-4fb9-4510-a218-27e227bfe041 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.935691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04e333-5262-4ca0-b9dc-70f69bcf864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.936367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04e333-5262-4ca0-b9dc-70f69bcf864c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.936701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04e333-5262-4ca0-b9dc-70f69bcf864c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.936983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04e333-5262-4ca0-b9dc-70f69bcf864c admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.937675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04e333-5262-4ca0-b9dc-70f69bcf864c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.938622 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1115/2178] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:08.939969 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04e333-5262-4ca0-b9dc-70f69bcf864c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.950218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731194a-6f6f-4fa6-a6d8-a0bc1e7c9c90 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.952044 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d731194a-6f6f-4fa6-a6d8-a0bc1e7c9c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:08.961781 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1064/2179] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:08 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:08.965699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04e333-5262-4ca0-b9dc-70f69bcf864c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:08.975969 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04e333-5262-4ca0-b9dc-70f69bcf864c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:08.980720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214784f-c76c-4313-b6f9-b8dec5b570df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:08.981376 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214784f-c76c-4313-b6f9-b8dec5b570df admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:08.981660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214784f-c76c-4313-b6f9-b8dec5b570df admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:08.981938 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214784f-c76c-4313-b6f9-b8dec5b570df admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:08.982656 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214784f-c76c-4313-b6f9-b8dec5b570df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:08.984256 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214784f-c76c-4313-b6f9-b8dec5b570df admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:08.994375 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1065/2180] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:38:08.998381 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214784f-c76c-4313-b6f9-b8dec5b570df admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:09.007885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214784f-c76c-4313-b6f9-b8dec5b570df admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.013045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c4c9f-266a-4039-a079-3471fce1552d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.013921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c4c9f-266a-4039-a079-3471fce1552d admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.014204 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c4c9f-266a-4039-a079-3471fce1552d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.014308 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731194a-6f6f-4fa6-a6d8-a0bc1e7c9c90 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.014481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c4c9f-266a-4039-a079-3471fce1552d admin admin] PATH_INFO: `/v3/projects/468150172b48461493c7e93a19b480b2/users/cf6022179d61459293cbf32fc178e7b1/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.018848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dc30c-1bd0-438d-b1de-eaff279a6f07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.019585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dc30c-1bd0-438d-b1de-eaff279a6f07 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.019878 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dc30c-1bd0-438d-b1de-eaff279a6f07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.020160 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dc30c-1bd0-438d-b1de-eaff279a6f07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.029044 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201dc30c-1bd0-438d-b1de-eaff279a6f07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.029815 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c4c9f-266a-4039-a079-3471fce1552d admin admin] RBAC: Authorizing `identity:create_grant(project_id=468150172b48461493c7e93a19b480b2, user_id=cf6022179d61459293cbf32fc178e7b1, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.030497 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201dc30c-1bd0-438d-b1de-eaff279a6f07 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.033069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c4c9f-266a-4039-a079-3471fce1552d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.041154 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1116/2181] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:38:09.046871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1066/2182] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:08 2022] PUT /identity/v3/projects/468150172b48461493c7e93a19b480b2/users/cf6022179d61459293cbf32fc178e7b1/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:38:09.050698 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dc30c-1bd0-438d-b1de-eaff279a6f07 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:09.061375 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dc30c-1bd0-438d-b1de-eaff279a6f07 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.121122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7a00f-4059-4bf8-bc7a-c479cefbb66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.121801 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7a00f-4059-4bf8-bc7a-c479cefbb66c admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.122143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7a00f-4059-4bf8-bc7a-c479cefbb66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.122432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7a00f-4059-4bf8-bc7a-c479cefbb66c admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.123196 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7a00f-4059-4bf8-bc7a-c479cefbb66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.124888 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7a00f-4059-4bf8-bc7a-c479cefbb66c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.138329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1117/2183] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:09.139347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c4c9f-266a-4039-a079-3471fce1552d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:09.150873 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c4c9f-266a-4039-a079-3471fce1552d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.158163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aa209-b10d-4896-9033-c524ff13f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.159312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa209-b10d-4896-9033-c524ff13f9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.159604 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa209-b10d-4896-9033-c524ff13f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.159895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa209-b10d-4896-9033-c524ff13f9d0 admin admin] PATH_INFO: `/v3/projects/468150172b48461493c7e93a19b480b2/users/cf6022179d61459293cbf32fc178e7b1/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.162247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aa209-b10d-4896-9033-c524ff13f9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=468150172b48461493c7e93a19b480b2, user_id=cf6022179d61459293cbf32fc178e7b1, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.165119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aa209-b10d-4896-9033-c524ff13f9d0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.178240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1067/2184] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:09 2022] PUT /identity/v3/projects/468150172b48461493c7e93a19b480b2/users/cf6022179d61459293cbf32fc178e7b1/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:38:09.190192 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46984a9-b0a8-487e-8298-3ea4f65f42e5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.190532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46984a9-b0a8-487e-8298-3ea4f65f42e5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.190870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46984a9-b0a8-487e-8298-3ea4f65f42e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.231311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b46984a9-b0a8-487e-8298-3ea4f65f42e5 None None] MFA Rules not processed for user `cf6022179d61459293cbf32fc178e7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:09.232583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b46984a9-b0a8-487e-8298-3ea4f65f42e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:09.296593 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:09.328681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1118/2185] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:09.435760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aa209-b10d-4896-9033-c524ff13f9d0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:09.535646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aa209-b10d-4896-9033-c524ff13f9d0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.539416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c231c3e-f4f6-4911-bbff-5e9f063b741f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.540140 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231c3e-f4f6-4911-bbff-5e9f063b741f service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.540579 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231c3e-f4f6-4911-bbff-5e9f063b741f service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.540926 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231c3e-f4f6-4911-bbff-5e9f063b741f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.553611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c231c3e-f4f6-4911-bbff-5e9f063b741f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.555261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c231c3e-f4f6-4911-bbff-5e9f063b741f service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.568205 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1068/2186] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:09.706270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46984a9-b0a8-487e-8298-3ea4f65f42e5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:09.768908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46984a9-b0a8-487e-8298-3ea4f65f42e5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:09.773295 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2328a-0f29-4758-bffd-42d89245f608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:09.774209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2328a-0f29-4758-bffd-42d89245f608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.774487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2328a-0f29-4758-bffd-42d89245f608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.774753 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2328a-0f29-4758-bffd-42d89245f608 admin admin] PATH_INFO: `/v3/users/af3ac28b0dd7400f8bc7d46ead43fc88` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.775926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2328a-0f29-4758-bffd-42d89245f608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3ac28b0dd7400f8bc7d46ead43fc88)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:09.777945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2328a-0f29-4758-bffd-42d89245f608 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:09.827769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-20f2328a-0f29-4758-bffd-42d89245f608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3ac28b0dd7400f8bc7d46ead43fc88'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:09.835006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-20f2328a-0f29-4758-bffd-42d89245f608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3ac28b0dd7400f8bc7d46ead43fc88'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:09.843214 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-20f2328a-0f29-4758-bffd-42d89245f608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3ac28b0dd7400f8bc7d46ead43fc88'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:09.843921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-20f2328a-0f29-4758-bffd-42d89245f608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3ac28b0dd7400f8bc7d46ead43fc88'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:09.857249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-20f2328a-0f29-4758-bffd-42d89245f608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3ac28b0dd7400f8bc7d46ead43fc88'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:09.866037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1119/2187] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:09 2022] DELETE /identity/v3/users/af3ac28b0dd7400f8bc7d46ead43fc88 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:09.870811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c794239-158e-473c-918b-38fc7457e21e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:09.871112 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c794239-158e-473c-918b-38fc7457e21e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:09.871425 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c794239-158e-473c-918b-38fc7457e21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:09.890773 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6c794239-158e-473c-918b-38fc7457e21e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:09.892635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6c794239-158e-473c-918b-38fc7457e21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:09.927996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:09.959326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1069/2188] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:09.969608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2328a-0f29-4758-bffd-42d89245f608 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:09.971624 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-20f2328a-0f29-4758-bffd-42d89245f608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:10.029547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2328a-0f29-4758-bffd-42d89245f608 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:10.035590 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521146d-3272-4211-827c-40129204cfbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:10.036248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521146d-3272-4211-827c-40129204cfbe service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:10.036566 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521146d-3272-4211-827c-40129204cfbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:10.036859 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521146d-3272-4211-827c-40129204cfbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:10.047057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521146d-3272-4211-827c-40129204cfbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:10.049704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521146d-3272-4211-827c-40129204cfbe service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:10.059527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1120/2189] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:38:10.732122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c794239-158e-473c-918b-38fc7457e21e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:10.733841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6c794239-158e-473c-918b-38fc7457e21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:10.800105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c794239-158e-473c-918b-38fc7457e21e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:10.816870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:10.817923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:10.818222 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:10.818503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] PATH_INFO: `/v3/projects/924e4d6ca63a469bb655ed0f984c6a96` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:10.822592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] RBAC: Authorizing `identity:delete_project(project_id=924e4d6ca63a469bb655ed0f984c6a96)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:10.827796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:10.919516 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924e4d6ca63a469bb655ed0f984c6a96', 'request_id': 'req-be3effcc-7dc5-4563-af0a-60a2432759da'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:10.935563 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924e4d6ca63a469bb655ed0f984c6a96', 'request_id': 'req-be3effcc-7dc5-4563-af0a-60a2432759da'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:10.946355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924e4d6ca63a469bb655ed0f984c6a96', 'request_id': 'req-be3effcc-7dc5-4563-af0a-60a2432759da'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:10.970722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] The token cache is being invalidate because project 924e4d6ca63a469bb655ed0f984c6a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:10.971252 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:10.972479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:10.974257 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1070/2190] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:10 2022] DELETE /identity/v3/projects/924e4d6ca63a469bb655ed0f984c6a96 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:10.978415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521146d-3272-4211-827c-40129204cfbe service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:10.991376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521146d-3272-4211-827c-40129204cfbe service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:10.997251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:11.087046 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d09301-6409-4c20-8d9f-355938df6786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:11.087952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d09301-6409-4c20-8d9f-355938df6786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:11.088241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d09301-6409-4c20-8d9f-355938df6786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:11.088566 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d09301-6409-4c20-8d9f-355938df6786 admin admin] PATH_INFO: `/v3/users/cf6022179d61459293cbf32fc178e7b1` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:11.089914 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d09301-6409-4c20-8d9f-355938df6786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf6022179d61459293cbf32fc178e7b1)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:11.091889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d09301-6409-4c20-8d9f-355938df6786 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:11.155228 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e9d09301-6409-4c20-8d9f-355938df6786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf6022179d61459293cbf32fc178e7b1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:11.165739 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e9d09301-6409-4c20-8d9f-355938df6786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf6022179d61459293cbf32fc178e7b1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:11.180603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e9d09301-6409-4c20-8d9f-355938df6786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf6022179d61459293cbf32fc178e7b1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:11.180992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e9d09301-6409-4c20-8d9f-355938df6786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf6022179d61459293cbf32fc178e7b1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:11.201417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e9d09301-6409-4c20-8d9f-355938df6786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf6022179d61459293cbf32fc178e7b1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:11.211084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1121/2191] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:10 2022] DELETE /identity/v3/users/cf6022179d61459293cbf32fc178e7b1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:11.618356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:11.620345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:11.641949 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3effcc-7dc5-4563-af0a-60a2432759da admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:11.712540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:11.713546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:11.713833 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:11.714124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] PATH_INFO: `/v3/projects/468150172b48461493c7e93a19b480b2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:11.715308 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] RBAC: Authorizing `identity:delete_project(project_id=468150172b48461493c7e93a19b480b2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:11.717268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:11.767646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468150172b48461493c7e93a19b480b2', 'request_id': 'req-b5fce73f-8f0e-4a88-a405-d2eb6898625b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:11.775687 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468150172b48461493c7e93a19b480b2', 'request_id': 'req-b5fce73f-8f0e-4a88-a405-d2eb6898625b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:11.784199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468150172b48461493c7e93a19b480b2', 'request_id': 'req-b5fce73f-8f0e-4a88-a405-d2eb6898625b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:11.788935 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:11.799490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] The token cache is being invalidate because project 468150172b48461493c7e93a19b480b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:11.799784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:11.800627 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:11.802739 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1071/2192] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:11 2022] DELETE /identity/v3/projects/468150172b48461493c7e93a19b480b2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:38:11.807510 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eef65-aa53-46ad-a2ef-dafeac0a2be3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:11.807846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eef65-aa53-46ad-a2ef-dafeac0a2be3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:11.808134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eef65-aa53-46ad-a2ef-dafeac0a2be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:11.831562 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f66eef65-aa53-46ad-a2ef-dafeac0a2be3 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:11.832894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f66eef65-aa53-46ad-a2ef-dafeac0a2be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:11.940562 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1122/2193] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:11.941208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:11.942204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195ec72-253a-455d-9995-81a227ddf9fa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:11.942599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195ec72-253a-455d-9995-81a227ddf9fa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:11.942711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:11.943050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195ec72-253a-455d-9995-81a227ddf9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:11.957369 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fce73f-8f0e-4a88-a405-d2eb6898625b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:11.962540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ff640-956a-49d3-a7e1-b630d0cd229c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:11.963641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ff640-956a-49d3-a7e1-b630d0cd229c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:11.963923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ff640-956a-49d3-a7e1-b630d0cd229c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:11.964361 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ff640-956a-49d3-a7e1-b630d0cd229c admin admin] PATH_INFO: `/v3/users/65e28eaaa6834d588e92fed6878be973` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:11.965035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b195ec72-253a-455d-9995-81a227ddf9fa None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:11.966220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ff640-956a-49d3-a7e1-b630d0cd229c admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e28eaaa6834d588e92fed6878be973)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:11.966532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b195ec72-253a-455d-9995-81a227ddf9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:11.968579 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ff640-956a-49d3-a7e1-b630d0cd229c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:11.975447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1123/2194] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:11.981800 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195ec72-253a-455d-9995-81a227ddf9fa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:11.994416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195ec72-253a-455d-9995-81a227ddf9fa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.001195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d8d00-fc57-44b5-b4f3-534e7dcd54c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.002462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d8d00-fc57-44b5-b4f3-534e7dcd54c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.003015 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d8d00-fc57-44b5-b4f3-534e7dcd54c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.003517 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d8d00-fc57-44b5-b4f3-534e7dcd54c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.004385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d8d00-fc57-44b5-b4f3-534e7dcd54c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:12.006357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d8d00-fc57-44b5-b4f3-534e7dcd54c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.008213 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d8d00-fc57-44b5-b4f3-534e7dcd54c5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.026974 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1124/2195] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:12.028072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d8d00-fc57-44b5-b4f3-534e7dcd54c5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:12.033245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0a1ff640-956a-49d3-a7e1-b630d0cd229c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e28eaaa6834d588e92fed6878be973'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:12.040224 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d8d00-fc57-44b5-b4f3-534e7dcd54c5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.045924 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db56875-450d-44ae-9621-55c700db54fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.048460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db56875-450d-44ae-9621-55c700db54fd admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.049546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db56875-450d-44ae-9621-55c700db54fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.050103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db56875-450d-44ae-9621-55c700db54fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.051094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db56875-450d-44ae-9621-55c700db54fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.053581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db56875-450d-44ae-9621-55c700db54fd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.056309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0a1ff640-956a-49d3-a7e1-b630d0cd229c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e28eaaa6834d588e92fed6878be973'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:12.058658 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0a1ff640-956a-49d3-a7e1-b630d0cd229c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e28eaaa6834d588e92fed6878be973'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:12.058890 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:12.075635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0a1ff640-956a-49d3-a7e1-b630d0cd229c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e28eaaa6834d588e92fed6878be973'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:12.077709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0a1ff640-956a-49d3-a7e1-b630d0cd229c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e28eaaa6834d588e92fed6878be973'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:12.101478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1072/2196] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:11 2022] DELETE /identity/v3/users/65e28eaaa6834d588e92fed6878be973 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:38:12.106709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b45c-c5e2-4c60-a292-7eb875692483 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.107123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b45c-c5e2-4c60-a292-7eb875692483 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.107415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b45c-c5e2-4c60-a292-7eb875692483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.122298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1125/2197] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:12 2022] POST /identity/v3/projects => generated 409 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:12.130258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db56875-450d-44ae-9621-55c700db54fd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:12.132207 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2db56875-450d-44ae-9621-55c700db54fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:12.132546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e166b45c-c5e2-4c60-a292-7eb875692483 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:12.133913 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e166b45c-c5e2-4c60-a292-7eb875692483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:12.228952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db56875-450d-44ae-9621-55c700db54fd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.230879 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1073/2198] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:12.231905 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166b45c-c5e2-4c60-a292-7eb875692483 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:12.233579 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e166b45c-c5e2-4c60-a292-7eb875692483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:12.235462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec0554-62e7-47c1-bcec-425b17af85e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.236359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec0554-62e7-47c1-bcec-425b17af85e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.236716 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec0554-62e7-47c1-bcec-425b17af85e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.237009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec0554-62e7-47c1-bcec-425b17af85e5 admin admin] PATH_INFO: `/v3/users/0aece7e536bd4655950f70e9e5359079` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.238841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec0554-62e7-47c1-bcec-425b17af85e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aece7e536bd4655950f70e9e5359079)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.240828 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec0554-62e7-47c1-bcec-425b17af85e5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.247749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166b45c-c5e2-4c60-a292-7eb875692483 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.256140 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c258735-428b-4341-b7d9-cc49190fe35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.257004 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c258735-428b-4341-b7d9-cc49190fe35f admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.257338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c258735-428b-4341-b7d9-cc49190fe35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.257665 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c258735-428b-4341-b7d9-cc49190fe35f admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.259912 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c258735-428b-4341-b7d9-cc49190fe35f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.263154 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c258735-428b-4341-b7d9-cc49190fe35f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.290585 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1074/2199] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:12 2022] POST /identity/v3/users => generated 305 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:12.291493 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c258735-428b-4341-b7d9-cc49190fe35f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:12.293398 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5c258735-428b-4341-b7d9-cc49190fe35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:12.332458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-08ec0554-62e7-47c1-bcec-425b17af85e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aece7e536bd4655950f70e9e5359079'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:12.342757 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-08ec0554-62e7-47c1-bcec-425b17af85e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aece7e536bd4655950f70e9e5359079'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:12.352015 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-08ec0554-62e7-47c1-bcec-425b17af85e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aece7e536bd4655950f70e9e5359079'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:12.353817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-08ec0554-62e7-47c1-bcec-425b17af85e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aece7e536bd4655950f70e9e5359079'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:12.378594 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:12.383280 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c258735-428b-4341-b7d9-cc49190fe35f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.387561 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-08ec0554-62e7-47c1-bcec-425b17af85e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aece7e536bd4655950f70e9e5359079'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:12.390372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662b3e4-d636-41be-88b0-5dd52cfacccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.391819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662b3e4-d636-41be-88b0-5dd52cfacccf service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.393052 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662b3e4-d636-41be-88b0-5dd52cfacccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.393693 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662b3e4-d636-41be-88b0-5dd52cfacccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.396581 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4662b3e4-d636-41be-88b0-5dd52cfacccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:12.404276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1126/2200] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:12 2022] DELETE /identity/v3/users/0aece7e536bd4655950f70e9e5359079 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:12.404276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec0554-62e7-47c1-bcec-425b17af85e5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:12.404667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-08ec0554-62e7-47c1-bcec-425b17af85e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:12.412558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662b3e4-d636-41be-88b0-5dd52cfacccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.415146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662b3e4-d636-41be-88b0-5dd52cfacccf service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.431433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1075/2201] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:12.432625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83c8db-f33e-48c8-8f46-f5be9d8a2f14 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.432963 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83c8db-f33e-48c8-8f46-f5be9d8a2f14 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.433301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83c8db-f33e-48c8-8f46-f5be9d8a2f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.468949 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1e83c8db-f33e-48c8-8f46-f5be9d8a2f14 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:12.470479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1e83c8db-f33e-48c8-8f46-f5be9d8a2f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:12.544753 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec0554-62e7-47c1-bcec-425b17af85e5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.553564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552be262-4e42-43fe-ad72-96042be4b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.554490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552be262-4e42-43fe-ad72-96042be4b898 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.554984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552be262-4e42-43fe-ad72-96042be4b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.555270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552be262-4e42-43fe-ad72-96042be4b898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.556963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552be262-4e42-43fe-ad72-96042be4b898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.559326 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552be262-4e42-43fe-ad72-96042be4b898 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.562314 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1076/2202] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:12.578320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83c8db-f33e-48c8-8f46-f5be9d8a2f14 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:12.580900 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1e83c8db-f33e-48c8-8f46-f5be9d8a2f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:12.583857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1127/2203] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:12.588022 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552be262-4e42-43fe-ad72-96042be4b898 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:12.595942 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:12.604570 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552be262-4e42-43fe-ad72-96042be4b898 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.611618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1e33d-33a2-4f5b-a3da-c2db83f56a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.612422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1e33d-33a2-4f5b-a3da-c2db83f56a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.612988 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1e33d-33a2-4f5b-a3da-c2db83f56a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.613502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1e33d-33a2-4f5b-a3da-c2db83f56a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.614836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1e33d-33a2-4f5b-a3da-c2db83f56a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.617203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1e33d-33a2-4f5b-a3da-c2db83f56a65 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.632311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1128/2204] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:12.633535 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1e33d-33a2-4f5b-a3da-c2db83f56a65 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:12.645075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1e33d-33a2-4f5b-a3da-c2db83f56a65 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.650312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685fad1-d830-43ad-9ee9-e7176a26d682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.651450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685fad1-d830-43ad-9ee9-e7176a26d682 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.651862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685fad1-d830-43ad-9ee9-e7176a26d682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.652833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685fad1-d830-43ad-9ee9-e7176a26d682 admin admin] PATH_INFO: `/v3/projects/1a59eb0645964c9e94c715804be0f86f/users/c85d1839a15a409c942ef9149b82ae28/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.667933 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83c8db-f33e-48c8-8f46-f5be9d8a2f14 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:12.675898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b64581-5ca4-43c8-a2ae-2da307397cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:12.677090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b64581-5ca4-43c8-a2ae-2da307397cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.677514 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b64581-5ca4-43c8-a2ae-2da307397cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.677868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b64581-5ca4-43c8-a2ae-2da307397cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.679450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685fad1-d830-43ad-9ee9-e7176a26d682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a59eb0645964c9e94c715804be0f86f, user_id=c85d1839a15a409c942ef9149b82ae28, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.684703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685fad1-d830-43ad-9ee9-e7176a26d682 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.695287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b64581-5ca4-43c8-a2ae-2da307397cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:12.699536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b64581-5ca4-43c8-a2ae-2da307397cd6 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:12.718415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1077/2205] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:38:12.723083 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1129/2206] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:12 2022] PUT /identity/v3/projects/1a59eb0645964c9e94c715804be0f86f/users/c85d1839a15a409c942ef9149b82ae28/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:12.735425 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0b3c6-05b9-483c-8a99-7182f5408f84 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:12.736253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0b3c6-05b9-483c-8a99-7182f5408f84 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:12.738401 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0b3c6-05b9-483c-8a99-7182f5408f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:12.790181 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-99a0b3c6-05b9-483c-8a99-7182f5408f84 None None] MFA Rules not processed for user `c85d1839a15a409c942ef9149b82ae28`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:12.791413 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-99a0b3c6-05b9-483c-8a99-7182f5408f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:12.915486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1078/2207] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:12 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:12.920641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685fad1-d830-43ad-9ee9-e7176a26d682 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:13.047693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685fad1-d830-43ad-9ee9-e7176a26d682 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:13.059230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91782797-d41d-41f9-a99b-862fa38442c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:13.060440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0b3c6-05b9-483c-8a99-7182f5408f84 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:13.060587 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91782797-d41d-41f9-a99b-862fa38442c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:13.061123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91782797-d41d-41f9-a99b-862fa38442c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:13.061978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91782797-d41d-41f9-a99b-862fa38442c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:13.062592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91782797-d41d-41f9-a99b-862fa38442c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:13.064979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-99a0b3c6-05b9-483c-8a99-7182f5408f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:13.066025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91782797-d41d-41f9-a99b-862fa38442c6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:13.107531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0b3c6-05b9-483c-8a99-7182f5408f84 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:13.119035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbe393-112c-4122-8768-f7c1b05389be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:13.120170 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbe393-112c-4122-8768-f7c1b05389be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:13.120633 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbe393-112c-4122-8768-f7c1b05389be admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:13.121081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbe393-112c-4122-8768-f7c1b05389be admin admin] PATH_INFO: `/v3/projects/2f46d4b887e549c49393e67d147a13a1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:13.123488 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbe393-112c-4122-8768-f7c1b05389be admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f46d4b887e549c49393e67d147a13a1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:13.126435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbe393-112c-4122-8768-f7c1b05389be admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:13.145930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1130/2208] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:12 2022] POST /identity/v3/projects => generated 407 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:13.159293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:13.164928 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91782797-d41d-41f9-a99b-862fa38442c6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:13.218687 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1fbe393-112c-4122-8768-f7c1b05389be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f46d4b887e549c49393e67d147a13a1', 'request_id': 'req-c1fbe393-112c-4122-8768-f7c1b05389be'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.233219 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1fbe393-112c-4122-8768-f7c1b05389be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f46d4b887e549c49393e67d147a13a1', 'request_id': 'req-c1fbe393-112c-4122-8768-f7c1b05389be'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.245245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1fbe393-112c-4122-8768-f7c1b05389be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f46d4b887e549c49393e67d147a13a1', 'request_id': 'req-c1fbe393-112c-4122-8768-f7c1b05389be'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.292457 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1fbe393-112c-4122-8768-f7c1b05389be admin admin] The token cache is being invalidate because project 2f46d4b887e549c49393e67d147a13a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:13.292457 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1fbe393-112c-4122-8768-f7c1b05389be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.292457 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1fbe393-112c-4122-8768-f7c1b05389be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.301203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1079/2209] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:13 2022] DELETE /identity/v3/projects/2f46d4b887e549c49393e67d147a13a1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:13.302835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3131a-0983-4484-ad31-c05dbc22b878 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:13.303254 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3131a-0983-4484-ad31-c05dbc22b878 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:13.303626 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3131a-0983-4484-ad31-c05dbc22b878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:13.321194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91782797-d41d-41f9-a99b-862fa38442c6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:13.348944 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9ea3131a-0983-4484-ad31-c05dbc22b878 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:13.366694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9ea3131a-0983-4484-ad31-c05dbc22b878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:13.443765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09862f0c-7596-4759-aba2-e7ac1e1d6180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:13.446223 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09862f0c-7596-4759-aba2-e7ac1e1d6180 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:13.446223 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09862f0c-7596-4759-aba2-e7ac1e1d6180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:13.446478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09862f0c-7596-4759-aba2-e7ac1e1d6180 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:13.447189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09862f0c-7596-4759-aba2-e7ac1e1d6180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:13.451833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09862f0c-7596-4759-aba2-e7ac1e1d6180 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:13.474147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:13.501897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1131/2210] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:13 2022] POST /identity/v3/users => generated 310 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:13.503317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09862f0c-7596-4759-aba2-e7ac1e1d6180 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:13.505482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-09862f0c-7596-4759-aba2-e7ac1e1d6180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:13.518458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09862f0c-7596-4759-aba2-e7ac1e1d6180 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:13.528320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1080/2211] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:13.528320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3131a-0983-4484-ad31-c05dbc22b878 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:13.528320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9ea3131a-0983-4484-ad31-c05dbc22b878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:13.534081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:13.535433 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:13.535864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:13.536302 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] PATH_INFO: `/v3/projects/df70afeb269a485c82a54249acafb713` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:13.538260 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df70afeb269a485c82a54249acafb713)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:13.538757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3131a-0983-4484-ad31-c05dbc22b878 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:13.541469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:13.553867 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a8e14-d238-41a1-915e-1d8a9e6b9f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:13.553867 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a8e14-d238-41a1-915e-1d8a9e6b9f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:13.553867 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a8e14-d238-41a1-915e-1d8a9e6b9f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:13.553867 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a8e14-d238-41a1-915e-1d8a9e6b9f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:13.554290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a8e14-d238-41a1-915e-1d8a9e6b9f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:13.554290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a8e14-d238-41a1-915e-1d8a9e6b9f56 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:13.562169 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1081/2212] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:13.566612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc5be-f29e-4161-a14d-21775946a3ce None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:13.566904 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc5be-f29e-4161-a14d-21775946a3ce None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:13.567190 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc5be-f29e-4161-a14d-21775946a3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:13.588531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f48dc5be-f29e-4161-a14d-21775946a3ce None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:13.589768 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f48dc5be-f29e-4161-a14d-21775946a3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:13.604098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df70afeb269a485c82a54249acafb713', 'request_id': 'req-11497491-5534-4b0b-9bd9-9f891ecf0eb7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.611105 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df70afeb269a485c82a54249acafb713', 'request_id': 'req-11497491-5534-4b0b-9bd9-9f891ecf0eb7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.617834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df70afeb269a485c82a54249acafb713', 'request_id': 'req-11497491-5534-4b0b-9bd9-9f891ecf0eb7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.631797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] The token cache is being invalidate because project df70afeb269a485c82a54249acafb713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:13.632071 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.632829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.634733 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1132/2213] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:13 2022] DELETE /identity/v3/projects/df70afeb269a485c82a54249acafb713 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:13.635475 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:13.637069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:13.655737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1082/2214] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:13.657383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dc5be-f29e-4161-a14d-21775946a3ce None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:13.658806 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f48dc5be-f29e-4161-a14d-21775946a3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:13.671833 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dc5be-f29e-4161-a14d-21775946a3ce None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:13.677386 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a82103-ee3b-497f-b42a-a6c892000ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:13.678263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82103-ee3b-497f-b42a-a6c892000ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:13.678549 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82103-ee3b-497f-b42a-a6c892000ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:13.678902 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82103-ee3b-497f-b42a-a6c892000ed4 admin admin] PATH_INFO: `/v3/users/6e6a164c51424f629b2df26f608ac21f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:13.680253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a82103-ee3b-497f-b42a-a6c892000ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e6a164c51424f629b2df26f608ac21f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:13.682458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a82103-ee3b-497f-b42a-a6c892000ed4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:13.718828 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11497491-5534-4b0b-9bd9-9f891ecf0eb7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:13.720617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:13.723761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b71f01-ce11-402b-9c2f-d87852ab7b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:13.724690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b71f01-ce11-402b-9c2f-d87852ab7b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:13.724976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b71f01-ce11-402b-9c2f-d87852ab7b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:13.725258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b71f01-ce11-402b-9c2f-d87852ab7b43 admin admin] PATH_INFO: `/v3/projects/1f988cfba8a14d578196ace4cdb25b09/users/a80ea09fb5fb42ccb1cab4bf6ba2c45b/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:13.734490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-45a82103-ee3b-497f-b42a-a6c892000ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e6a164c51424f629b2df26f608ac21f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.741256 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b71f01-ce11-402b-9c2f-d87852ab7b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f988cfba8a14d578196ace4cdb25b09, user_id=a80ea09fb5fb42ccb1cab4bf6ba2c45b, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:13.744539 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b71f01-ce11-402b-9c2f-d87852ab7b43 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:13.747078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-45a82103-ee3b-497f-b42a-a6c892000ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e6a164c51424f629b2df26f608ac21f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.747778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-45a82103-ee3b-497f-b42a-a6c892000ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e6a164c51424f629b2df26f608ac21f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.755968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-45a82103-ee3b-497f-b42a-a6c892000ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e6a164c51424f629b2df26f608ac21f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.756754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-45a82103-ee3b-497f-b42a-a6c892000ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e6a164c51424f629b2df26f608ac21f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:13.758538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1133/2215] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:13 2022] PUT /identity/v3/projects/1f988cfba8a14d578196ace4cdb25b09/users/a80ea09fb5fb42ccb1cab4bf6ba2c45b/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:13.762417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b71f01-ce11-402b-9c2f-d87852ab7b43 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:13.764311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f3b71f01-ce11-402b-9c2f-d87852ab7b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:13.770981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1083/2216] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:13 2022] DELETE /identity/v3/users/6e6a164c51424f629b2df26f608ac21f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:13.771697 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a82103-ee3b-497f-b42a-a6c892000ed4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:13.773065 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-45a82103-ee3b-497f-b42a-a6c892000ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:13.841417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:13.848806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b71f01-ce11-402b-9c2f-d87852ab7b43 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:13.856568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de03944-5ba8-44ba-8237-ef79555f87ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:13.857902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03944-5ba8-44ba-8237-ef79555f87ff admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:13.858826 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03944-5ba8-44ba-8237-ef79555f87ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:13.859231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03944-5ba8-44ba-8237-ef79555f87ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:13.859819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a82103-ee3b-497f-b42a-a6c892000ed4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:13.861099 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de03944-5ba8-44ba-8237-ef79555f87ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:13.861860 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de03944-5ba8-44ba-8237-ef79555f87ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:13.864247 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de03944-5ba8-44ba-8237-ef79555f87ff admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:13.866176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f16f5e-6cee-462f-bb26-e7140f25ea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:13.867149 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f16f5e-6cee-462f-bb26-e7140f25ea70 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:13.867456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f16f5e-6cee-462f-bb26-e7140f25ea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:13.867751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f16f5e-6cee-462f-bb26-e7140f25ea70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:13.868689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f16f5e-6cee-462f-bb26-e7140f25ea70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:13.870393 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f16f5e-6cee-462f-bb26-e7140f25ea70 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:13.883026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1084/2217] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:13.887182 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f16f5e-6cee-462f-bb26-e7140f25ea70 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:13.902548 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1134/2218] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:13.902548 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de03944-5ba8-44ba-8237-ef79555f87ff admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:13.902819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f16f5e-6cee-462f-bb26-e7140f25ea70 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:13.902910 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9de03944-5ba8-44ba-8237-ef79555f87ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:13.907026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6634920-1c6f-4f93-ae50-b81d8373ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:13.908028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6634920-1c6f-4f93-ae50-b81d8373ee91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:13.908384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6634920-1c6f-4f93-ae50-b81d8373ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:13.908762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6634920-1c6f-4f93-ae50-b81d8373ee91 admin admin] PATH_INFO: `/v3/projects/1f988cfba8a14d578196ace4cdb25b09/users/a80ea09fb5fb42ccb1cab4bf6ba2c45b/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:13.916538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de03944-5ba8-44ba-8237-ef79555f87ff admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:13.920947 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6634920-1c6f-4f93-ae50-b81d8373ee91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f988cfba8a14d578196ace4cdb25b09, user_id=a80ea09fb5fb42ccb1cab4bf6ba2c45b, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:13.922691 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a706ceb-cd94-4bae-a62f-a5f257a08aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:13.923963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a706ceb-cd94-4bae-a62f-a5f257a08aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:13.924319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a706ceb-cd94-4bae-a62f-a5f257a08aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:13.924698 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a706ceb-cd94-4bae-a62f-a5f257a08aac admin admin] PATH_INFO: `/v3/users/be49b6c404234866989cfca0db6a9792` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:13.926675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a706ceb-cd94-4bae-a62f-a5f257a08aac admin admin] RBAC: Authorizing `identity:delete_user(user_id=be49b6c404234866989cfca0db6a9792)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:13.928230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6634920-1c6f-4f93-ae50-b81d8373ee91 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:13.928467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a706ceb-cd94-4bae-a62f-a5f257a08aac admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:13.943770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1085/2219] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:13 2022] PUT /identity/v3/projects/1f988cfba8a14d578196ace4cdb25b09/users/a80ea09fb5fb42ccb1cab4bf6ba2c45b/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:38:13.944632 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6634920-1c6f-4f93-ae50-b81d8373ee91 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:14.002310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7a706ceb-cd94-4bae-a62f-a5f257a08aac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be49b6c404234866989cfca0db6a9792'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:14.014075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7a706ceb-cd94-4bae-a62f-a5f257a08aac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be49b6c404234866989cfca0db6a9792'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:14.022356 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7a706ceb-cd94-4bae-a62f-a5f257a08aac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be49b6c404234866989cfca0db6a9792'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:14.023112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7a706ceb-cd94-4bae-a62f-a5f257a08aac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be49b6c404234866989cfca0db6a9792'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:14.036407 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7a706ceb-cd94-4bae-a62f-a5f257a08aac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be49b6c404234866989cfca0db6a9792'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:14.042836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1135/2220] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:13 2022] DELETE /identity/v3/users/be49b6c404234866989cfca0db6a9792 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:14.047866 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6634920-1c6f-4f93-ae50-b81d8373ee91 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:14.048063 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69489c4d-91d7-4c1a-9009-50eee9c3c180 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.048822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69489c4d-91d7-4c1a-9009-50eee9c3c180 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.048822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69489c4d-91d7-4c1a-9009-50eee9c3c180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.082423 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-69489c4d-91d7-4c1a-9009-50eee9c3c180 None None] MFA Rules not processed for user `a80ea09fb5fb42ccb1cab4bf6ba2c45b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:14.083559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-69489c4d-91d7-4c1a-9009-50eee9c3c180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.100359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:14.126150 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365489b-96d4-48d5-bc02-ddb1db7dfe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:14.126590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365489b-96d4-48d5-bc02-ddb1db7dfe1f admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.126972 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365489b-96d4-48d5-bc02-ddb1db7dfe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.127635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365489b-96d4-48d5-bc02-ddb1db7dfe1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.128110 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365489b-96d4-48d5-bc02-ddb1db7dfe1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:14.130764 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365489b-96d4-48d5-bc02-ddb1db7dfe1f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:14.179342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1086/2221] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:13 2022] POST /identity/v3/projects => generated 379 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:14.185823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1136/2222] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:14 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:14.185823 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69489c4d-91d7-4c1a-9009-50eee9c3c180 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:14.186064 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9de98-998b-425e-8bda-4c28b3657e8e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.186064 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9de98-998b-425e-8bda-4c28b3657e8e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.186064 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9de98-998b-425e-8bda-4c28b3657e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.186333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-69489c4d-91d7-4c1a-9009-50eee9c3c180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.206928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-10a9de98-998b-425e-8bda-4c28b3657e8e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:14.208210 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-10a9de98-998b-425e-8bda-4c28b3657e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.209587 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69489c4d-91d7-4c1a-9009-50eee9c3c180 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:14.259651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:14.273091 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1087/2223] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:14.276770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479018c3-60fc-4f5f-9bc4-0ade90594929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:14.277006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9de98-998b-425e-8bda-4c28b3657e8e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:14.277467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479018c3-60fc-4f5f-9bc4-0ade90594929 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.277702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479018c3-60fc-4f5f-9bc4-0ade90594929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.278187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479018c3-60fc-4f5f-9bc4-0ade90594929 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.278359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-10a9de98-998b-425e-8bda-4c28b3657e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.279495 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479018c3-60fc-4f5f-9bc4-0ade90594929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:14.282236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479018c3-60fc-4f5f-9bc4-0ade90594929 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:14.291076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9de98-998b-425e-8bda-4c28b3657e8e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:14.296541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:14.297450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.297741 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.298048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] PATH_INFO: `/v3/projects/fd0ff74e2016423f9dda814820239ede` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.299227 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0ff74e2016423f9dda814820239ede)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:14.301177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:14.304440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1137/2224] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:14 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:14.304440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479018c3-60fc-4f5f-9bc4-0ade90594929 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:14.306998 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-479018c3-60fc-4f5f-9bc4-0ade90594929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.351060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0ff74e2016423f9dda814820239ede', 'request_id': 'req-e279f151-0915-4143-9ae6-55b97df4cde5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:14.358914 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0ff74e2016423f9dda814820239ede', 'request_id': 'req-e279f151-0915-4143-9ae6-55b97df4cde5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:14.366064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479018c3-60fc-4f5f-9bc4-0ade90594929 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:14.366507 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0ff74e2016423f9dda814820239ede', 'request_id': 'req-e279f151-0915-4143-9ae6-55b97df4cde5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:14.377706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] The token cache is being invalidate because project fd0ff74e2016423f9dda814820239ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:14.377994 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:14.378652 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:14.383478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1088/2225] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:14 2022] DELETE /identity/v3/projects/fd0ff74e2016423f9dda814820239ede => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:14.383478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:14.384936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.415806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d451b64-ea6b-49e8-82cb-3c197b14511c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:14.416535 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d451b64-ea6b-49e8-82cb-3c197b14511c service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.416830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d451b64-ea6b-49e8-82cb-3c197b14511c service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.417368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d451b64-ea6b-49e8-82cb-3c197b14511c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.419205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1d451b64-ea6b-49e8-82cb-3c197b14511c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.444435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:14.448700 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279f151-0915-4143-9ae6-55b97df4cde5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:14.454351 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a986f6-f3b0-43bf-a04d-fd02e8642541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:14.455037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a986f6-f3b0-43bf-a04d-fd02e8642541 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.455323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a986f6-f3b0-43bf-a04d-fd02e8642541 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.455605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a986f6-f3b0-43bf-a04d-fd02e8642541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.457528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a5a986f6-f3b0-43bf-a04d-fd02e8642541 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.505370 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d451b64-ea6b-49e8-82cb-3c197b14511c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:14.506986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d451b64-ea6b-49e8-82cb-3c197b14511c service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:14.533115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1138/2226] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:14 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:14.533115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d451b64-ea6b-49e8-82cb-3c197b14511c service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:14.533115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1d451b64-ea6b-49e8-82cb-3c197b14511c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.536419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a986f6-f3b0-43bf-a04d-fd02e8642541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:14.537890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a986f6-f3b0-43bf-a04d-fd02e8642541 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:14.549700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d451b64-ea6b-49e8-82cb-3c197b14511c service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:14.552311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1089/2227] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:14.553654 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cefaf-7964-4deb-9554-bb20033027a7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.553939 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cefaf-7964-4deb-9554-bb20033027a7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.554215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cefaf-7964-4deb-9554-bb20033027a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.586695 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0da5b3-7653-443e-b9e6-4a0947b6e237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:14.587560 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0da5b3-7653-443e-b9e6-4a0947b6e237 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.587853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0da5b3-7653-443e-b9e6-4a0947b6e237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.588732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0da5b3-7653-443e-b9e6-4a0947b6e237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.589771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0da5b3-7653-443e-b9e6-4a0947b6e237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:14.591167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0da5b3-7653-443e-b9e6-4a0947b6e237 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:14.607065 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-204cefaf-7964-4deb-9554-bb20033027a7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:14.608914 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-204cefaf-7964-4deb-9554-bb20033027a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.616272 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1139/2228] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:14.620904 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0da5b3-7653-443e-b9e6-4a0947b6e237 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:14.628779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1090/2229] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:14.638662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa22ea-b2b4-45c0-bb6f-69b719802ad1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.639036 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa22ea-b2b4-45c0-bb6f-69b719802ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.639702 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa22ea-b2b4-45c0-bb6f-69b719802ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.642211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0da5b3-7653-443e-b9e6-4a0947b6e237 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:14.654580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02741c15-38f8-4957-a49f-8dd08028813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:14.655263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741c15-38f8-4957-a49f-8dd08028813d admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.655549 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741c15-38f8-4957-a49f-8dd08028813d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.655826 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741c15-38f8-4957-a49f-8dd08028813d admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.656612 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02741c15-38f8-4957-a49f-8dd08028813d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:14.661271 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02741c15-38f8-4957-a49f-8dd08028813d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:14.667302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5cfa22ea-b2b4-45c0-bb6f-69b719802ad1 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:14.668694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5cfa22ea-b2b4-45c0-bb6f-69b719802ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.682428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1091/2230] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:14.683918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa22ea-b2b4-45c0-bb6f-69b719802ad1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:14.688551 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1140/2231] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:14.694354 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02741c15-38f8-4957-a49f-8dd08028813d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:14.709712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa22ea-b2b4-45c0-bb6f-69b719802ad1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:14.717521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02741c15-38f8-4957-a49f-8dd08028813d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:14.723832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109866b9-6c08-491b-832a-8313967cdf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:14.725160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109866b9-6c08-491b-832a-8313967cdf29 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.725536 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396125c0-db52-49b6-a339-3ed9482d4dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:14.725920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109866b9-6c08-491b-832a-8313967cdf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.726595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396125c0-db52-49b6-a339-3ed9482d4dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.727060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109866b9-6c08-491b-832a-8313967cdf29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.727698 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396125c0-db52-49b6-a339-3ed9482d4dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.728240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109866b9-6c08-491b-832a-8313967cdf29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:14.728613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396125c0-db52-49b6-a339-3ed9482d4dfa admin admin] PATH_INFO: `/v3/projects/1e9f9e0f8edb42848965b3c6141e88d0/users/145cee1016d349ceb93323a170bc957e/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.729051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109866b9-6c08-491b-832a-8313967cdf29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:14.734302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109866b9-6c08-491b-832a-8313967cdf29 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:14.755001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396125c0-db52-49b6-a339-3ed9482d4dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9f9e0f8edb42848965b3c6141e88d0, user_id=145cee1016d349ceb93323a170bc957e, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:14.756792 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1092/2232] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:14.762312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109866b9-6c08-491b-832a-8313967cdf29 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:14.768550 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396125c0-db52-49b6-a339-3ed9482d4dfa admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:14.774596 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:14.782785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109866b9-6c08-491b-832a-8313967cdf29 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:14.801255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47913d-00ee-4382-a6ae-2449d59dd7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:14.802286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47913d-00ee-4382-a6ae-2449d59dd7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.802738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1141/2233] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:14 2022] PUT /identity/v3/projects/1e9f9e0f8edb42848965b3c6141e88d0/users/145cee1016d349ceb93323a170bc957e/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:14.802919 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47913d-00ee-4382-a6ae-2449d59dd7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.803380 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47913d-00ee-4382-a6ae-2449d59dd7a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.803970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396125c0-db52-49b6-a339-3ed9482d4dfa admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:14.804573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47913d-00ee-4382-a6ae-2449d59dd7a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:14.807186 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47913d-00ee-4382-a6ae-2449d59dd7a8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:14.808762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-396125c0-db52-49b6-a339-3ed9482d4dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.861093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1093/2234] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:14 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:14.862735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bad0fb-f784-405b-b289-f689b85b1122 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.863041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bad0fb-f784-405b-b289-f689b85b1122 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.863448 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bad0fb-f784-405b-b289-f689b85b1122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.890228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-46bad0fb-f784-405b-b289-f689b85b1122 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:14.893332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-46bad0fb-f784-405b-b289-f689b85b1122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.904700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396125c0-db52-49b6-a339-3ed9482d4dfa admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:14.981353 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1094/2235] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:14.982916 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bad0fb-f784-405b-b289-f689b85b1122 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:14.985244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c86b6-91f5-496a-8f38-6e54a999d622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:14.986093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c86b6-91f5-496a-8f38-6e54a999d622 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:14.986513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c86b6-91f5-496a-8f38-6e54a999d622 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:14.987045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c86b6-91f5-496a-8f38-6e54a999d622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:14.989372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-532c86b6-91f5-496a-8f38-6e54a999d622 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:14.995843 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bad0fb-f784-405b-b289-f689b85b1122 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.002093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef35269-fbb0-42ed-a51a-cb8d49115675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:15.003158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef35269-fbb0-42ed-a51a-cb8d49115675 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.004185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef35269-fbb0-42ed-a51a-cb8d49115675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.004185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef35269-fbb0-42ed-a51a-cb8d49115675 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.005097 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef35269-fbb0-42ed-a51a-cb8d49115675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.007680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef35269-fbb0-42ed-a51a-cb8d49115675 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.035596 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1095/2236] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:14 2022] POST /identity/v3/users => generated 290 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:15.039775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef35269-fbb0-42ed-a51a-cb8d49115675 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:15.069021 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c86b6-91f5-496a-8f38-6e54a999d622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.071068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c86b6-91f5-496a-8f38-6e54a999d622 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.083433 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1142/2237] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:14 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:15.084694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c86b6-91f5-496a-8f38-6e54a999d622 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:15.103511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c86b6-91f5-496a-8f38-6e54a999d622 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.103724 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:15.109238 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f85b9-8dfa-4a19-8d39-f554b16bc3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:15.110532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f85b9-8dfa-4a19-8d39-f554b16bc3aa admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.111249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f85b9-8dfa-4a19-8d39-f554b16bc3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.111671 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f85b9-8dfa-4a19-8d39-f554b16bc3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.112317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f85b9-8dfa-4a19-8d39-f554b16bc3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.114157 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f85b9-8dfa-4a19-8d39-f554b16bc3aa admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.126959 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1143/2238] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:15.131994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f85b9-8dfa-4a19-8d39-f554b16bc3aa admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:15.148021 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f85b9-8dfa-4a19-8d39-f554b16bc3aa admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.152948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c511d7-de8d-4b87-88f4-cf8a98b5c32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:15.153702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c511d7-de8d-4b87-88f4-cf8a98b5c32b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.154673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c511d7-de8d-4b87-88f4-cf8a98b5c32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.154673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c511d7-de8d-4b87-88f4-cf8a98b5c32b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.155940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c511d7-de8d-4b87-88f4-cf8a98b5c32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.157742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c511d7-de8d-4b87-88f4-cf8a98b5c32b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.159340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef35269-fbb0-42ed-a51a-cb8d49115675 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.168021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a6070-18f2-4962-95be-39e8de6f4652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:15.168596 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6070-18f2-4962-95be-39e8de6f4652 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.168990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6070-18f2-4962-95be-39e8de6f4652 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.169156 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6070-18f2-4962-95be-39e8de6f4652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.170178 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1144/2239] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:15.170178 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c511d7-de8d-4b87-88f4-cf8a98b5c32b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:15.177068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-88c511d7-de8d-4b87-88f4-cf8a98b5c32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:15.188892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a6070-18f2-4962-95be-39e8de6f4652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.191677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a6070-18f2-4962-95be-39e8de6f4652 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.194145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c511d7-de8d-4b87-88f4-cf8a98b5c32b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.200107 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113dbb4-ef1e-4741-a5cb-09840f13878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:15.201207 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113dbb4-ef1e-4741-a5cb-09840f13878b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.201607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113dbb4-ef1e-4741-a5cb-09840f13878b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.201987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113dbb4-ef1e-4741-a5cb-09840f13878b admin admin] PATH_INFO: `/v3/projects/b3f51114a89748ef9a1dce6fe5e4e97f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.203465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113dbb4-ef1e-4741-a5cb-09840f13878b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f51114a89748ef9a1dce6fe5e4e97f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.206366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113dbb4-ef1e-4741-a5cb-09840f13878b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.216520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1096/2240] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:15.217369 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a6070-18f2-4962-95be-39e8de6f4652 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:15.243298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a6070-18f2-4962-95be-39e8de6f4652 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.253928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7da7cd-4ad7-40be-b59a-66d9a38bd228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:15.255046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7da7cd-4ad7-40be-b59a-66d9a38bd228 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.255386 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7da7cd-4ad7-40be-b59a-66d9a38bd228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.255669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7da7cd-4ad7-40be-b59a-66d9a38bd228 admin admin] PATH_INFO: `/v3/projects/2d2f005902254b08aab2fc1bcb352188/users/ae19da403a03499baaca7df823530ef8/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.271820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:15.280584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b113dbb4-ef1e-4741-a5cb-09840f13878b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f51114a89748ef9a1dce6fe5e4e97f', 'request_id': 'req-b113dbb4-ef1e-4741-a5cb-09840f13878b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:15.290266 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b113dbb4-ef1e-4741-a5cb-09840f13878b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f51114a89748ef9a1dce6fe5e4e97f', 'request_id': 'req-b113dbb4-ef1e-4741-a5cb-09840f13878b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:15.292499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7da7cd-4ad7-40be-b59a-66d9a38bd228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2f005902254b08aab2fc1bcb352188, user_id=ae19da403a03499baaca7df823530ef8, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.297917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b113dbb4-ef1e-4741-a5cb-09840f13878b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f51114a89748ef9a1dce6fe5e4e97f', 'request_id': 'req-b113dbb4-ef1e-4741-a5cb-09840f13878b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:15.298775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7da7cd-4ad7-40be-b59a-66d9a38bd228 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.318400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b113dbb4-ef1e-4741-a5cb-09840f13878b admin admin] The token cache is being invalidate because project b3f51114a89748ef9a1dce6fe5e4e97f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:15.319642 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b113dbb4-ef1e-4741-a5cb-09840f13878b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:15.320651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b113dbb4-ef1e-4741-a5cb-09840f13878b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:15.326263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1145/2241] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:15 2022] DELETE /identity/v3/projects/b3f51114a89748ef9a1dce6fe5e4e97f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:15.336301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1097/2242] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:15 2022] PUT /identity/v3/projects/2d2f005902254b08aab2fc1bcb352188/users/ae19da403a03499baaca7df823530ef8/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:15.336537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a50792-e0bd-45ba-a39f-461c573df74e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.336537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a50792-e0bd-45ba-a39f-461c573df74e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.336537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a50792-e0bd-45ba-a39f-461c573df74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.338326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b533f3-e59d-447c-ab5a-ad808ba875db None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.338696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b533f3-e59d-447c-ab5a-ad808ba875db None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.338997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b533f3-e59d-447c-ab5a-ad808ba875db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.367956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-92a50792-e0bd-45ba-a39f-461c573df74e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:15.369987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-92a50792-e0bd-45ba-a39f-461c573df74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:15.377204 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-52b533f3-e59d-447c-ab5a-ad808ba875db None None] MFA Rules not processed for user `ae19da403a03499baaca7df823530ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:15.379125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-52b533f3-e59d-447c-ab5a-ad808ba875db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:15.521155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1098/2243] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:15.521506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1146/2244] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:15.530642 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a50792-e0bd-45ba-a39f-461c573df74e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:15.533528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fd413-9a3a-4c40-925e-836388d3afc3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.534026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fd413-9a3a-4c40-925e-836388d3afc3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.534650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fd413-9a3a-4c40-925e-836388d3afc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.538236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-92a50792-e0bd-45ba-a39f-461c573df74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:15.554684 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a50792-e0bd-45ba-a39f-461c573df74e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.568748 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7a1fd413-9a3a-4c40-925e-836388d3afc3 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:15.568748 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7a1fd413-9a3a-4c40-925e-836388d3afc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:15.586411 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1099/2245] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:15.587735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fd413-9a3a-4c40-925e-836388d3afc3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:15.588713 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35ff33-e804-416a-b46b-dd42c02ae335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:15.590337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35ff33-e804-416a-b46b-dd42c02ae335 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.592588 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35ff33-e804-416a-b46b-dd42c02ae335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.593100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35ff33-e804-416a-b46b-dd42c02ae335 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.597992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35ff33-e804-416a-b46b-dd42c02ae335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.601475 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35ff33-e804-416a-b46b-dd42c02ae335 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.602821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fd413-9a3a-4c40-925e-836388d3afc3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.608696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66e291-941d-4724-931e-0032b6810bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:15.609500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66e291-941d-4724-931e-0032b6810bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.610083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66e291-941d-4724-931e-0032b6810bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.610372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66e291-941d-4724-931e-0032b6810bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.611178 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66e291-941d-4724-931e-0032b6810bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:15.611828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66e291-941d-4724-931e-0032b6810bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.614864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66e291-941d-4724-931e-0032b6810bb0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.638684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1100/2246] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:15.644766 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66e291-941d-4724-931e-0032b6810bb0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:15.681137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1147/2247] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:15 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:15.682587 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35ff33-e804-416a-b46b-dd42c02ae335 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:15.686659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66e291-941d-4724-931e-0032b6810bb0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.787561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece10ab6-0cda-4b31-a0be-9c4e905f3f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:15.789442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece10ab6-0cda-4b31-a0be-9c4e905f3f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.789880 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece10ab6-0cda-4b31-a0be-9c4e905f3f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.790484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece10ab6-0cda-4b31-a0be-9c4e905f3f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.792560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece10ab6-0cda-4b31-a0be-9c4e905f3f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.795197 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece10ab6-0cda-4b31-a0be-9c4e905f3f78 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.800574 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35ff33-e804-416a-b46b-dd42c02ae335 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.820104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1a7f7-9f85-46e8-98fa-2f708f85f5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:15.820845 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1a7f7-9f85-46e8-98fa-2f708f85f5be admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.821103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1a7f7-9f85-46e8-98fa-2f708f85f5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.821369 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1a7f7-9f85-46e8-98fa-2f708f85f5be admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.822358 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1a7f7-9f85-46e8-98fa-2f708f85f5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.824560 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1a7f7-9f85-46e8-98fa-2f708f85f5be admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.835995 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1101/2248] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:15 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:15.837602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece10ab6-0cda-4b31-a0be-9c4e905f3f78 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:15.848923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:15.852019 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1148/2249] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:15 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:15.856319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1a7f7-9f85-46e8-98fa-2f708f85f5be admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:15.868913 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1a7f7-9f85-46e8-98fa-2f708f85f5be admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.918681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:15.928831 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece10ab6-0cda-4b31-a0be-9c4e905f3f78 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.941299 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674775d-e002-451f-9747-142ca2f5eede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:15.942012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674775d-e002-451f-9747-142ca2f5eede admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.942293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674775d-e002-451f-9747-142ca2f5eede admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.944199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674775d-e002-451f-9747-142ca2f5eede admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.944903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674775d-e002-451f-9747-142ca2f5eede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.947055 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674775d-e002-451f-9747-142ca2f5eede admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.953950 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665a13c-e065-482f-8a8b-6272244f4abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:15.954777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665a13c-e065-482f-8a8b-6272244f4abd admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:15.955389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665a13c-e065-482f-8a8b-6272244f4abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:15.955778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665a13c-e065-482f-8a8b-6272244f4abd admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:15.956980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665a13c-e065-482f-8a8b-6272244f4abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:15.960355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665a13c-e065-482f-8a8b-6272244f4abd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:15.980989 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1149/2250] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:38:15.982026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665a13c-e065-482f-8a8b-6272244f4abd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:15.986737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1102/2251] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:15 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:15.990976 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674775d-e002-451f-9747-142ca2f5eede admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:15.994439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665a13c-e065-482f-8a8b-6272244f4abd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:15.999982 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68842a96-5cdb-439a-81e0-03051c0ab5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:16.001666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68842a96-5cdb-439a-81e0-03051c0ab5fb admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:16.001866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68842a96-5cdb-439a-81e0-03051c0ab5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:16.002226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68842a96-5cdb-439a-81e0-03051c0ab5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:16.003057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68842a96-5cdb-439a-81e0-03051c0ab5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:16.004824 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68842a96-5cdb-439a-81e0-03051c0ab5fb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:16.005263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674775d-e002-451f-9747-142ca2f5eede admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:16.016110 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400821fe-94f6-4faa-a54a-b89386158dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:16.018918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400821fe-94f6-4faa-a54a-b89386158dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:16.019225 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400821fe-94f6-4faa-a54a-b89386158dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:16.020504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400821fe-94f6-4faa-a54a-b89386158dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:16.021210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1150/2252] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:16.022674 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400821fe-94f6-4faa-a54a-b89386158dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:16.026726 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68842a96-5cdb-439a-81e0-03051c0ab5fb admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:16.028158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400821fe-94f6-4faa-a54a-b89386158dbb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:16.040732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68842a96-5cdb-439a-81e0-03051c0ab5fb admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:16.049267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40851a4-2c84-48b9-b3c1-8dcf27beb434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:16.050287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40851a4-2c84-48b9-b3c1-8dcf27beb434 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:16.050657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40851a4-2c84-48b9-b3c1-8dcf27beb434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:16.051005 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40851a4-2c84-48b9-b3c1-8dcf27beb434 admin admin] PATH_INFO: `/v3/projects/a71169771f5846c7b190a673bb9e394d/users/70599c78608943bd824a5cb8df7c5408/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:16.061677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1103/2253] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:16.067428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400821fe-94f6-4faa-a54a-b89386158dbb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:16.081095 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400821fe-94f6-4faa-a54a-b89386158dbb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:16.088624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba20e2-b9d3-4a12-81a8-70dc48a7f628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:16.089413 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba20e2-b9d3-4a12-81a8-70dc48a7f628 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:16.089760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba20e2-b9d3-4a12-81a8-70dc48a7f628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:16.090026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba20e2-b9d3-4a12-81a8-70dc48a7f628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:16.090531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40851a4-2c84-48b9-b3c1-8dcf27beb434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71169771f5846c7b190a673bb9e394d, user_id=70599c78608943bd824a5cb8df7c5408, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:16.090998 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba20e2-b9d3-4a12-81a8-70dc48a7f628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:16.092525 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba20e2-b9d3-4a12-81a8-70dc48a7f628 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:16.097277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40851a4-2c84-48b9-b3c1-8dcf27beb434 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:16.121096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1104/2254] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:16.122011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba20e2-b9d3-4a12-81a8-70dc48a7f628 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:16.135440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba20e2-b9d3-4a12-81a8-70dc48a7f628 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:16.136743 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1151/2255] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:16 2022] PUT /identity/v3/projects/a71169771f5846c7b190a673bb9e394d/users/70599c78608943bd824a5cb8df7c5408/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:16.139847 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483b117-3e8c-4a78-b175-a64668dedc80 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:16.140291 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483b117-3e8c-4a78-b175-a64668dedc80 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:16.145836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483b117-3e8c-4a78-b175-a64668dedc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:16.187604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e483b117-3e8c-4a78-b175-a64668dedc80 None None] MFA Rules not processed for user `70599c78608943bd824a5cb8df7c5408`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:16.189758 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e483b117-3e8c-4a78-b175-a64668dedc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:16.233040 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffad658-f7bb-4f60-b452-6532e504b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:16.236179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffad658-f7bb-4f60-b452-6532e504b55c admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:16.236768 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffad658-f7bb-4f60-b452-6532e504b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:16.237688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffad658-f7bb-4f60-b452-6532e504b55c admin admin] PATH_INFO: `/v3/projects/e017ca1f397549f3adf925ce07b0d241/users/f73179930a094171b5284c3de035ab9a/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:16.261830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffad658-f7bb-4f60-b452-6532e504b55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e017ca1f397549f3adf925ce07b0d241, user_id=f73179930a094171b5284c3de035ab9a, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:16.265329 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffad658-f7bb-4f60-b452-6532e504b55c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:16.275608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1152/2256] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:16.280365 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483b117-3e8c-4a78-b175-a64668dedc80 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:16.286208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1105/2257] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:16 2022] PUT /identity/v3/projects/e017ca1f397549f3adf925ce07b0d241/users/f73179930a094171b5284c3de035ab9a/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:16.296103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483b117-3e8c-4a78-b175-a64668dedc80 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:16.304279 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11a11-78c8-4c65-a96d-0bf15e85c1bc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:16.306145 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11a11-78c8-4c65-a96d-0bf15e85c1bc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:16.306441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11a11-78c8-4c65-a96d-0bf15e85c1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:16.363449 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0ca11a11-78c8-4c65-a96d-0bf15e85c1bc None None] MFA Rules not processed for user `f73179930a094171b5284c3de035ab9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:16.364833 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0ca11a11-78c8-4c65-a96d-0bf15e85c1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:16.373212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e4e21-380b-44ed-a583-6cf199cbd165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:16.374204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e4e21-380b-44ed-a583-6cf199cbd165 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:16.374645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e4e21-380b-44ed-a583-6cf199cbd165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:16.375283 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e4e21-380b-44ed-a583-6cf199cbd165 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:16.376638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e4e21-380b-44ed-a583-6cf199cbd165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:16.378961 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e4e21-380b-44ed-a583-6cf199cbd165 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:16.413042 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1153/2258] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:16 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:16.417492 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e4e21-380b-44ed-a583-6cf199cbd165 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:16.435743 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:16.443845 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:16.479645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1106/2259] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:16.484328 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca11a11-78c8-4c65-a96d-0bf15e85c1bc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:16.515315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca11a11-78c8-4c65-a96d-0bf15e85c1bc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:16.546111 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e4e21-380b-44ed-a583-6cf199cbd165 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:16.559967 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45145c7-c7ad-4eeb-b542-d467509643e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:16.560688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45145c7-c7ad-4eeb-b542-d467509643e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:16.560982 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45145c7-c7ad-4eeb-b542-d467509643e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:16.561269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45145c7-c7ad-4eeb-b542-d467509643e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:16.561973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45145c7-c7ad-4eeb-b542-d467509643e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:16.563981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45145c7-c7ad-4eeb-b542-d467509643e7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:16.605857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1154/2260] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:16 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:16.605857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeab7fa-c027-4f3b-8047-4d284ffd6c3a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:16.605857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeab7fa-c027-4f3b-8047-4d284ffd6c3a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:16.605857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeab7fa-c027-4f3b-8047-4d284ffd6c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:16.620558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cfa03-b477-425c-996a-6ee73cb02b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:16.621295 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cfa03-b477-425c-996a-6ee73cb02b83 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:16.621585 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cfa03-b477-425c-996a-6ee73cb02b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:16.621894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cfa03-b477-425c-996a-6ee73cb02b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:16.622603 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cfa03-b477-425c-996a-6ee73cb02b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:16.630092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cfa03-b477-425c-996a-6ee73cb02b83 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:16.638129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3aeab7fa-c027-4f3b-8047-4d284ffd6c3a None None] MFA Rules not processed for user `145cee1016d349ceb93323a170bc957e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:16.639393 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3aeab7fa-c027-4f3b-8047-4d284ffd6c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:16.675725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1107/2261] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:16 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:16.676733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cfa03-b477-425c-996a-6ee73cb02b83 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:16.778572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cfa03-b477-425c-996a-6ee73cb02b83 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:16.785911 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e581e42-03f6-4a7f-9858-707a0c3026cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:16.786370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e581e42-03f6-4a7f-9858-707a0c3026cf admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:16.786973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e581e42-03f6-4a7f-9858-707a0c3026cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:16.787187 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e581e42-03f6-4a7f-9858-707a0c3026cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:16.788024 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e581e42-03f6-4a7f-9858-707a0c3026cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:16.790072 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e581e42-03f6-4a7f-9858-707a0c3026cf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:16.813546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1155/2262] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:16.814534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeab7fa-c027-4f3b-8047-4d284ffd6c3a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:16.821244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1108/2263] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:16.825393 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e581e42-03f6-4a7f-9858-707a0c3026cf admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:16.835740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeab7fa-c027-4f3b-8047-4d284ffd6c3a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:16.836649 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e581e42-03f6-4a7f-9858-707a0c3026cf admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:16.855122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3dbc6-9aac-4fb8-b46b-1a582df58eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:16.855814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3dbc6-9aac-4fb8-b46b-1a582df58eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:16.856108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3dbc6-9aac-4fb8-b46b-1a582df58eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:16.856431 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3dbc6-9aac-4fb8-b46b-1a582df58eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:16.857119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3dbc6-9aac-4fb8-b46b-1a582df58eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:16.859558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3dbc6-9aac-4fb8-b46b-1a582df58eb5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:16.865189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3ecda-76a9-4c30-96aa-5c3d4338019a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:16.866595 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3ecda-76a9-4c30-96aa-5c3d4338019a admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:16.866985 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3ecda-76a9-4c30-96aa-5c3d4338019a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:16.867391 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3ecda-76a9-4c30-96aa-5c3d4338019a admin admin] PATH_INFO: `/v3/projects/f104b021b5724d0db1ba7b7e6cf76663/users/c16233aa24cb463e85d9371f69c4a189/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:16.899588 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1156/2264] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:16 2022] POST /identity/v3/users => generated 289 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:16.900717 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3dbc6-9aac-4fb8-b46b-1a582df58eb5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:16.905739 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-adb3dbc6-9aac-4fb8-b46b-1a582df58eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:16.909662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3ecda-76a9-4c30-96aa-5c3d4338019a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f104b021b5724d0db1ba7b7e6cf76663, user_id=c16233aa24cb463e85d9371f69c4a189, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:16.916605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3ecda-76a9-4c30-96aa-5c3d4338019a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:16.954375 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1109/2265] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:16 2022] PUT /identity/v3/projects/f104b021b5724d0db1ba7b7e6cf76663/users/c16233aa24cb463e85d9371f69c4a189/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:16.954375 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3ecda-76a9-4c30-96aa-5c3d4338019a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.026507 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3dbc6-9aac-4fb8-b46b-1a582df58eb5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.077807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:17.096180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:17.128704 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3ecda-76a9-4c30-96aa-5c3d4338019a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.133007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01856ac5-fb7c-497e-99c4-606e9a1cdf3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.134461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01856ac5-fb7c-497e-99c4-606e9a1cdf3b service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.135074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01856ac5-fb7c-497e-99c4-606e9a1cdf3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.135617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01856ac5-fb7c-497e-99c4-606e9a1cdf3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.146027 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f952b4-6df0-4db1-a6bc-f035cd23f198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.148884 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f952b4-6df0-4db1-a6bc-f035cd23f198 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.149285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f952b4-6df0-4db1-a6bc-f035cd23f198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.149667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f952b4-6df0-4db1-a6bc-f035cd23f198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.150759 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f952b4-6df0-4db1-a6bc-f035cd23f198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.153180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f952b4-6df0-4db1-a6bc-f035cd23f198 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.175745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1110/2266] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:17.178946 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f952b4-6df0-4db1-a6bc-f035cd23f198 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.197815 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f952b4-6df0-4db1-a6bc-f035cd23f198 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.204185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a109a9a-07f2-4208-8cf5-d65fe8534255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.206656 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a109a9a-07f2-4208-8cf5-d65fe8534255 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.206656 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a109a9a-07f2-4208-8cf5-d65fe8534255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.206656 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a109a9a-07f2-4208-8cf5-d65fe8534255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.206656 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a109a9a-07f2-4208-8cf5-d65fe8534255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.207891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a109a9a-07f2-4208-8cf5-d65fe8534255 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.223013 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1111/2267] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:17.223013 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a109a9a-07f2-4208-8cf5-d65fe8534255 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.231107 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01856ac5-fb7c-497e-99c4-606e9a1cdf3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.231545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a109a9a-07f2-4208-8cf5-d65fe8534255 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.232988 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01856ac5-fb7c-497e-99c4-606e9a1cdf3b service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.237055 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfde4ab-43b7-4677-9fe1-b1520880c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.237832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfde4ab-43b7-4677-9fe1-b1520880c352 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.238192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfde4ab-43b7-4677-9fe1-b1520880c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.238543 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfde4ab-43b7-4677-9fe1-b1520880c352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.239363 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfde4ab-43b7-4677-9fe1-b1520880c352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.241090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfde4ab-43b7-4677-9fe1-b1520880c352 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.245425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1157/2268] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:17.246338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01856ac5-fb7c-497e-99c4-606e9a1cdf3b service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.259028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1112/2269] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:17.260239 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfde4ab-43b7-4677-9fe1-b1520880c352 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.265601 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01856ac5-fb7c-497e-99c4-606e9a1cdf3b service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.271892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10a90d-834c-4831-a179-aac0ec6cc236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.272599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfde4ab-43b7-4677-9fe1-b1520880c352 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.273471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a90d-834c-4831-a179-aac0ec6cc236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.273768 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a90d-834c-4831-a179-aac0ec6cc236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.274101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a90d-834c-4831-a179-aac0ec6cc236 admin admin] PATH_INFO: `/v3/projects/f104b021b5724d0db1ba7b7e6cf76663/users/c16233aa24cb463e85d9371f69c4a189/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.277049 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10a90d-834c-4831-a179-aac0ec6cc236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f104b021b5724d0db1ba7b7e6cf76663, user_id=c16233aa24cb463e85d9371f69c4a189, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.279833 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ecb20-cc53-44dc-88da-5dea51bb2ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.280132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10a90d-834c-4831-a179-aac0ec6cc236 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.281214 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ecb20-cc53-44dc-88da-5dea51bb2ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.281690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ecb20-cc53-44dc-88da-5dea51bb2ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.282123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ecb20-cc53-44dc-88da-5dea51bb2ae0 admin admin] PATH_INFO: `/v3/projects/09d97a052b0841a494decd1fbeff172b/users/1ddd33d346e54e4f85a3fd24b299fda1/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.292649 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1158/2270] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:17 2022] PUT /identity/v3/projects/f104b021b5724d0db1ba7b7e6cf76663/users/c16233aa24cb463e85d9371f69c4a189/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:17.301215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ecb20-cc53-44dc-88da-5dea51bb2ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d97a052b0841a494decd1fbeff172b, user_id=1ddd33d346e54e4f85a3fd24b299fda1, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.304134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3ae02-d919-4860-a2eb-4bf0df8b2a3c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.304991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3ae02-d919-4860-a2eb-4bf0df8b2a3c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.305437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3ae02-d919-4860-a2eb-4bf0df8b2a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.313929 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ecb20-cc53-44dc-88da-5dea51bb2ae0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.344953 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-90c3ae02-d919-4860-a2eb-4bf0df8b2a3c None None] MFA Rules not processed for user `c16233aa24cb463e85d9371f69c4a189`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:17.346973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-90c3ae02-d919-4860-a2eb-4bf0df8b2a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:17.347582 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1113/2271] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:17 2022] PUT /identity/v3/projects/09d97a052b0841a494decd1fbeff172b/users/1ddd33d346e54e4f85a3fd24b299fda1/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:17.361896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57738379-c358-4670-9946-a115971a2d8f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.363087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57738379-c358-4670-9946-a115971a2d8f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.363592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57738379-c358-4670-9946-a115971a2d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.430452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-57738379-c358-4670-9946-a115971a2d8f None None] MFA Rules not processed for user `1ddd33d346e54e4f85a3fd24b299fda1`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:17.431679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-57738379-c358-4670-9946-a115971a2d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:17.453807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1159/2272] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:17.465444 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3ae02-d919-4860-a2eb-4bf0df8b2a3c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.469640 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-90c3ae02-d919-4860-a2eb-4bf0df8b2a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:17.540597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3ae02-d919-4860-a2eb-4bf0df8b2a3c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.551277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803be868-75fe-49a0-9544-b1cd34974a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.551980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803be868-75fe-49a0-9544-b1cd34974a2e service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.552273 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803be868-75fe-49a0-9544-b1cd34974a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.552576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803be868-75fe-49a0-9544-b1cd34974a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.574538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1114/2273] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:17.577357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803be868-75fe-49a0-9544-b1cd34974a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.579915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57738379-c358-4670-9946-a115971a2d8f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.582776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803be868-75fe-49a0-9544-b1cd34974a2e service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.595515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:17.625825 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1160/2274] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:17.672878 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803be868-75fe-49a0-9544-b1cd34974a2e service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.687150 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803be868-75fe-49a0-9544-b1cd34974a2e service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.693006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8611864-3a75-4b47-81d7-abad726e3764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.693819 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611864-3a75-4b47-81d7-abad726e3764 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.694110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611864-3a75-4b47-81d7-abad726e3764 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.694387 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611864-3a75-4b47-81d7-abad726e3764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.728876 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57738379-c358-4670-9946-a115971a2d8f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:17.734425 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20d5f3-048b-4df7-9fa4-b30e4aca02cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:17.736671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20d5f3-048b-4df7-9fa4-b30e4aca02cf admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:17.736671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20d5f3-048b-4df7-9fa4-b30e4aca02cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:17.736894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20d5f3-048b-4df7-9fa4-b30e4aca02cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:17.737728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20d5f3-048b-4df7-9fa4-b30e4aca02cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.740028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20d5f3-048b-4df7-9fa4-b30e4aca02cf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.762271 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8611864-3a75-4b47-81d7-abad726e3764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:17.764246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8611864-3a75-4b47-81d7-abad726e3764 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:17.785534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1161/2275] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:38:17.825162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1115/2276] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:17 2022] POST /identity/v3/projects => generated 377 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:17.827082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8611864-3a75-4b47-81d7-abad726e3764 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:17.843632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8611864-3a75-4b47-81d7-abad726e3764 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:18.000294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1a694-1125-4f04-87a8-1454a2cdd053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:18.003122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a694-1125-4f04-87a8-1454a2cdd053 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:18.003424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a694-1125-4f04-87a8-1454a2cdd053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:18.003714 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a694-1125-4f04-87a8-1454a2cdd053 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:18.006815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1a694-1125-4f04-87a8-1454a2cdd053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:18.009736 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1a694-1125-4f04-87a8-1454a2cdd053 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:18.043974 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1162/2277] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:17 2022] POST /identity/v3/users => generated 295 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:18.048423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20d5f3-048b-4df7-9fa4-b30e4aca02cf admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:18.064107 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20d5f3-048b-4df7-9fa4-b30e4aca02cf admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:18.081430 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e1612-8891-4ab5-9b42-7af405472c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:18.082177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e1612-8891-4ab5-9b42-7af405472c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:18.082470 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e1612-8891-4ab5-9b42-7af405472c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:18.082752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e1612-8891-4ab5-9b42-7af405472c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:18.083493 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e1612-8891-4ab5-9b42-7af405472c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:18.085174 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e1612-8891-4ab5-9b42-7af405472c73 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:18.088100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:18.108553 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1a694-1125-4f04-87a8-1454a2cdd053 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:18.109885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1116/2278] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:18.131118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1a694-1125-4f04-87a8-1454a2cdd053 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:18.145531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184073ac-ec9c-4061-8129-2043a338a1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:18.146481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184073ac-ec9c-4061-8129-2043a338a1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:18.146750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184073ac-ec9c-4061-8129-2043a338a1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:18.147018 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184073ac-ec9c-4061-8129-2043a338a1a6 admin admin] PATH_INFO: `/v3/projects/073a86e1430b438687b281748953e46b/users/c3db5e1b0a704199a1cc803bbcc09a4a/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:18.170054 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184073ac-ec9c-4061-8129-2043a338a1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073a86e1430b438687b281748953e46b, user_id=c3db5e1b0a704199a1cc803bbcc09a4a, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:18.173352 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184073ac-ec9c-4061-8129-2043a338a1a6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:18.199928 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1163/2279] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:18 2022] PUT /identity/v3/projects/073a86e1430b438687b281748953e46b/users/c3db5e1b0a704199a1cc803bbcc09a4a/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:38:18.205174 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e1612-8891-4ab5-9b42-7af405472c73 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:18.226838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e1612-8891-4ab5-9b42-7af405472c73 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:18.326244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f44aa3-2a86-4e7d-b56e-8713582a6525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:18.327132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44aa3-2a86-4e7d-b56e-8713582a6525 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:18.332138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44aa3-2a86-4e7d-b56e-8713582a6525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:18.332465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44aa3-2a86-4e7d-b56e-8713582a6525 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:18.333375 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f44aa3-2a86-4e7d-b56e-8713582a6525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:18.338718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f44aa3-2a86-4e7d-b56e-8713582a6525 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:18.364385 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1117/2280] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:18.366313 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184073ac-ec9c-4061-8129-2043a338a1a6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:18.384575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184073ac-ec9c-4061-8129-2043a338a1a6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:18.408075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf6ea-a24b-4e04-a87d-83f34da20339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:18.409032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf6ea-a24b-4e04-a87d-83f34da20339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:18.409321 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf6ea-a24b-4e04-a87d-83f34da20339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:18.410030 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf6ea-a24b-4e04-a87d-83f34da20339 admin admin] PATH_INFO: `/v3/projects/073a86e1430b438687b281748953e46b/users/c3db5e1b0a704199a1cc803bbcc09a4a/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:18.412070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf6ea-a24b-4e04-a87d-83f34da20339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073a86e1430b438687b281748953e46b, user_id=c3db5e1b0a704199a1cc803bbcc09a4a, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:18.414793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf6ea-a24b-4e04-a87d-83f34da20339 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:18.432664 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1164/2281] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:18 2022] PUT /identity/v3/projects/073a86e1430b438687b281748953e46b/users/c3db5e1b0a704199a1cc803bbcc09a4a/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:18.441633 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b8346-53af-4b98-be20-7d2d6f90db3a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:18.442127 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b8346-53af-4b98-be20-7d2d6f90db3a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:18.442674 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b8346-53af-4b98-be20-7d2d6f90db3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:18.472144 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5f3b8346-53af-4b98-be20-7d2d6f90db3a None None] MFA Rules not processed for user `c3db5e1b0a704199a1cc803bbcc09a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:18.473425 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f3b8346-53af-4b98-be20-7d2d6f90db3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:18.560047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1118/2282] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:18.576522 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf6ea-a24b-4e04-a87d-83f34da20339 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:18.631671 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:18.637333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf6ea-a24b-4e04-a87d-83f34da20339 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:18.642358 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedf631-1004-4c55-9d9c-c45dcadcbff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:18.643010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf631-1004-4c55-9d9c-c45dcadcbff9 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:18.643300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf631-1004-4c55-9d9c-c45dcadcbff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:18.643586 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf631-1004-4c55-9d9c-c45dcadcbff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:18.717803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedf631-1004-4c55-9d9c-c45dcadcbff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:18.720262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedf631-1004-4c55-9d9c-c45dcadcbff9 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:18.736806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1165/2283] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:19.646336 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b8346-53af-4b98-be20-7d2d6f90db3a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:19.647916 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f3b8346-53af-4b98-be20-7d2d6f90db3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:19.718469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b8346-53af-4b98-be20-7d2d6f90db3a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:19.723883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa82706-4387-4b46-a173-96b0187c52ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:19.724785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa82706-4387-4b46-a173-96b0187c52ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:19.725097 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa82706-4387-4b46-a173-96b0187c52ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:19.725362 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa82706-4387-4b46-a173-96b0187c52ce admin admin] PATH_INFO: `/v3/users/1f231f706d2f4d3e9070105bb5981cec` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:19.726563 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa82706-4387-4b46-a173-96b0187c52ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f231f706d2f4d3e9070105bb5981cec)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:19.728535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa82706-4387-4b46-a173-96b0187c52ce admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:19.751336 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:19.776730 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8aa82706-4387-4b46-a173-96b0187c52ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f231f706d2f4d3e9070105bb5981cec'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:19.789657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8aa82706-4387-4b46-a173-96b0187c52ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f231f706d2f4d3e9070105bb5981cec'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:19.790346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8aa82706-4387-4b46-a173-96b0187c52ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f231f706d2f4d3e9070105bb5981cec'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:19.797982 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8aa82706-4387-4b46-a173-96b0187c52ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f231f706d2f4d3e9070105bb5981cec'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:19.798617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8aa82706-4387-4b46-a173-96b0187c52ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f231f706d2f4d3e9070105bb5981cec'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:19.813519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1119/2284] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:19 2022] DELETE /identity/v3/users/1f231f706d2f4d3e9070105bb5981cec => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:20.003268 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedf631-1004-4c55-9d9c-c45dcadcbff9 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:20.022499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedf631-1004-4c55-9d9c-c45dcadcbff9 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:20.087276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c6754-08e5-49cf-b9d7-2318f84c18ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:20.088139 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c6754-08e5-49cf-b9d7-2318f84c18ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.088453 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c6754-08e5-49cf-b9d7-2318f84c18ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.088735 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c6754-08e5-49cf-b9d7-2318f84c18ef admin admin] PATH_INFO: `/v3/projects/d2f12afd420d4f6bad8e80207ea64d44` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.089906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c6754-08e5-49cf-b9d7-2318f84c18ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f12afd420d4f6bad8e80207ea64d44)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:20.091867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c6754-08e5-49cf-b9d7-2318f84c18ef admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:20.142701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-250c6754-08e5-49cf-b9d7-2318f84c18ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f12afd420d4f6bad8e80207ea64d44', 'request_id': 'req-250c6754-08e5-49cf-b9d7-2318f84c18ef'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:20.149454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-250c6754-08e5-49cf-b9d7-2318f84c18ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f12afd420d4f6bad8e80207ea64d44', 'request_id': 'req-250c6754-08e5-49cf-b9d7-2318f84c18ef'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:20.155605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-250c6754-08e5-49cf-b9d7-2318f84c18ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f12afd420d4f6bad8e80207ea64d44', 'request_id': 'req-250c6754-08e5-49cf-b9d7-2318f84c18ef'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:20.179482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-250c6754-08e5-49cf-b9d7-2318f84c18ef admin admin] The token cache is being invalidate because project d2f12afd420d4f6bad8e80207ea64d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:20.179757 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-250c6754-08e5-49cf-b9d7-2318f84c18ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:20.180422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-250c6754-08e5-49cf-b9d7-2318f84c18ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:20.182153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1166/2285] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:20 2022] DELETE /identity/v3/projects/d2f12afd420d4f6bad8e80207ea64d44 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:20.187216 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc0e3a-a61d-4eff-81bc-213a07050c25 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.187559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc0e3a-a61d-4eff-81bc-213a07050c25 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.187854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc0e3a-a61d-4eff-81bc-213a07050c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.206507 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-33bc0e3a-a61d-4eff-81bc-213a07050c25 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:20.207718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-33bc0e3a-a61d-4eff-81bc-213a07050c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:20.270813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1120/2286] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:20.279397 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf57bd-54cf-4424-a389-1a969fc13d9d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.279696 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf57bd-54cf-4424-a389-1a969fc13d9d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.279980 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf57bd-54cf-4424-a389-1a969fc13d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.299907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fadf57bd-54cf-4424-a389-1a969fc13d9d None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:20.301173 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fadf57bd-54cf-4424-a389-1a969fc13d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:20.315554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1167/2287] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:20.318849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc0e3a-a61d-4eff-81bc-213a07050c25 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:20.335732 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc0e3a-a61d-4eff-81bc-213a07050c25 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:20.340491 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bfa44-72e5-4052-a700-7db5ff117dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:20.341242 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bfa44-72e5-4052-a700-7db5ff117dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.341583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bfa44-72e5-4052-a700-7db5ff117dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.341871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bfa44-72e5-4052-a700-7db5ff117dc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.342636 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bfa44-72e5-4052-a700-7db5ff117dc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:20.342955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bfa44-72e5-4052-a700-7db5ff117dc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:20.345060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bfa44-72e5-4052-a700-7db5ff117dc9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:20.358183 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1121/2288] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:20.363564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf57bd-54cf-4424-a389-1a969fc13d9d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:20.377602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf57bd-54cf-4424-a389-1a969fc13d9d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:20.382335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7ece2-cf86-4113-a1f6-df0db05f73f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:20.383002 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7ece2-cf86-4113-a1f6-df0db05f73f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.383292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7ece2-cf86-4113-a1f6-df0db05f73f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.383573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7ece2-cf86-4113-a1f6-df0db05f73f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.384282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7ece2-cf86-4113-a1f6-df0db05f73f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:20.386223 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7ece2-cf86-4113-a1f6-df0db05f73f0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:20.417613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1168/2289] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:20 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:20.419245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bfa44-72e5-4052-a700-7db5ff117dc9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:20.430712 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bfa44-72e5-4052-a700-7db5ff117dc9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:20.490813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a66516-e4e0-41d1-8449-804ad18f81e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:20.491510 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a66516-e4e0-41d1-8449-804ad18f81e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.491797 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a66516-e4e0-41d1-8449-804ad18f81e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.492084 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a66516-e4e0-41d1-8449-804ad18f81e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.492816 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a66516-e4e0-41d1-8449-804ad18f81e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:20.494826 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a66516-e4e0-41d1-8449-804ad18f81e7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:20.515739 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1122/2290] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:20 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:20.520117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7ece2-cf86-4113-a1f6-df0db05f73f0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:20.528089 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:20.533119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7ece2-cf86-4113-a1f6-df0db05f73f0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:20.539614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90758de3-fb36-48f7-b511-af4bc8293f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:20.540818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90758de3-fb36-48f7-b511-af4bc8293f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.541367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90758de3-fb36-48f7-b511-af4bc8293f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.541645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90758de3-fb36-48f7-b511-af4bc8293f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.542843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90758de3-fb36-48f7-b511-af4bc8293f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:20.545070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90758de3-fb36-48f7-b511-af4bc8293f18 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:20.558443 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1169/2291] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:20.562513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a66516-e4e0-41d1-8449-804ad18f81e7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:20.574547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a66516-e4e0-41d1-8449-804ad18f81e7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:20.580558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3191c-ab62-4ee4-aa29-60ebb5219851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:20.581238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3191c-ab62-4ee4-aa29-60ebb5219851 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.581531 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3191c-ab62-4ee4-aa29-60ebb5219851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.581813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3191c-ab62-4ee4-aa29-60ebb5219851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.582553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3191c-ab62-4ee4-aa29-60ebb5219851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:20.584255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3191c-ab62-4ee4-aa29-60ebb5219851 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:20.596028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1123/2292] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:20.600210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90758de3-fb36-48f7-b511-af4bc8293f18 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:20.615125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90758de3-fb36-48f7-b511-af4bc8293f18 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:20.620618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef583b-0a45-44b8-af6d-39f77d874f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:20.621646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef583b-0a45-44b8-af6d-39f77d874f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.621948 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef583b-0a45-44b8-af6d-39f77d874f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.622219 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef583b-0a45-44b8-af6d-39f77d874f17 admin admin] PATH_INFO: `/v3/projects/9af209f962144de4ae7e3575a3890096/users/75d12a685d9b419fa3606b5f4d1309fe/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.637540 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef583b-0a45-44b8-af6d-39f77d874f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af209f962144de4ae7e3575a3890096, user_id=75d12a685d9b419fa3606b5f4d1309fe, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:20.640239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef583b-0a45-44b8-af6d-39f77d874f17 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:20.655344 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1170/2293] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:20 2022] PUT /identity/v3/projects/9af209f962144de4ae7e3575a3890096/users/75d12a685d9b419fa3606b5f4d1309fe/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:20.661150 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c06600-fdfd-4ac6-8417-8fc88e99debe None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.661612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c06600-fdfd-4ac6-8417-8fc88e99debe None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.661726 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c06600-fdfd-4ac6-8417-8fc88e99debe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.668834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:20.681890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-36c06600-fdfd-4ac6-8417-8fc88e99debe None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:20.683512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-36c06600-fdfd-4ac6-8417-8fc88e99debe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:20.756067 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1124/2294] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:20.766814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef583b-0a45-44b8-af6d-39f77d874f17 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:20.768606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e8ef583b-0a45-44b8-af6d-39f77d874f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:20.830702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef583b-0a45-44b8-af6d-39f77d874f17 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:20.835157 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81535d65-bfdf-4aed-9b5d-cef9f8f7947c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:20.835820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535d65-bfdf-4aed-9b5d-cef9f8f7947c service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:20.836111 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535d65-bfdf-4aed-9b5d-cef9f8f7947c service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:20.836424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535d65-bfdf-4aed-9b5d-cef9f8f7947c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:20.846395 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81535d65-bfdf-4aed-9b5d-cef9f8f7947c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:20.847901 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81535d65-bfdf-4aed-9b5d-cef9f8f7947c service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:20.858373 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1171/2295] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:21.033291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65209c-ae5d-4d29-84f4-fc10ccf6d5ad None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:21.033672 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65209c-ae5d-4d29-84f4-fc10ccf6d5ad None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:21.034017 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65209c-ae5d-4d29-84f4-fc10ccf6d5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:21.053198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-eb65209c-ae5d-4d29-84f4-fc10ccf6d5ad None None] MFA Rules not processed for user `145cee1016d349ceb93323a170bc957e`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:21.054468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eb65209c-ae5d-4d29-84f4-fc10ccf6d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:21.123571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1125/2296] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:21.438389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81535d65-bfdf-4aed-9b5d-cef9f8f7947c service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:21.444495 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-81535d65-bfdf-4aed-9b5d-cef9f8f7947c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:21.576316 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81535d65-bfdf-4aed-9b5d-cef9f8f7947c service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:21.581581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375aec6f-a2ec-44bb-9a07-12d57d6ce642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:21.582437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aec6f-a2ec-44bb-9a07-12d57d6ce642 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:21.582724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aec6f-a2ec-44bb-9a07-12d57d6ce642 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:21.583000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aec6f-a2ec-44bb-9a07-12d57d6ce642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:21.584972 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-375aec6f-a2ec-44bb-9a07-12d57d6ce642 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:21.676987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aec6f-a2ec-44bb-9a07-12d57d6ce642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:21.678657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aec6f-a2ec-44bb-9a07-12d57d6ce642 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:21.691420 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1172/2297] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:22.709203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65209c-ae5d-4d29-84f4-fc10ccf6d5ad None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:22.723496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65209c-ae5d-4d29-84f4-fc10ccf6d5ad None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:22.747895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53742afc-1d9a-489a-816c-07125a7e6500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:22.748591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53742afc-1d9a-489a-816c-07125a7e6500 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:22.748859 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53742afc-1d9a-489a-816c-07125a7e6500 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:22.749149 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53742afc-1d9a-489a-816c-07125a7e6500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:22.771600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-53742afc-1d9a-489a-816c-07125a7e6500 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:23.005211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53742afc-1d9a-489a-816c-07125a7e6500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:23.007110 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53742afc-1d9a-489a-816c-07125a7e6500 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:23.032292 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1126/2298] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:24.233630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375aec6f-a2ec-44bb-9a07-12d57d6ce642 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:24.235898 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-375aec6f-a2ec-44bb-9a07-12d57d6ce642 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:24.269194 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375aec6f-a2ec-44bb-9a07-12d57d6ce642 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:24.278941 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954b105-cb85-49a8-a458-2e5be6ef0e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:24.280089 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b105-cb85-49a8-a458-2e5be6ef0e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:24.280494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b105-cb85-49a8-a458-2e5be6ef0e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:24.280835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b105-cb85-49a8-a458-2e5be6ef0e7c admin admin] PATH_INFO: `/v3/users/ae19da403a03499baaca7df823530ef8` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:24.282252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954b105-cb85-49a8-a458-2e5be6ef0e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae19da403a03499baaca7df823530ef8)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:24.284294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954b105-cb85-49a8-a458-2e5be6ef0e7c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:24.323282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:24.371624 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c954b105-cb85-49a8-a458-2e5be6ef0e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae19da403a03499baaca7df823530ef8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:24.384972 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c954b105-cb85-49a8-a458-2e5be6ef0e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae19da403a03499baaca7df823530ef8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:24.414813 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c954b105-cb85-49a8-a458-2e5be6ef0e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae19da403a03499baaca7df823530ef8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:24.416323 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c954b105-cb85-49a8-a458-2e5be6ef0e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae19da403a03499baaca7df823530ef8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:24.443867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c954b105-cb85-49a8-a458-2e5be6ef0e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae19da403a03499baaca7df823530ef8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:24.457201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1173/2299] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:24 2022] DELETE /identity/v3/users/ae19da403a03499baaca7df823530ef8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:24.461453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372cf64-63d6-46e4-a879-c0d5d9cfa5f7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:24.462859 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372cf64-63d6-46e4-a879-c0d5d9cfa5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:24.463365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372cf64-63d6-46e4-a879-c0d5d9cfa5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:24.489891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8372cf64-63d6-46e4-a879-c0d5d9cfa5f7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:24.493881 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8372cf64-63d6-46e4-a879-c0d5d9cfa5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:24.625635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:24.669667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1127/2300] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:24.681633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954b105-cb85-49a8-a458-2e5be6ef0e7c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:24.683485 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c954b105-cb85-49a8-a458-2e5be6ef0e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:24.803415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954b105-cb85-49a8-a458-2e5be6ef0e7c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:24.810526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3b252-6526-4690-8c44-0bde39824f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:24.811559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3b252-6526-4690-8c44-0bde39824f11 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:24.812116 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3b252-6526-4690-8c44-0bde39824f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:24.812993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3b252-6526-4690-8c44-0bde39824f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:24.837262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3b252-6526-4690-8c44-0bde39824f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:24.839720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3b252-6526-4690-8c44-0bde39824f11 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:24.857853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1174/2301] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:25.129705 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372cf64-63d6-46e4-a879-c0d5d9cfa5f7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:25.131167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8372cf64-63d6-46e4-a879-c0d5d9cfa5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:25.154887 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372cf64-63d6-46e4-a879-c0d5d9cfa5f7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:25.170506 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385613fb-89aa-4aef-adcb-6dcefd2dc343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:25.171435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385613fb-89aa-4aef-adcb-6dcefd2dc343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:25.171807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385613fb-89aa-4aef-adcb-6dcefd2dc343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:25.172425 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385613fb-89aa-4aef-adcb-6dcefd2dc343 admin admin] PATH_INFO: `/v3/users/c85d1839a15a409c942ef9149b82ae28` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:25.173465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385613fb-89aa-4aef-adcb-6dcefd2dc343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85d1839a15a409c942ef9149b82ae28)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:25.175471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385613fb-89aa-4aef-adcb-6dcefd2dc343 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:25.300175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-385613fb-89aa-4aef-adcb-6dcefd2dc343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85d1839a15a409c942ef9149b82ae28'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:25.318828 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-385613fb-89aa-4aef-adcb-6dcefd2dc343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85d1839a15a409c942ef9149b82ae28'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:25.319990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-385613fb-89aa-4aef-adcb-6dcefd2dc343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85d1839a15a409c942ef9149b82ae28'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:25.330168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-385613fb-89aa-4aef-adcb-6dcefd2dc343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85d1839a15a409c942ef9149b82ae28'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:25.331162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-385613fb-89aa-4aef-adcb-6dcefd2dc343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85d1839a15a409c942ef9149b82ae28'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:25.370391 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1128/2302] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:25 2022] DELETE /identity/v3/users/c85d1839a15a409c942ef9149b82ae28 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:25.376993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25a9ad-64ca-4ed0-8bc1-aa57c979640a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:25.379061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25a9ad-64ca-4ed0-8bc1-aa57c979640a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:25.379610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25a9ad-64ca-4ed0-8bc1-aa57c979640a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:25.425191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-be25a9ad-64ca-4ed0-8bc1-aa57c979640a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:25.429099 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-be25a9ad-64ca-4ed0-8bc1-aa57c979640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:25.554140 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1175/2303] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:25.566613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385613fb-89aa-4aef-adcb-6dcefd2dc343 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:25.568945 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-385613fb-89aa-4aef-adcb-6dcefd2dc343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:25.583455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25a9ad-64ca-4ed0-8bc1-aa57c979640a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:25.586163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-be25a9ad-64ca-4ed0-8bc1-aa57c979640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:25.599538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25a9ad-64ca-4ed0-8bc1-aa57c979640a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:25.604928 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:25.606146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:25.606771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:25.607226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] PATH_INFO: `/v3/projects/2d2f005902254b08aab2fc1bcb352188` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:25.617922 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2f005902254b08aab2fc1bcb352188)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:25.620596 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:25.712269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385613fb-89aa-4aef-adcb-6dcefd2dc343 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:25.722838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a8af9-97f9-4bd5-b813-ad6c9fd7f631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:25.723513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a8af9-97f9-4bd5-b813-ad6c9fd7f631 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:25.723801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a8af9-97f9-4bd5-b813-ad6c9fd7f631 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:25.724060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a8af9-97f9-4bd5-b813-ad6c9fd7f631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:25.738319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:25.743824 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a8af9-97f9-4bd5-b813-ad6c9fd7f631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:25.745896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a8af9-97f9-4bd5-b813-ad6c9fd7f631 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:25.769021 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2f005902254b08aab2fc1bcb352188', 'request_id': 'req-d2bcbd06-e895-4717-8223-715ce0afa093'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:25.774671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1129/2304] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:25.804164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2f005902254b08aab2fc1bcb352188', 'request_id': 'req-d2bcbd06-e895-4717-8223-715ce0afa093'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:25.816930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2f005902254b08aab2fc1bcb352188', 'request_id': 'req-d2bcbd06-e895-4717-8223-715ce0afa093'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:25.838510 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] The token cache is being invalidate because project 2d2f005902254b08aab2fc1bcb352188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:25.838835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:25.840043 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:25.842001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1176/2305] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:25 2022] DELETE /identity/v3/projects/2d2f005902254b08aab2fc1bcb352188 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:25.846023 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a8af9-97f9-4bd5-b813-ad6c9fd7f631 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:25.859086 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a8af9-97f9-4bd5-b813-ad6c9fd7f631 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:25.952694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74204a79-dbb5-4be3-b388-17dcb4d7d8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:25.960089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74204a79-dbb5-4be3-b388-17dcb4d7d8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:25.960441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74204a79-dbb5-4be3-b388-17dcb4d7d8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:25.960736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74204a79-dbb5-4be3-b388-17dcb4d7d8b1 admin admin] PATH_INFO: `/v3/users/70599c78608943bd824a5cb8df7c5408` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:25.962229 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74204a79-dbb5-4be3-b388-17dcb4d7d8b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70599c78608943bd824a5cb8df7c5408)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:25.965861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74204a79-dbb5-4be3-b388-17dcb4d7d8b1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:25.967905 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:26.079315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-74204a79-dbb5-4be3-b388-17dcb4d7d8b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70599c78608943bd824a5cb8df7c5408'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:26.108228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-74204a79-dbb5-4be3-b388-17dcb4d7d8b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70599c78608943bd824a5cb8df7c5408'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:26.110237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-74204a79-dbb5-4be3-b388-17dcb4d7d8b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70599c78608943bd824a5cb8df7c5408'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:26.120619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-74204a79-dbb5-4be3-b388-17dcb4d7d8b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70599c78608943bd824a5cb8df7c5408'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:26.122109 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-74204a79-dbb5-4be3-b388-17dcb4d7d8b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70599c78608943bd824a5cb8df7c5408'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:26.142751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1130/2306] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:25 2022] DELETE /identity/v3/users/70599c78608943bd824a5cb8df7c5408 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:26.637241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:26.639909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:26.662597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcbd06-e895-4717-8223-715ce0afa093 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:26.810358 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:26.811747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:26.812653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:26.813227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] PATH_INFO: `/v3/projects/1a59eb0645964c9e94c715804be0f86f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:26.815610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a59eb0645964c9e94c715804be0f86f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:26.819292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:26.839677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74204a79-dbb5-4be3-b388-17dcb4d7d8b1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:26.841561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-74204a79-dbb5-4be3-b388-17dcb4d7d8b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:26.878769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74204a79-dbb5-4be3-b388-17dcb4d7d8b1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:26.886309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:26.888605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:26.889342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:26.889845 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] PATH_INFO: `/v3/projects/a71169771f5846c7b190a673bb9e394d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:26.892209 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71169771f5846c7b190a673bb9e394d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:26.894510 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:26.905308 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a59eb0645964c9e94c715804be0f86f', 'request_id': 'req-afc77afd-720d-469e-afed-b847d31a63fd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:26.914927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a59eb0645964c9e94c715804be0f86f', 'request_id': 'req-afc77afd-720d-469e-afed-b847d31a63fd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:26.924214 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a59eb0645964c9e94c715804be0f86f', 'request_id': 'req-afc77afd-720d-469e-afed-b847d31a63fd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:26.946031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] The token cache is being invalidate because project 1a59eb0645964c9e94c715804be0f86f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:26.946336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:26.947230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:26.949298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1177/2307] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:26 2022] DELETE /identity/v3/projects/1a59eb0645964c9e94c715804be0f86f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:26.954391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:26.959127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:26.975416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71169771f5846c7b190a673bb9e394d', 'request_id': 'req-346943a8-d888-4c41-bd4d-0f0a7c6532a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:26.989906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71169771f5846c7b190a673bb9e394d', 'request_id': 'req-346943a8-d888-4c41-bd4d-0f0a7c6532a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.002795 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71169771f5846c7b190a673bb9e394d', 'request_id': 'req-346943a8-d888-4c41-bd4d-0f0a7c6532a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.025746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] The token cache is being invalidate because project a71169771f5846c7b190a673bb9e394d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:27.026075 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.029275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.033870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1131/2308] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:26 2022] DELETE /identity/v3/projects/a71169771f5846c7b190a673bb9e394d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:27.039237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:27.042145 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:27.058914 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:27.065959 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc77afd-720d-469e-afed-b847d31a63fd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:27.173286 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4e9d7-ead6-4327-b5b2-77eb67623234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:27.174095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e9d7-ead6-4327-b5b2-77eb67623234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:27.174385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e9d7-ead6-4327-b5b2-77eb67623234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:27.174666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e9d7-ead6-4327-b5b2-77eb67623234 admin admin] PATH_INFO: `/v3/users/a80ea09fb5fb42ccb1cab4bf6ba2c45b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:27.187181 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4e9d7-ead6-4327-b5b2-77eb67623234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a80ea09fb5fb42ccb1cab4bf6ba2c45b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:27.189749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4e9d7-ead6-4327-b5b2-77eb67623234 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:27.198759 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346943a8-d888-4c41-bd4d-0f0a7c6532a7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:27.208125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6217ab-1464-49e3-a72b-0bf4dd588595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:27.209448 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6217ab-1464-49e3-a72b-0bf4dd588595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:27.209742 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6217ab-1464-49e3-a72b-0bf4dd588595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:27.210499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6217ab-1464-49e3-a72b-0bf4dd588595 admin admin] PATH_INFO: `/v3/users/c16233aa24cb463e85d9371f69c4a189` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:27.211769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6217ab-1464-49e3-a72b-0bf4dd588595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16233aa24cb463e85d9371f69c4a189)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:27.215245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6217ab-1464-49e3-a72b-0bf4dd588595 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:27.219827 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:27.283391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-83b4e9d7-ead6-4327-b5b2-77eb67623234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a80ea09fb5fb42ccb1cab4bf6ba2c45b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.298925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-83b4e9d7-ead6-4327-b5b2-77eb67623234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a80ea09fb5fb42ccb1cab4bf6ba2c45b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.324675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-83b4e9d7-ead6-4327-b5b2-77eb67623234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a80ea09fb5fb42ccb1cab4bf6ba2c45b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.326217 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-83b4e9d7-ead6-4327-b5b2-77eb67623234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a80ea09fb5fb42ccb1cab4bf6ba2c45b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.347029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4e6217ab-1464-49e3-a72b-0bf4dd588595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16233aa24cb463e85d9371f69c4a189'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.359021 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-83b4e9d7-ead6-4327-b5b2-77eb67623234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a80ea09fb5fb42ccb1cab4bf6ba2c45b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.370553 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1178/2309] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:26 2022] DELETE /identity/v3/users/a80ea09fb5fb42ccb1cab4bf6ba2c45b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:27.377382 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4e6217ab-1464-49e3-a72b-0bf4dd588595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16233aa24cb463e85d9371f69c4a189'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.378001 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4e6217ab-1464-49e3-a72b-0bf4dd588595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16233aa24cb463e85d9371f69c4a189'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.399736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4e6217ab-1464-49e3-a72b-0bf4dd588595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16233aa24cb463e85d9371f69c4a189'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.402908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4e6217ab-1464-49e3-a72b-0bf4dd588595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16233aa24cb463e85d9371f69c4a189'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.443465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1132/2310] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:27 2022] DELETE /identity/v3/users/c16233aa24cb463e85d9371f69c4a189 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:27.534465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4e9d7-ead6-4327-b5b2-77eb67623234 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:27.536893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-83b4e9d7-ead6-4327-b5b2-77eb67623234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:27.646026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4e9d7-ead6-4327-b5b2-77eb67623234 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:27.691901 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:27.801058 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fdf28-3402-43de-9059-5e427f0f92d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:27.801961 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fdf28-3402-43de-9059-5e427f0f92d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:27.802252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fdf28-3402-43de-9059-5e427f0f92d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:27.802538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fdf28-3402-43de-9059-5e427f0f92d9 admin admin] PATH_INFO: `/v3/users/f73179930a094171b5284c3de035ab9a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:27.803842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fdf28-3402-43de-9059-5e427f0f92d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f73179930a094171b5284c3de035ab9a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:27.805889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fdf28-3402-43de-9059-5e427f0f92d9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:27.878459 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3c1fdf28-3402-43de-9059-5e427f0f92d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f73179930a094171b5284c3de035ab9a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.896992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3c1fdf28-3402-43de-9059-5e427f0f92d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f73179930a094171b5284c3de035ab9a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.909925 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3c1fdf28-3402-43de-9059-5e427f0f92d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f73179930a094171b5284c3de035ab9a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.912318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3c1fdf28-3402-43de-9059-5e427f0f92d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f73179930a094171b5284c3de035ab9a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.940738 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3c1fdf28-3402-43de-9059-5e427f0f92d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f73179930a094171b5284c3de035ab9a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:27.952068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1179/2311] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:27 2022] DELETE /identity/v3/users/f73179930a094171b5284c3de035ab9a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:27.954153 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65050240-cc1e-4759-8975-55049ec3ed9e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:27.954713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65050240-cc1e-4759-8975-55049ec3ed9e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:27.954819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65050240-cc1e-4759-8975-55049ec3ed9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:27.985921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-65050240-cc1e-4759-8975-55049ec3ed9e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:27.987599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-65050240-cc1e-4759-8975-55049ec3ed9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:28.066690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fdf28-3402-43de-9059-5e427f0f92d9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:28.068344 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3c1fdf28-3402-43de-9059-5e427f0f92d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:28.132422 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1133/2312] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:28.143106 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65050240-cc1e-4759-8975-55049ec3ed9e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:28.144894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-65050240-cc1e-4759-8975-55049ec3ed9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:28.175958 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fdf28-3402-43de-9059-5e427f0f92d9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:28.192881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:28.193992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:28.194274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:28.194545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0 admin admin] PATH_INFO: `/v3/projects/1f988cfba8a14d578196ace4cdb25b09` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:28.195765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f988cfba8a14d578196ace4cdb25b09)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:28.197734 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:28.270153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f988cfba8a14d578196ace4cdb25b09', 'request_id': 'req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:28.272413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:28.278924 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f988cfba8a14d578196ace4cdb25b09', 'request_id': 'req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:28.292130 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f988cfba8a14d578196ace4cdb25b09', 'request_id': 'req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:28.301164 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65050240-cc1e-4759-8975-55049ec3ed9e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:28.316729 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0 admin admin] The token cache is being invalidate because project 1f988cfba8a14d578196ace4cdb25b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:28.317022 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:28.320679 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c6ac7e98-aeb4-489b-9c98-2e716733ecf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:28.336422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1180/2313] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:28 2022] DELETE /identity/v3/projects/1f988cfba8a14d578196ace4cdb25b09 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:28.364769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:28.397134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc98fb7-54e0-4da8-b1d5-2fafcde57872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:28.398014 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc98fb7-54e0-4da8-b1d5-2fafcde57872 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:28.398404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc98fb7-54e0-4da8-b1d5-2fafcde57872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:28.398789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc98fb7-54e0-4da8-b1d5-2fafcde57872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:28.404269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0bc98fb7-54e0-4da8-b1d5-2fafcde57872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:28.498170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b2178-c0f5-4dac-8645-0fff58d5a2f3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:28.498459 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b2178-c0f5-4dac-8645-0fff58d5a2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:28.498745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b2178-c0f5-4dac-8645-0fff58d5a2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:28.605208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc98fb7-54e0-4da8-b1d5-2fafcde57872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:28.608427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc98fb7-54e0-4da8-b1d5-2fafcde57872 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:28.624054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1134/2314] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:38:28.629090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-eb9b2178-c0f5-4dac-8645-0fff58d5a2f3 None None] MFA Rules not processed for user `75d12a685d9b419fa3606b5f4d1309fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:28.630351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-eb9b2178-c0f5-4dac-8645-0fff58d5a2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:28.739043 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1181/2315] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:28.939499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc98fb7-54e0-4da8-b1d5-2fafcde57872 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:28.941528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0bc98fb7-54e0-4da8-b1d5-2fafcde57872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:29.042480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc98fb7-54e0-4da8-b1d5-2fafcde57872 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:29.058409 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ad8df-f97a-419b-ac58-19b7a990ccf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:29.059082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ad8df-f97a-419b-ac58-19b7a990ccf5 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.059364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ad8df-f97a-419b-ac58-19b7a990ccf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.059647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ad8df-f97a-419b-ac58-19b7a990ccf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.081004 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ad8df-f97a-419b-ac58-19b7a990ccf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:29.082762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ad8df-f97a-419b-ac58-19b7a990ccf5 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:29.094598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1135/2316] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:29.149851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b2178-c0f5-4dac-8645-0fff58d5a2f3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:29.151491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-eb9b2178-c0f5-4dac-8645-0fff58d5a2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:29.179741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b2178-c0f5-4dac-8645-0fff58d5a2f3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:29.192733 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:29.193630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.193916 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.194193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] PATH_INFO: `/v3/projects/f104b021b5724d0db1ba7b7e6cf76663` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.197450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f104b021b5724d0db1ba7b7e6cf76663)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:29.200927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:29.327069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f104b021b5724d0db1ba7b7e6cf76663', 'request_id': 'req-cb0d5311-27c2-48e2-a335-3dd078ff7bee'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:29.341548 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f104b021b5724d0db1ba7b7e6cf76663', 'request_id': 'req-cb0d5311-27c2-48e2-a335-3dd078ff7bee'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:29.361475 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f104b021b5724d0db1ba7b7e6cf76663', 'request_id': 'req-cb0d5311-27c2-48e2-a335-3dd078ff7bee'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:29.380037 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] The token cache is being invalidate because project f104b021b5724d0db1ba7b7e6cf76663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:29.380533 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:29.381347 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:29.384351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1182/2317] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:29 2022] DELETE /identity/v3/projects/f104b021b5724d0db1ba7b7e6cf76663 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:29.390902 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dd705-3edf-450f-a589-12c86b0d4597 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.391315 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dd705-3edf-450f-a589-12c86b0d4597 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.391755 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dd705-3edf-450f-a589-12c86b0d4597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.414092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b27dd705-3edf-450f-a589-12c86b0d4597 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:29.415318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b27dd705-3edf-450f-a589-12c86b0d4597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:29.499251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:29.501157 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:29.517489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1136/2318] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:29.519860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5ba56-1fa5-4135-a553-d7d2f53cce21 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.520424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5ba56-1fa5-4135-a553-d7d2f53cce21 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.520755 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5ba56-1fa5-4135-a553-d7d2f53cce21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.550845 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cbb5ba56-1fa5-4135-a553-d7d2f53cce21 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:29.552861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cbb5ba56-1fa5-4135-a553-d7d2f53cce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:29.564188 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1137/2319] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:29.568908 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5ba56-1fa5-4135-a553-d7d2f53cce21 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:29.582104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5ba56-1fa5-4135-a553-d7d2f53cce21 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:29.588646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f21096-b18d-4641-b02c-9158290a6d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:29.589591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f21096-b18d-4641-b02c-9158290a6d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.590378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f21096-b18d-4641-b02c-9158290a6d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.590556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f21096-b18d-4641-b02c-9158290a6d1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.591302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f21096-b18d-4641-b02c-9158290a6d1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:29.591771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f21096-b18d-4641-b02c-9158290a6d1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:29.594821 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f21096-b18d-4641-b02c-9158290a6d1a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:29.597013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:29.597343 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:29.612809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1138/2320] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:29.619255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d5311-27c2-48e2-a335-3dd078ff7bee admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:29.621869 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f21096-b18d-4641-b02c-9158290a6d1a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:29.629407 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:29.630286 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.630658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.630935 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] PATH_INFO: `/v3/projects/e017ca1f397549f3adf925ce07b0d241` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.633113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f21096-b18d-4641-b02c-9158290a6d1a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:29.633312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e017ca1f397549f3adf925ce07b0d241)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:29.635163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:29.638937 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a3fb6-f653-4977-8913-2e409add0800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:29.639671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a3fb6-f653-4977-8913-2e409add0800 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.640142 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a3fb6-f653-4977-8913-2e409add0800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.641131 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a3fb6-f653-4977-8913-2e409add0800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.641907 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a3fb6-f653-4977-8913-2e409add0800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:29.645761 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a3fb6-f653-4977-8913-2e409add0800 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:29.681360 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1139/2321] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:29 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:29.685506 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a3fb6-f653-4977-8913-2e409add0800 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:29.703604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e017ca1f397549f3adf925ce07b0d241', 'request_id': 'req-440b241b-d761-4568-aa9b-3d750df8776e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:29.710187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e017ca1f397549f3adf925ce07b0d241', 'request_id': 'req-440b241b-d761-4568-aa9b-3d750df8776e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:29.724243 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e017ca1f397549f3adf925ce07b0d241', 'request_id': 'req-440b241b-d761-4568-aa9b-3d750df8776e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:29.742303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] The token cache is being invalidate because project e017ca1f397549f3adf925ce07b0d241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:29.742927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:29.743360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:29.748775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1183/2322] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:29 2022] DELETE /identity/v3/projects/e017ca1f397549f3adf925ce07b0d241 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:38:29.750595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:29.752318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:29.764122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a3fb6-f653-4977-8913-2e409add0800 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:29.858205 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625d623-af4f-4f84-96d6-0ee15107584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:29.859740 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625d623-af4f-4f84-96d6-0ee15107584b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.860339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625d623-af4f-4f84-96d6-0ee15107584b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.860818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625d623-af4f-4f84-96d6-0ee15107584b admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.862309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625d623-af4f-4f84-96d6-0ee15107584b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:29.864817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625d623-af4f-4f84-96d6-0ee15107584b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:29.877567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b241b-d761-4568-aa9b-3d750df8776e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:29.884054 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8825b-d0b6-46fa-8df2-f54110205857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:29.885244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8825b-d0b6-46fa-8df2-f54110205857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.885544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8825b-d0b6-46fa-8df2-f54110205857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.885940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8825b-d0b6-46fa-8df2-f54110205857 admin admin] PATH_INFO: `/v3/users/1ddd33d346e54e4f85a3fd24b299fda1` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.887416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8825b-d0b6-46fa-8df2-f54110205857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ddd33d346e54e4f85a3fd24b299fda1)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:29.889954 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8825b-d0b6-46fa-8df2-f54110205857 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:29.896866 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1140/2323] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:29 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:29.900666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625d623-af4f-4f84-96d6-0ee15107584b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:29.903088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a625d623-af4f-4f84-96d6-0ee15107584b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:29.922963 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625d623-af4f-4f84-96d6-0ee15107584b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:29.929384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa324499-2428-4edc-918a-5a759dcd09e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:29.930609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa324499-2428-4edc-918a-5a759dcd09e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.930903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa324499-2428-4edc-918a-5a759dcd09e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.931504 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa324499-2428-4edc-918a-5a759dcd09e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.932171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa324499-2428-4edc-918a-5a759dcd09e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:29.934225 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa324499-2428-4edc-918a-5a759dcd09e2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:29.951666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1141/2324] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:29.955836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa324499-2428-4edc-918a-5a759dcd09e2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:29.970691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa324499-2428-4edc-918a-5a759dcd09e2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:29.976967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117cd23-178d-4400-81ba-457463afa9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:29.977729 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117cd23-178d-4400-81ba-457463afa9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:29.978019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117cd23-178d-4400-81ba-457463afa9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:29.978300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117cd23-178d-4400-81ba-457463afa9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:29.979506 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117cd23-178d-4400-81ba-457463afa9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:29.981588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117cd23-178d-4400-81ba-457463afa9a6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:30.003126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1142/2325] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:38:30.004444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117cd23-178d-4400-81ba-457463afa9a6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:30.017085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-69a8825b-d0b6-46fa-8df2-f54110205857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ddd33d346e54e4f85a3fd24b299fda1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:30.019713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117cd23-178d-4400-81ba-457463afa9a6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:30.027422 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b72ed-717a-4a1b-ab14-a46ee7264d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:30.029086 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b72ed-717a-4a1b-ab14-a46ee7264d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:30.029594 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b72ed-717a-4a1b-ab14-a46ee7264d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:30.029883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b72ed-717a-4a1b-ab14-a46ee7264d2e admin admin] PATH_INFO: `/v3/projects/a4973f3528a645f98edc1617536b2e51/users/1d9e0676e77243b189acb4afcef7d036/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:30.041132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-69a8825b-d0b6-46fa-8df2-f54110205857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ddd33d346e54e4f85a3fd24b299fda1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:30.054327 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b72ed-717a-4a1b-ab14-a46ee7264d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4973f3528a645f98edc1617536b2e51, user_id=1d9e0676e77243b189acb4afcef7d036, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:30.058607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b72ed-717a-4a1b-ab14-a46ee7264d2e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:30.059921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-69a8825b-d0b6-46fa-8df2-f54110205857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ddd33d346e54e4f85a3fd24b299fda1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:30.060817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-69a8825b-d0b6-46fa-8df2-f54110205857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ddd33d346e54e4f85a3fd24b299fda1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:30.098764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-69a8825b-d0b6-46fa-8df2-f54110205857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ddd33d346e54e4f85a3fd24b299fda1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:30.103484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:30.112911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1184/2326] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:29 2022] DELETE /identity/v3/users/1ddd33d346e54e4f85a3fd24b299fda1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:38:30.136556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1143/2327] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:30 2022] PUT /identity/v3/projects/a4973f3528a645f98edc1617536b2e51/users/1d9e0676e77243b189acb4afcef7d036/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:30.150269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93030120-3c48-4b47-97e5-d3157f409688 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:30.150681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93030120-3c48-4b47-97e5-d3157f409688 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:30.151074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93030120-3c48-4b47-97e5-d3157f409688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:30.230290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-93030120-3c48-4b47-97e5-d3157f409688 None None] MFA Rules not processed for user `1d9e0676e77243b189acb4afcef7d036`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:30.232111 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-93030120-3c48-4b47-97e5-d3157f409688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:30.239324 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47dae3-fa3e-4f59-8426-c04b8a3efe81 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:30.239838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47dae3-fa3e-4f59-8426-c04b8a3efe81 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:30.240269 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47dae3-fa3e-4f59-8426-c04b8a3efe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:30.304209 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2e47dae3-fa3e-4f59-8426-c04b8a3efe81 None None] MFA Rules not processed for user `932ad1f03da24593a6ad444f6cb95e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:30.309067 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2e47dae3-fa3e-4f59-8426-c04b8a3efe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:30.386055 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:30.459640 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1185/2328] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:30.464762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93030120-3c48-4b47-97e5-d3157f409688 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:30.468087 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-93030120-3c48-4b47-97e5-d3157f409688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:30.487857 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1144/2329] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:30.613655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93030120-3c48-4b47-97e5-d3157f409688 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:30.620370 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8125ce-cac7-4d17-9b60-653801343961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:30.621483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8125ce-cac7-4d17-9b60-653801343961 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:30.621912 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8125ce-cac7-4d17-9b60-653801343961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:30.622477 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8125ce-cac7-4d17-9b60-653801343961 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:30.624229 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8125ce-cac7-4d17-9b60-653801343961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:30.627437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8125ce-cac7-4d17-9b60-653801343961 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:30.677431 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1186/2330] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:30 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:30.681268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47dae3-fa3e-4f59-8426-c04b8a3efe81 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:30.694559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47dae3-fa3e-4f59-8426-c04b8a3efe81 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:30.764587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845f514-df18-4453-9edf-9cc7193f094f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:30.766211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f514-df18-4453-9edf-9cc7193f094f admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:30.766379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f514-df18-4453-9edf-9cc7193f094f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:30.766806 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f514-df18-4453-9edf-9cc7193f094f admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:30.767588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845f514-df18-4453-9edf-9cc7193f094f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:30.769626 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845f514-df18-4453-9edf-9cc7193f094f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:30.795441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1145/2331] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:30 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:30.799449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8125ce-cac7-4d17-9b60-653801343961 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:30.811426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8125ce-cac7-4d17-9b60-653801343961 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:30.817399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8759b-235d-400e-9a2b-2c61549fd210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:30.818222 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8759b-235d-400e-9a2b-2c61549fd210 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:30.818527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8759b-235d-400e-9a2b-2c61549fd210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:30.818801 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8759b-235d-400e-9a2b-2c61549fd210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:30.820133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8759b-235d-400e-9a2b-2c61549fd210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:30.821410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8759b-235d-400e-9a2b-2c61549fd210 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:30.835215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1187/2332] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:30.839550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845f514-df18-4453-9edf-9cc7193f094f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:30.851663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845f514-df18-4453-9edf-9cc7193f094f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:30.856597 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1124da-7f5f-4e6d-8c7c-bac7bfbc8971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:30.857598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1124da-7f5f-4e6d-8c7c-bac7bfbc8971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:30.857949 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1124da-7f5f-4e6d-8c7c-bac7bfbc8971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:30.858417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1124da-7f5f-4e6d-8c7c-bac7bfbc8971 admin admin] PATH_INFO: `/v3/projects/b3ba08a6c87e4f74ad6dc4451b894bfd/users/6f559e495b9d4323bb32dd28eabea097/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:30.875431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1124da-7f5f-4e6d-8c7c-bac7bfbc8971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ba08a6c87e4f74ad6dc4451b894bfd, user_id=6f559e495b9d4323bb32dd28eabea097, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:30.878352 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1124da-7f5f-4e6d-8c7c-bac7bfbc8971 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:30.896331 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1146/2333] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:30 2022] PUT /identity/v3/projects/b3ba08a6c87e4f74ad6dc4451b894bfd/users/6f559e495b9d4323bb32dd28eabea097/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:38:30.900655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8759b-235d-400e-9a2b-2c61549fd210 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:30.912761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8759b-235d-400e-9a2b-2c61549fd210 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:30.978494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6b6a5-8cd7-4c3c-a709-08e146df4f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:30.979237 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6b6a5-8cd7-4c3c-a709-08e146df4f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:30.979537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6b6a5-8cd7-4c3c-a709-08e146df4f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:30.979819 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6b6a5-8cd7-4c3c-a709-08e146df4f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:30.980587 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6b6a5-8cd7-4c3c-a709-08e146df4f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:30.985155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6b6a5-8cd7-4c3c-a709-08e146df4f14 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:30.997794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:31.000158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1188/2334] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:31.004875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1124da-7f5f-4e6d-8c7c-bac7bfbc8971 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:31.037676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1124da-7f5f-4e6d-8c7c-bac7bfbc8971 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:31.047019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f4ec9-63c7-4cba-8e3a-97911333071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:31.049294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f4ec9-63c7-4cba-8e3a-97911333071e admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:31.049294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f4ec9-63c7-4cba-8e3a-97911333071e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:31.049294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f4ec9-63c7-4cba-8e3a-97911333071e admin admin] PATH_INFO: `/v3/projects/b3ba08a6c87e4f74ad6dc4451b894bfd/users/6f559e495b9d4323bb32dd28eabea097/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:31.056123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f4ec9-63c7-4cba-8e3a-97911333071e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ba08a6c87e4f74ad6dc4451b894bfd, user_id=6f559e495b9d4323bb32dd28eabea097, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:31.060592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f4ec9-63c7-4cba-8e3a-97911333071e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:31.089643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1147/2335] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:31 2022] PUT /identity/v3/projects/b3ba08a6c87e4f74ad6dc4451b894bfd/users/6f559e495b9d4323bb32dd28eabea097/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:31.095287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a7ab1-0336-434f-83f5-bc2be3f74ea3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:31.095856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a7ab1-0336-434f-83f5-bc2be3f74ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:31.096334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a7ab1-0336-434f-83f5-bc2be3f74ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:31.188090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2b7a7ab1-0336-434f-83f5-bc2be3f74ea3 None None] MFA Rules not processed for user `6f559e495b9d4323bb32dd28eabea097`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:31.192749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2b7a7ab1-0336-434f-83f5-bc2be3f74ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:31.313953 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f4ec9-63c7-4cba-8e3a-97911333071e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:31.315979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d88f4ec9-63c7-4cba-8e3a-97911333071e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:31.408215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1189/2336] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:31.424513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a7ab1-0336-434f-83f5-bc2be3f74ea3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:31.428306 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2b7a7ab1-0336-434f-83f5-bc2be3f74ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:31.485776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f4ec9-63c7-4cba-8e3a-97911333071e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:31.502849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:31.503663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:31.503945 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:31.504223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] PATH_INFO: `/v3/projects/09d97a052b0841a494decd1fbeff172b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:31.505498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d97a052b0841a494decd1fbeff172b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:31.507474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:31.535307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a7ab1-0336-434f-83f5-bc2be3f74ea3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:31.540224 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7f5cb-7eaa-4ed5-953e-9c1ba283486f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:31.540930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7f5cb-7eaa-4ed5-953e-9c1ba283486f service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:31.542131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7f5cb-7eaa-4ed5-953e-9c1ba283486f service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:31.542425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7f5cb-7eaa-4ed5-953e-9c1ba283486f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:31.555235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7f5cb-7eaa-4ed5-953e-9c1ba283486f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:31.557969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7f5cb-7eaa-4ed5-953e-9c1ba283486f service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:31.563247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:31.589278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1190/2337] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:38:31.665917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d97a052b0841a494decd1fbeff172b', 'request_id': 'req-70a2c1cb-2def-473a-9235-dd469a5286aa'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:31.686160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d97a052b0841a494decd1fbeff172b', 'request_id': 'req-70a2c1cb-2def-473a-9235-dd469a5286aa'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:31.708471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d97a052b0841a494decd1fbeff172b', 'request_id': 'req-70a2c1cb-2def-473a-9235-dd469a5286aa'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:31.738625 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] The token cache is being invalidate because project 09d97a052b0841a494decd1fbeff172b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:31.738926 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:31.741639 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:31.748107 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1148/2338] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:31 2022] DELETE /identity/v3/projects/09d97a052b0841a494decd1fbeff172b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:31.752938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7f5cb-7eaa-4ed5-953e-9c1ba283486f service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:31.778100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7f5cb-7eaa-4ed5-953e-9c1ba283486f service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:31.958753 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a1178-bee6-4548-b924-99e5d8bfaa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:31.964838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1178-bee6-4548-b924-99e5d8bfaa28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:31.965171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1178-bee6-4548-b924-99e5d8bfaa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:31.967747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1178-bee6-4548-b924-99e5d8bfaa28 admin admin] PATH_INFO: `/v3/users/c3db5e1b0a704199a1cc803bbcc09a4a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:31.981762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a1178-bee6-4548-b924-99e5d8bfaa28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3db5e1b0a704199a1cc803bbcc09a4a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:31.987312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a1178-bee6-4548-b924-99e5d8bfaa28 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:32.072135 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:32.100643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8f7a1178-bee6-4548-b924-99e5d8bfaa28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3db5e1b0a704199a1cc803bbcc09a4a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:32.130033 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8f7a1178-bee6-4548-b924-99e5d8bfaa28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3db5e1b0a704199a1cc803bbcc09a4a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:32.166537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8f7a1178-bee6-4548-b924-99e5d8bfaa28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3db5e1b0a704199a1cc803bbcc09a4a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:32.167899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8f7a1178-bee6-4548-b924-99e5d8bfaa28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3db5e1b0a704199a1cc803bbcc09a4a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:32.215777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8f7a1178-bee6-4548-b924-99e5d8bfaa28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3db5e1b0a704199a1cc803bbcc09a4a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:32.237007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1191/2339] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:31 2022] DELETE /identity/v3/users/c3db5e1b0a704199a1cc803bbcc09a4a => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:32.736829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:32.739405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:32.767834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2c1cb-2def-473a-9235-dd469a5286aa admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:32.899771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082c3e4-034b-4365-8c36-0e2b2d4c9948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:32.901168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082c3e4-034b-4365-8c36-0e2b2d4c9948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:32.901741 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082c3e4-034b-4365-8c36-0e2b2d4c9948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:32.902152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082c3e4-034b-4365-8c36-0e2b2d4c9948 admin admin] PATH_INFO: `/v3/users/1d9e0676e77243b189acb4afcef7d036` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:32.903606 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082c3e4-034b-4365-8c36-0e2b2d4c9948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9e0676e77243b189acb4afcef7d036)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:32.906633 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082c3e4-034b-4365-8c36-0e2b2d4c9948 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:33.025444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4082c3e4-034b-4365-8c36-0e2b2d4c9948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9e0676e77243b189acb4afcef7d036'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:33.066450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4082c3e4-034b-4365-8c36-0e2b2d4c9948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9e0676e77243b189acb4afcef7d036'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:33.068802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4082c3e4-034b-4365-8c36-0e2b2d4c9948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9e0676e77243b189acb4afcef7d036'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:33.091258 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4082c3e4-034b-4365-8c36-0e2b2d4c9948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9e0676e77243b189acb4afcef7d036'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:33.095410 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4082c3e4-034b-4365-8c36-0e2b2d4c9948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9e0676e77243b189acb4afcef7d036'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:33.124635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1149/2340] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:32 2022] DELETE /identity/v3/users/1d9e0676e77243b189acb4afcef7d036 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:33.130124 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522156e9-ac79-4fdd-adae-c4b2f8e77cd7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:33.130740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522156e9-ac79-4fdd-adae-c4b2f8e77cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:33.130740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522156e9-ac79-4fdd-adae-c4b2f8e77cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:33.176215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2be7d-db1d-4413-b9be-16d3fa8a3573 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:33.176483 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2be7d-db1d-4413-b9be-16d3fa8a3573 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:33.176799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2be7d-db1d-4413-b9be-16d3fa8a3573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:33.179474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-522156e9-ac79-4fdd-adae-c4b2f8e77cd7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:33.180834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-522156e9-ac79-4fdd-adae-c4b2f8e77cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:33.214159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b1f2be7d-db1d-4413-b9be-16d3fa8a3573 None None] MFA Rules not processed for user `75d12a685d9b419fa3606b5f4d1309fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:33.215440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b1f2be7d-db1d-4413-b9be-16d3fa8a3573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:33.251323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:33.279997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1192/2341] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:33.292120 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522156e9-ac79-4fdd-adae-c4b2f8e77cd7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:33.293895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-522156e9-ac79-4fdd-adae-c4b2f8e77cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:33.344706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1150/2342] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:33.388716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2be7d-db1d-4413-b9be-16d3fa8a3573 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:33.392999 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b1f2be7d-db1d-4413-b9be-16d3fa8a3573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:33.423371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522156e9-ac79-4fdd-adae-c4b2f8e77cd7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:33.431379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9b241-4fca-4d5b-b783-8d5e315e1529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:33.432051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9b241-4fca-4d5b-b783-8d5e315e1529 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:33.432332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9b241-4fca-4d5b-b783-8d5e315e1529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:33.432637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9b241-4fca-4d5b-b783-8d5e315e1529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:33.456926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9b241-4fca-4d5b-b783-8d5e315e1529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:33.458438 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9b241-4fca-4d5b-b783-8d5e315e1529 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:33.463793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2be7d-db1d-4413-b9be-16d3fa8a3573 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:33.471782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473489a-2481-4165-80cf-e8cd6547056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:33.472745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473489a-2481-4165-80cf-e8cd6547056d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:33.473456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473489a-2481-4165-80cf-e8cd6547056d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:33.473456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473489a-2481-4165-80cf-e8cd6547056d admin admin] PATH_INFO: `/v3/projects/073a86e1430b438687b281748953e46b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:33.475087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473489a-2481-4165-80cf-e8cd6547056d admin admin] RBAC: Authorizing `identity:delete_project(project_id=073a86e1430b438687b281748953e46b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:33.486603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1193/2343] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:38:33.507501 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473489a-2481-4165-80cf-e8cd6547056d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:33.573629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c473489a-2481-4165-80cf-e8cd6547056d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073a86e1430b438687b281748953e46b', 'request_id': 'req-c473489a-2481-4165-80cf-e8cd6547056d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:33.585250 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c473489a-2481-4165-80cf-e8cd6547056d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073a86e1430b438687b281748953e46b', 'request_id': 'req-c473489a-2481-4165-80cf-e8cd6547056d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:33.595415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c473489a-2481-4165-80cf-e8cd6547056d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073a86e1430b438687b281748953e46b', 'request_id': 'req-c473489a-2481-4165-80cf-e8cd6547056d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:33.609401 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c473489a-2481-4165-80cf-e8cd6547056d admin admin] The token cache is being invalidate because project 073a86e1430b438687b281748953e46b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:33.609848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c473489a-2481-4165-80cf-e8cd6547056d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:33.610674 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c473489a-2481-4165-80cf-e8cd6547056d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:33.612966 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1151/2344] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:33 2022] DELETE /identity/v3/projects/073a86e1430b438687b281748953e46b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:33.618731 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006e31e-0834-4334-aad9-c49941d7218b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:33.619120 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006e31e-0834-4334-aad9-c49941d7218b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:33.619471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006e31e-0834-4334-aad9-c49941d7218b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:33.641596 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9006e31e-0834-4334-aad9-c49941d7218b None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:33.643084 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9006e31e-0834-4334-aad9-c49941d7218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:33.699569 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:33.720340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1194/2345] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:33.728657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914a3bc-70b5-4e0b-baff-6e7885762cd6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:33.729101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914a3bc-70b5-4e0b-baff-6e7885762cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:33.729618 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914a3bc-70b5-4e0b-baff-6e7885762cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:33.753853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2914a3bc-70b5-4e0b-baff-6e7885762cd6 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:33.755074 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2914a3bc-70b5-4e0b-baff-6e7885762cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:33.763118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1152/2346] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:33.767943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006e31e-0834-4334-aad9-c49941d7218b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:33.779561 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006e31e-0834-4334-aad9-c49941d7218b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:33.785503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68499a9a-ca86-4183-8300-a248769acaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:33.786206 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68499a9a-ca86-4183-8300-a248769acaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:33.786493 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68499a9a-ca86-4183-8300-a248769acaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:33.786774 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68499a9a-ca86-4183-8300-a248769acaf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:33.787511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68499a9a-ca86-4183-8300-a248769acaf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:33.787820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68499a9a-ca86-4183-8300-a248769acaf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:33.789631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68499a9a-ca86-4183-8300-a248769acaf9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:33.806897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1195/2347] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:33.807860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914a3bc-70b5-4e0b-baff-6e7885762cd6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:33.825188 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914a3bc-70b5-4e0b-baff-6e7885762cd6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:33.844793 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be223ed-820a-46ac-a6ea-ec9fb5330005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:33.845622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be223ed-820a-46ac-a6ea-ec9fb5330005 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:33.845791 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be223ed-820a-46ac-a6ea-ec9fb5330005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:33.846136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be223ed-820a-46ac-a6ea-ec9fb5330005 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:33.846836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be223ed-820a-46ac-a6ea-ec9fb5330005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:33.849077 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be223ed-820a-46ac-a6ea-ec9fb5330005 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:33.896745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1153/2348] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:33 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:33.898073 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68499a9a-ca86-4183-8300-a248769acaf9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:33.910721 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68499a9a-ca86-4183-8300-a248769acaf9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:34.034109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ff8e4-de22-4450-890b-d3bcd34e4e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:34.035017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ff8e4-de22-4450-890b-d3bcd34e4e75 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:34.035455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ff8e4-de22-4450-890b-d3bcd34e4e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:34.035906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ff8e4-de22-4450-890b-d3bcd34e4e75 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:34.036912 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ff8e4-de22-4450-890b-d3bcd34e4e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:34.039426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ff8e4-de22-4450-890b-d3bcd34e4e75 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:34.072322 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1196/2349] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:33 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:34.076691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be223ed-820a-46ac-a6ea-ec9fb5330005 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:34.089779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be223ed-820a-46ac-a6ea-ec9fb5330005 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:34.094779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ff8e4-de22-4450-890b-d3bcd34e4e75 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:34.096727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-632ff8e4-de22-4450-890b-d3bcd34e4e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:34.098045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a40f7-3cf7-47fe-b0f9-854d4f456086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:34.098752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a40f7-3cf7-47fe-b0f9-854d4f456086 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:34.099046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a40f7-3cf7-47fe-b0f9-854d4f456086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:34.099332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a40f7-3cf7-47fe-b0f9-854d4f456086 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:34.100261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a40f7-3cf7-47fe-b0f9-854d4f456086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:34.102357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a40f7-3cf7-47fe-b0f9-854d4f456086 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:34.115404 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ff8e4-de22-4450-890b-d3bcd34e4e75 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:34.119629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1154/2350] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:38:34.121229 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a40f7-3cf7-47fe-b0f9-854d4f456086 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:34.121729 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:34.122832 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:34.123184 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:34.123512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] PATH_INFO: `/v3/projects/a4973f3528a645f98edc1617536b2e51` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:34.124970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4973f3528a645f98edc1617536b2e51)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:34.127374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:34.133340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a40f7-3cf7-47fe-b0f9-854d4f456086 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:34.138977 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58bc26-14e4-45fb-9fa9-93daa19cfee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:34.139710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58bc26-14e4-45fb-9fa9-93daa19cfee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:34.139941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58bc26-14e4-45fb-9fa9-93daa19cfee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:34.148039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58bc26-14e4-45fb-9fa9-93daa19cfee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:34.148936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58bc26-14e4-45fb-9fa9-93daa19cfee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:34.154348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58bc26-14e4-45fb-9fa9-93daa19cfee8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:34.167463 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1155/2351] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:34.184510 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58bc26-14e4-45fb-9fa9-93daa19cfee8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:34.204817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4973f3528a645f98edc1617536b2e51', 'request_id': 'req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:34.206579 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58bc26-14e4-45fb-9fa9-93daa19cfee8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:34.214574 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4973f3528a645f98edc1617536b2e51', 'request_id': 'req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:34.223019 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4973f3528a645f98edc1617536b2e51', 'request_id': 'req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:34.247687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] The token cache is being invalidate because project a4973f3528a645f98edc1617536b2e51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:34.247996 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:34.249292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:34.253224 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1197/2352] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:34 2022] DELETE /identity/v3/projects/a4973f3528a645f98edc1617536b2e51 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:34.257949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:34.260017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:34.288569 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f50022-98ac-4ecc-99ce-20170f9141df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:34.289676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f50022-98ac-4ecc-99ce-20170f9141df admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:34.290053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f50022-98ac-4ecc-99ce-20170f9141df admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:34.290441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f50022-98ac-4ecc-99ce-20170f9141df admin admin] PATH_INFO: `/v3/projects/1650586a4ece4668a08189e9eb77fd62/users/3ae40494b53f4e70b9979d819e301f4a/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:34.305145 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:34.313661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f50022-98ac-4ecc-99ce-20170f9141df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1650586a4ece4668a08189e9eb77fd62, user_id=3ae40494b53f4e70b9979d819e301f4a, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:34.317375 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f50022-98ac-4ecc-99ce-20170f9141df admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:34.325230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:34.336785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1156/2353] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:34 2022] PUT /identity/v3/projects/1650586a4ece4668a08189e9eb77fd62/users/3ae40494b53f4e70b9979d819e301f4a/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:34.348344 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78209d-beb6-4409-a3fb-3f442a19be52 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:34.348677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78209d-beb6-4409-a3fb-3f442a19be52 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:34.348981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78209d-beb6-4409-a3fb-3f442a19be52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:34.349402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91948ad1-bd76-4db1-a8bc-3cb314f1b26d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:34.382714 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3f78209d-beb6-4409-a3fb-3f442a19be52 None None] MFA Rules not processed for user `3ae40494b53f4e70b9979d819e301f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:34.383845 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3f78209d-beb6-4409-a3fb-3f442a19be52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:34.421870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb62cd0-aa3d-4501-9af3-48d3f6d4e4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:34.422838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb62cd0-aa3d-4501-9af3-48d3f6d4e4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:34.423400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb62cd0-aa3d-4501-9af3-48d3f6d4e4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:34.423400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb62cd0-aa3d-4501-9af3-48d3f6d4e4cb admin admin] PATH_INFO: `/v3/users/6f559e495b9d4323bb32dd28eabea097` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:34.424643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb62cd0-aa3d-4501-9af3-48d3f6d4e4cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f559e495b9d4323bb32dd28eabea097)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:34.426584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb62cd0-aa3d-4501-9af3-48d3f6d4e4cb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:34.499092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1157/2354] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:34.503753 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3eb62cd0-aa3d-4501-9af3-48d3f6d4e4cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f559e495b9d4323bb32dd28eabea097'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:34.515645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78209d-beb6-4409-a3fb-3f442a19be52 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:34.517455 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3f78209d-beb6-4409-a3fb-3f442a19be52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:34.528524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3eb62cd0-aa3d-4501-9af3-48d3f6d4e4cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f559e495b9d4323bb32dd28eabea097'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:34.545204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3eb62cd0-aa3d-4501-9af3-48d3f6d4e4cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f559e495b9d4323bb32dd28eabea097'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:34.546228 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3eb62cd0-aa3d-4501-9af3-48d3f6d4e4cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f559e495b9d4323bb32dd28eabea097'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:34.566281 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3eb62cd0-aa3d-4501-9af3-48d3f6d4e4cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f559e495b9d4323bb32dd28eabea097'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:34.573956 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1198/2355] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:34 2022] DELETE /identity/v3/users/6f559e495b9d4323bb32dd28eabea097 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:34.691197 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78209d-beb6-4409-a3fb-3f442a19be52 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:34.838063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfa1bd-d850-4a39-960a-e5cc6292fc8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:34.839677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa1bd-d850-4a39-960a-e5cc6292fc8d service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:34.840074 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa1bd-d850-4a39-960a-e5cc6292fc8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:34.840492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa1bd-d850-4a39-960a-e5cc6292fc8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:34.844367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-85dfa1bd-d850-4a39-960a-e5cc6292fc8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:34.944145 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:35.005652 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfa1bd-d850-4a39-960a-e5cc6292fc8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:35.009710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfa1bd-d850-4a39-960a-e5cc6292fc8d service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:35.043155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1158/2356] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:38:35.085074 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb62cd0-aa3d-4501-9af3-48d3f6d4e4cb admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:35.086941 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3eb62cd0-aa3d-4501-9af3-48d3f6d4e4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:35.246148 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb62cd0-aa3d-4501-9af3-48d3f6d4e4cb admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:35.253996 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c01633-7d8b-4263-9e50-95c789774c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:35.257046 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c01633-7d8b-4263-9e50-95c789774c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:35.257581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c01633-7d8b-4263-9e50-95c789774c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:35.258561 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c01633-7d8b-4263-9e50-95c789774c5f admin admin] PATH_INFO: `/v3/users/3ae40494b53f4e70b9979d819e301f4a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:35.259993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c01633-7d8b-4263-9e50-95c789774c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae40494b53f4e70b9979d819e301f4a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:35.264287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c01633-7d8b-4263-9e50-95c789774c5f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:35.322531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:35.387031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-90c01633-7d8b-4263-9e50-95c789774c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae40494b53f4e70b9979d819e301f4a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:35.401639 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-90c01633-7d8b-4263-9e50-95c789774c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae40494b53f4e70b9979d819e301f4a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:35.430019 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-90c01633-7d8b-4263-9e50-95c789774c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae40494b53f4e70b9979d819e301f4a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:35.432025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-90c01633-7d8b-4263-9e50-95c789774c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae40494b53f4e70b9979d819e301f4a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:35.478970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-90c01633-7d8b-4263-9e50-95c789774c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae40494b53f4e70b9979d819e301f4a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:35.492110 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1199/2357] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:35 2022] DELETE /identity/v3/users/3ae40494b53f4e70b9979d819e301f4a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:35.496971 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62d11-664f-4be6-bac6-213df286826c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:35.497345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62d11-664f-4be6-bac6-213df286826c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:35.497696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62d11-664f-4be6-bac6-213df286826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:35.538426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-52f62d11-664f-4be6-bac6-213df286826c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:35.538426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-52f62d11-664f-4be6-bac6-213df286826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:35.595068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c01633-7d8b-4263-9e50-95c789774c5f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:35.603092 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-90c01633-7d8b-4263-9e50-95c789774c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:35.701921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1159/2358] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:35.712868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c01633-7d8b-4263-9e50-95c789774c5f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:35.718137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:35.718610 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f62d11-664f-4be6-bac6-213df286826c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:35.719042 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:35.719334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:35.719672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3 admin admin] PATH_INFO: `/v3/projects/b3ba08a6c87e4f74ad6dc4451b894bfd` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:35.720189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-52f62d11-664f-4be6-bac6-213df286826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:35.721711 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ba08a6c87e4f74ad6dc4451b894bfd)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:35.724323 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:35.788297 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ba08a6c87e4f74ad6dc4451b894bfd', 'request_id': 'req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:35.796983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ba08a6c87e4f74ad6dc4451b894bfd', 'request_id': 'req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:35.801942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f62d11-664f-4be6-bac6-213df286826c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:35.804747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ba08a6c87e4f74ad6dc4451b894bfd', 'request_id': 'req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:35.824435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3 admin admin] The token cache is being invalidate because project b3ba08a6c87e4f74ad6dc4451b894bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:35.824727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:35.825482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ab7a3721-7987-4bb4-a3c3-b9e2257a15f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:35.827641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1200/2359] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:35 2022] DELETE /identity/v3/projects/b3ba08a6c87e4f74ad6dc4451b894bfd => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:35.842189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324511cf-a3c0-4af7-93d2-b70ec7516742 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:35.842455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324511cf-a3c0-4af7-93d2-b70ec7516742 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:35.842697 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324511cf-a3c0-4af7-93d2-b70ec7516742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:35.865218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-324511cf-a3c0-4af7-93d2-b70ec7516742 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:35.867809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-324511cf-a3c0-4af7-93d2-b70ec7516742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:35.868896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa57a9-8518-4eb8-bd7a-e694d1290257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:35.869708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa57a9-8518-4eb8-bd7a-e694d1290257 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:35.870061 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa57a9-8518-4eb8-bd7a-e694d1290257 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:35.870352 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa57a9-8518-4eb8-bd7a-e694d1290257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:35.872515 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-befa57a9-8518-4eb8-bd7a-e694d1290257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:35.899714 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:35.950153 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:35.954589 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa57a9-8518-4eb8-bd7a-e694d1290257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:35.957012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa57a9-8518-4eb8-bd7a-e694d1290257 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:35.975664 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1201/2360] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:35.975832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1160/2361] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:38:35.977406 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299d8f-94cf-4b42-84ea-f36450545258 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:35.977687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299d8f-94cf-4b42-84ea-f36450545258 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:35.977967 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299d8f-94cf-4b42-84ea-f36450545258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:36.042393 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ff299d8f-94cf-4b42-84ea-f36450545258 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:36.048075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ff299d8f-94cf-4b42-84ea-f36450545258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:36.057852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1202/2362] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:36.062910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa57a9-8518-4eb8-bd7a-e694d1290257 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:36.076950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa57a9-8518-4eb8-bd7a-e694d1290257 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:36.087885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7308dc-a508-4add-a4d3-78558e8654eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:36.088915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7308dc-a508-4add-a4d3-78558e8654eb admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:36.089436 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7308dc-a508-4add-a4d3-78558e8654eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:36.089671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7308dc-a508-4add-a4d3-78558e8654eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:36.090474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7308dc-a508-4add-a4d3-78558e8654eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:36.090782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7308dc-a508-4add-a4d3-78558e8654eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:36.092655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7308dc-a508-4add-a4d3-78558e8654eb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:36.113915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1161/2363] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:36.115946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff299d8f-94cf-4b42-84ea-f36450545258 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:36.139059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff299d8f-94cf-4b42-84ea-f36450545258 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:36.144687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6476dff-45bd-4515-8474-7959cddbea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:36.145547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6476dff-45bd-4515-8474-7959cddbea03 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:36.145834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6476dff-45bd-4515-8474-7959cddbea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:36.146114 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6476dff-45bd-4515-8474-7959cddbea03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:36.146820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6476dff-45bd-4515-8474-7959cddbea03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:36.148818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6476dff-45bd-4515-8474-7959cddbea03 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:36.177826 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1203/2364] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:36 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:36.182398 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7308dc-a508-4add-a4d3-78558e8654eb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:36.193686 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7308dc-a508-4add-a4d3-78558e8654eb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:36.258148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88788ddd-da13-4a20-a2c5-8d6a794f63d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:36.258799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88788ddd-da13-4a20-a2c5-8d6a794f63d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:36.259078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88788ddd-da13-4a20-a2c5-8d6a794f63d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:36.259476 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88788ddd-da13-4a20-a2c5-8d6a794f63d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:36.260156 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88788ddd-da13-4a20-a2c5-8d6a794f63d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:36.262506 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88788ddd-da13-4a20-a2c5-8d6a794f63d2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:36.284485 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1162/2365] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:36 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:36.288611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6476dff-45bd-4515-8474-7959cddbea03 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:36.299444 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6476dff-45bd-4515-8474-7959cddbea03 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:36.304144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fdc34-cc0e-43c7-ac6c-7438cbeeb23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:36.304920 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fdc34-cc0e-43c7-ac6c-7438cbeeb23c admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:36.305212 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fdc34-cc0e-43c7-ac6c-7438cbeeb23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:36.305491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fdc34-cc0e-43c7-ac6c-7438cbeeb23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:36.306371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fdc34-cc0e-43c7-ac6c-7438cbeeb23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:36.307872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fdc34-cc0e-43c7-ac6c-7438cbeeb23c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:36.319328 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1204/2366] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:38:36.330566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88788ddd-da13-4a20-a2c5-8d6a794f63d2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:36.343484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88788ddd-da13-4a20-a2c5-8d6a794f63d2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:36.348976 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebbb04-fd37-460b-8ea8-1de7f2a83c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:36.349657 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebbb04-fd37-460b-8ea8-1de7f2a83c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:36.350174 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebbb04-fd37-460b-8ea8-1de7f2a83c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:36.350386 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebbb04-fd37-460b-8ea8-1de7f2a83c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:36.351270 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebbb04-fd37-460b-8ea8-1de7f2a83c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:36.352922 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebbb04-fd37-460b-8ea8-1de7f2a83c73 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:36.383348 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fdc34-cc0e-43c7-ac6c-7438cbeeb23c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:36.392484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1163/2367] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:38:36.397335 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fdc34-cc0e-43c7-ac6c-7438cbeeb23c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:36.397814 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebbb04-fd37-460b-8ea8-1de7f2a83c73 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:36.400372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2eebbb04-fd37-460b-8ea8-1de7f2a83c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:36.412966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee05fa-dec6-410d-b743-ed343c28de88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:36.413877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee05fa-dec6-410d-b743-ed343c28de88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:36.414481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee05fa-dec6-410d-b743-ed343c28de88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:36.414481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee05fa-dec6-410d-b743-ed343c28de88 admin admin] PATH_INFO: `/v3/projects/5c6d9917fc484639a0e0793ae14496b2/users/d204ddb1baba4bf497d25115cf76a83b/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:36.423940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebbb04-fd37-460b-8ea8-1de7f2a83c73 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:36.445981 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a2388-0c5f-43c2-82be-2d5d9777015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:36.449565 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a2388-0c5f-43c2-82be-2d5d9777015d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:36.449829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee05fa-dec6-410d-b743-ed343c28de88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6d9917fc484639a0e0793ae14496b2, user_id=d204ddb1baba4bf497d25115cf76a83b, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:36.450716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a2388-0c5f-43c2-82be-2d5d9777015d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:36.450989 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a2388-0c5f-43c2-82be-2d5d9777015d admin admin] PATH_INFO: `/v3/projects/1650586a4ece4668a08189e9eb77fd62` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:36.457461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a2388-0c5f-43c2-82be-2d5d9777015d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1650586a4ece4668a08189e9eb77fd62)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:36.457461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a2388-0c5f-43c2-82be-2d5d9777015d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:36.463749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee05fa-dec6-410d-b743-ed343c28de88 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:36.492469 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1205/2368] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:36 2022] PUT /identity/v3/projects/5c6d9917fc484639a0e0793ae14496b2/users/d204ddb1baba4bf497d25115cf76a83b/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:36.504339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb5ce9-2603-4e88-92e1-9cf334c9b3dc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:36.504643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb5ce9-2603-4e88-92e1-9cf334c9b3dc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:36.504926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb5ce9-2603-4e88-92e1-9cf334c9b3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:36.529774 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-717a2388-0c5f-43c2-82be-2d5d9777015d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1650586a4ece4668a08189e9eb77fd62', 'request_id': 'req-717a2388-0c5f-43c2-82be-2d5d9777015d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:36.542700 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-717a2388-0c5f-43c2-82be-2d5d9777015d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1650586a4ece4668a08189e9eb77fd62', 'request_id': 'req-717a2388-0c5f-43c2-82be-2d5d9777015d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:36.544034 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a2cb5ce9-2603-4e88-92e1-9cf334c9b3dc None None] MFA Rules not processed for user `d204ddb1baba4bf497d25115cf76a83b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:36.545668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a2cb5ce9-2603-4e88-92e1-9cf334c9b3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:36.552259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-717a2388-0c5f-43c2-82be-2d5d9777015d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1650586a4ece4668a08189e9eb77fd62', 'request_id': 'req-717a2388-0c5f-43c2-82be-2d5d9777015d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:36.568973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-717a2388-0c5f-43c2-82be-2d5d9777015d admin admin] The token cache is being invalidate because project 1650586a4ece4668a08189e9eb77fd62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:36.569426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-717a2388-0c5f-43c2-82be-2d5d9777015d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:36.570392 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-717a2388-0c5f-43c2-82be-2d5d9777015d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:36.572089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1164/2369] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:36 2022] DELETE /identity/v3/projects/1650586a4ece4668a08189e9eb77fd62 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:36.577724 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d86ec-832c-4cd3-ad22-ac14b93b3ec1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:36.578124 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d86ec-832c-4cd3-ad22-ac14b93b3ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:36.578615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d86ec-832c-4cd3-ad22-ac14b93b3ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:36.627538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-616d86ec-832c-4cd3-ad22-ac14b93b3ec1 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:36.633653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-616d86ec-832c-4cd3-ad22-ac14b93b3ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:36.635719 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1206/2370] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:36.656870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb5ce9-2603-4e88-92e1-9cf334c9b3dc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:36.660458 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a2cb5ce9-2603-4e88-92e1-9cf334c9b3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:36.698036 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:36.723007 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1165/2371] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:36.730743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd46a57-da41-4a55-99f5-b0521801035d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:36.731035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd46a57-da41-4a55-99f5-b0521801035d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:36.731322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd46a57-da41-4a55-99f5-b0521801035d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:36.746618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb5ce9-2603-4e88-92e1-9cf334c9b3dc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:36.755766 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e4fd8-6884-44cf-86a3-e1cec306afd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:36.756677 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4fd8-6884-44cf-86a3-e1cec306afd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:36.757109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4fd8-6884-44cf-86a3-e1cec306afd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:36.757532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4fd8-6884-44cf-86a3-e1cec306afd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:36.766730 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:36.768173 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4bd46a57-da41-4a55-99f5-b0521801035d None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:36.769621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4bd46a57-da41-4a55-99f5-b0521801035d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:36.771296 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e4fd8-6884-44cf-86a3-e1cec306afd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:36.774008 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e4fd8-6884-44cf-86a3-e1cec306afd5 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:36.780563 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1166/2372] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:38:36.783695 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd46a57-da41-4a55-99f5-b0521801035d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:36.788201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1207/2373] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:36.806568 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd46a57-da41-4a55-99f5-b0521801035d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:36.814741 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316aa9ce-e0fd-49a5-a325-6cf408404be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:36.815418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa9ce-e0fd-49a5-a325-6cf408404be5 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:36.815705 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa9ce-e0fd-49a5-a325-6cf408404be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:36.815984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa9ce-e0fd-49a5-a325-6cf408404be5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:36.816820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316aa9ce-e0fd-49a5-a325-6cf408404be5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:38:36.817456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316aa9ce-e0fd-49a5-a325-6cf408404be5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:36.819687 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316aa9ce-e0fd-49a5-a325-6cf408404be5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:36.840063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1167/2374] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:38:36.842892 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e4fd8-6884-44cf-86a3-e1cec306afd5 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:36.860578 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e4fd8-6884-44cf-86a3-e1cec306afd5 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:36.872801 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9266c50-bc38-4acf-bbd4-e64d63a3a3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:36.873710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9266c50-bc38-4acf-bbd4-e64d63a3a3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:36.874164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9266c50-bc38-4acf-bbd4-e64d63a3a3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:36.874745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9266c50-bc38-4acf-bbd4-e64d63a3a3e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:36.877239 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9266c50-bc38-4acf-bbd4-e64d63a3a3e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:36.879792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9266c50-bc38-4acf-bbd4-e64d63a3a3e8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:36.930731 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1208/2375] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:38:36 2022] POST /identity/v3/projects => generated 399 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:38:36.931923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316aa9ce-e0fd-49a5-a325-6cf408404be5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:36.950204 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316aa9ce-e0fd-49a5-a325-6cf408404be5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:37.029447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419b5d3-1610-4404-afcb-725aee98b626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:37.030142 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419b5d3-1610-4404-afcb-725aee98b626 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:37.030432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419b5d3-1610-4404-afcb-725aee98b626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:37.030743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419b5d3-1610-4404-afcb-725aee98b626 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:37.032084 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419b5d3-1610-4404-afcb-725aee98b626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:37.034104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419b5d3-1610-4404-afcb-725aee98b626 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:37.064587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1168/2376] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:38:36 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:38:37.068990 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9266c50-bc38-4acf-bbd4-e64d63a3a3e8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:37.087378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9266c50-bc38-4acf-bbd4-e64d63a3a3e8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:37.096660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0759cc-f827-43d6-877f-bae25afe0f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:37.097822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0759cc-f827-43d6-877f-bae25afe0f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:37.097822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0759cc-f827-43d6-877f-bae25afe0f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:37.099198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0759cc-f827-43d6-877f-bae25afe0f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:37.099198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0759cc-f827-43d6-877f-bae25afe0f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:37.102123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0759cc-f827-43d6-877f-bae25afe0f50 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:37.120558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1209/2377] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:37.121465 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419b5d3-1610-4404-afcb-725aee98b626 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:37.134048 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419b5d3-1610-4404-afcb-725aee98b626 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:37.139809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921e271-7648-4ddc-946e-3e2b52b39ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:37.142085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921e271-7648-4ddc-946e-3e2b52b39ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:37.142443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921e271-7648-4ddc-946e-3e2b52b39ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:37.142801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921e271-7648-4ddc-946e-3e2b52b39ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:37.143751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921e271-7648-4ddc-946e-3e2b52b39ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:37.145635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921e271-7648-4ddc-946e-3e2b52b39ca6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:37.161927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1169/2378] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:38:37.166040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0759cc-f827-43d6-877f-bae25afe0f50 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:37.177794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0759cc-f827-43d6-877f-bae25afe0f50 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:37.184691 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19b220-bb67-4f78-b3c8-67f07f5046d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:37.185739 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19b220-bb67-4f78-b3c8-67f07f5046d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:37.186187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19b220-bb67-4f78-b3c8-67f07f5046d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:37.186542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19b220-bb67-4f78-b3c8-67f07f5046d9 admin admin] PATH_INFO: `/v3/projects/8d9bed99ac9846da89a8c053abe2e5fc/users/85a053d2a61e43b383fec851c9dc7433/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:37.206334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19b220-bb67-4f78-b3c8-67f07f5046d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9bed99ac9846da89a8c053abe2e5fc, user_id=85a053d2a61e43b383fec851c9dc7433, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:37.209308 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19b220-bb67-4f78-b3c8-67f07f5046d9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:37.254002 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1210/2379] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:38:37 2022] PUT /identity/v3/projects/8d9bed99ac9846da89a8c053abe2e5fc/users/85a053d2a61e43b383fec851c9dc7433/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:37.267042 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5973e6-d67d-4055-a11c-54086c49bc62 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:37.267600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5973e6-d67d-4055-a11c-54086c49bc62 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:37.268039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5973e6-d67d-4055-a11c-54086c49bc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:37.343697 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ac5973e6-d67d-4055-a11c-54086c49bc62 None None] MFA Rules not processed for user `85a053d2a61e43b383fec851c9dc7433`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:37.349317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ac5973e6-d67d-4055-a11c-54086c49bc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:37.525947 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1170/2380] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:37.540718 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19b220-bb67-4f78-b3c8-67f07f5046d9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:37.650875 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19b220-bb67-4f78-b3c8-67f07f5046d9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:37.656953 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81acdb-c99b-447f-837a-db6b91b1151d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:37.657674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81acdb-c99b-447f-837a-db6b91b1151d service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:37.657963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81acdb-c99b-447f-837a-db6b91b1151d service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:37.658526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81acdb-c99b-447f-837a-db6b91b1151d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:37.677888 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81acdb-c99b-447f-837a-db6b91b1151d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:37.679568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81acdb-c99b-447f-837a-db6b91b1151d service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:37.714004 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1211/2381] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:38.490204 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41a7e2-cc25-49b4-b834-9ca8e05defdd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:38.490694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41a7e2-cc25-49b4-b834-9ca8e05defdd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:38.490792 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41a7e2-cc25-49b4-b834-9ca8e05defdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:38.516127 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ce41a7e2-cc25-49b4-b834-9ca8e05defdd None None] MFA Rules not processed for user `d204ddb1baba4bf497d25115cf76a83b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:38.517317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ce41a7e2-cc25-49b4-b834-9ca8e05defdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:38.556099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:38.595500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1171/2382] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:46.229068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81acdb-c99b-447f-837a-db6b91b1151d service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:46.315966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81acdb-c99b-447f-837a-db6b91b1151d service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:46.321917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fb803-fe16-47d3-b2cb-0e115c06031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:46.322799 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fb803-fe16-47d3-b2cb-0e115c06031d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:46.323088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fb803-fe16-47d3-b2cb-0e115c06031d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:46.323372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fb803-fe16-47d3-b2cb-0e115c06031d admin admin] PATH_INFO: `/v3/users/85a053d2a61e43b383fec851c9dc7433` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:46.324630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fb803-fe16-47d3-b2cb-0e115c06031d admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a053d2a61e43b383fec851c9dc7433)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:46.326566 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fb803-fe16-47d3-b2cb-0e115c06031d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:46.385090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:46.388001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d56fb803-fe16-47d3-b2cb-0e115c06031d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a053d2a61e43b383fec851c9dc7433'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:46.397779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d56fb803-fe16-47d3-b2cb-0e115c06031d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a053d2a61e43b383fec851c9dc7433'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:46.405503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d56fb803-fe16-47d3-b2cb-0e115c06031d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a053d2a61e43b383fec851c9dc7433'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:46.406250 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d56fb803-fe16-47d3-b2cb-0e115c06031d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a053d2a61e43b383fec851c9dc7433'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:46.419417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d56fb803-fe16-47d3-b2cb-0e115c06031d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a053d2a61e43b383fec851c9dc7433'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:46.431334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1212/2383] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:38:46 2022] DELETE /identity/v3/users/85a053d2a61e43b383fec851c9dc7433 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:46.435815 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bde8a-cfc8-42ab-814e-e9d80475b677 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:46.436305 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bde8a-cfc8-42ab-814e-e9d80475b677 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:46.436525 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bde8a-cfc8-42ab-814e-e9d80475b677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:46.473862 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1e1bde8a-cfc8-42ab-814e-e9d80475b677 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:46.475089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1e1bde8a-cfc8-42ab-814e-e9d80475b677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:46.542851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1172/2384] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:46.550040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fb803-fe16-47d3-b2cb-0e115c06031d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:46.551572 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d56fb803-fe16-47d3-b2cb-0e115c06031d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:46.623021 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fb803-fe16-47d3-b2cb-0e115c06031d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:46.628933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc188c7-e1e4-406f-bfed-d1ad94cb6126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:46.633500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc188c7-e1e4-406f-bfed-d1ad94cb6126 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:46.633500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc188c7-e1e4-406f-bfed-d1ad94cb6126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:46.633500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc188c7-e1e4-406f-bfed-d1ad94cb6126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:46.653675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc188c7-e1e4-406f-bfed-d1ad94cb6126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:46.656961 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc188c7-e1e4-406f-bfed-d1ad94cb6126 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:46.671971 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1213/2385] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:38:47.193707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc84870-b461-4c14-b884-323ec982a548 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:47.194214 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc84870-b461-4c14-b884-323ec982a548 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:47.194609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc84870-b461-4c14-b884-323ec982a548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:47.217105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1bc84870-b461-4c14-b884-323ec982a548 None None] MFA Rules not processed for user `c0b5962b37b2470099436609425f7423`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:38:47.218621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1bc84870-b461-4c14-b884-323ec982a548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:47.302745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1173/2386] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:38:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:38:47.507264 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc188c7-e1e4-406f-bfed-d1ad94cb6126 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:38:47.508993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1dc188c7-e1e4-406f-bfed-d1ad94cb6126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:38:47.540203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc188c7-e1e4-406f-bfed-d1ad94cb6126 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:38:47.547445 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:38:47.549604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:38:47.549897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:38:47.550181 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] PATH_INFO: `/v3/projects/8d9bed99ac9846da89a8c053abe2e5fc` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:38:47.551538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9bed99ac9846da89a8c053abe2e5fc)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:38:47.553933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:38:47.619128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9bed99ac9846da89a8c053abe2e5fc', 'request_id': 'req-be8d7df2-25c8-4706-b3c7-744e41972823'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:47.626355 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9bed99ac9846da89a8c053abe2e5fc', 'request_id': 'req-be8d7df2-25c8-4706-b3c7-744e41972823'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:47.632955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9bed99ac9846da89a8c053abe2e5fc', 'request_id': 'req-be8d7df2-25c8-4706-b3c7-744e41972823'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:47.648187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] The token cache is being invalidate because project 8d9bed99ac9846da89a8c053abe2e5fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:38:47.648632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:47.649413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:38:47.651125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1214/2387] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:38:47 2022] DELETE /identity/v3/projects/8d9bed99ac9846da89a8c053abe2e5fc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:38:57.287392 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=62 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:57.644735 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=11,keystone:SELECT=66,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:00.834302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bbefb-1ed2-4b67-a7c7-83679f109459 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:00.834762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bbefb-1ed2-4b67-a7c7-83679f109459 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:00.834858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bbefb-1ed2-4b67-a7c7-83679f109459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:00.854580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-470bbefb-1ed2-4b67-a7c7-83679f109459 None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:00.855832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-470bbefb-1ed2-4b67-a7c7-83679f109459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:00.911610 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1174/2388] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:39:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:00.961488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:00.963541 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:01.036898 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d7df2-25c8-4706-b3c7-744e41972823 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:01.042121 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4af7e-2bc4-4cf7-97bd-db042ccb380c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:01.042802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4af7e-2bc4-4cf7-97bd-db042ccb380c service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:01.043118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4af7e-2bc4-4cf7-97bd-db042ccb380c service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:01.043398 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4af7e-2bc4-4cf7-97bd-db042ccb380c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:01.051623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4af7e-2bc4-4cf7-97bd-db042ccb380c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:01.053290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4af7e-2bc4-4cf7-97bd-db042ccb380c service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:01.061801 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1215/2389] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:39:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 20:39:10.903888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=25 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:11.058767 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=32 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:18.391956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c749e-cf55-4b95-adde-7dccc7b94e6f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:18.392468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c749e-cf55-4b95-adde-7dccc7b94e6f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:18.392576 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c749e-cf55-4b95-adde-7dccc7b94e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:18.411630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0e3c749e-cf55-4b95-adde-7dccc7b94e6f None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:18.412935 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0e3c749e-cf55-4b95-adde-7dccc7b94e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:18.420570 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1175/2390] 10.222.0.66 () {58 vars in 967 bytes} [Fri Jul 15 20:39:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:18.438720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4af7e-2bc4-4cf7-97bd-db042ccb380c service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:18.450456 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4af7e-2bc4-4cf7-97bd-db042ccb380c service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:18.460632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270390f-547d-450a-aeaa-1f4cdd7c91a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:18.461323 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270390f-547d-450a-aeaa-1f4cdd7c91a0 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:18.462152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270390f-547d-450a-aeaa-1f4cdd7c91a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:18.462547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270390f-547d-450a-aeaa-1f4cdd7c91a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:18.473758 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270390f-547d-450a-aeaa-1f4cdd7c91a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:18.475557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270390f-547d-450a-aeaa-1f4cdd7c91a0 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:18.485446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1216/2391] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:39:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 20:39:19.421911 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a125ed-ee48-4249-ac8e-0e6143c0e776 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:19.422530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a125ed-ee48-4249-ac8e-0e6143c0e776 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:19.422530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a125ed-ee48-4249-ac8e-0e6143c0e776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:19.440490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-15a125ed-ee48-4249-ac8e-0e6143c0e776 None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:19.441737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-15a125ed-ee48-4249-ac8e-0e6143c0e776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:19.449534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1176/2392] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:39:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:19.462408 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270390f-547d-450a-aeaa-1f4cdd7c91a0 service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:19.472996 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270390f-547d-450a-aeaa-1f4cdd7c91a0 service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:19.478340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088a724-548f-40fe-8e61-d3e698ec3962 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:19.479069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088a724-548f-40fe-8e61-d3e698ec3962 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:19.479359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088a724-548f-40fe-8e61-d3e698ec3962 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:19.479645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088a724-548f-40fe-8e61-d3e698ec3962 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:19.488714 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088a724-548f-40fe-8e61-d3e698ec3962 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:19.490303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088a724-548f-40fe-8e61-d3e698ec3962 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:19.498389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1217/2393] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:39:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 20:39:20.047699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85f01-eed7-44a9-8347-60aa3087c7bd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:20.048060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85f01-eed7-44a9-8347-60aa3087c7bd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:20.048520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85f01-eed7-44a9-8347-60aa3087c7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:20.067128 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-53b85f01-eed7-44a9-8347-60aa3087c7bd None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:20.068340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-53b85f01-eed7-44a9-8347-60aa3087c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:20.076678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1177/2394] 10.222.0.66 () {58 vars in 967 bytes} [Fri Jul 15 20:39:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:20.091323 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088a724-548f-40fe-8e61-d3e698ec3962 service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:20.102687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088a724-548f-40fe-8e61-d3e698ec3962 service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:20.109151 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dc0f0-a643-4b6a-aee5-6ae8d0811b89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:20.110296 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dc0f0-a643-4b6a-aee5-6ae8d0811b89 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:20.110603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dc0f0-a643-4b6a-aee5-6ae8d0811b89 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:20.110882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dc0f0-a643-4b6a-aee5-6ae8d0811b89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:20.120306 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dc0f0-a643-4b6a-aee5-6ae8d0811b89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:20.122331 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dc0f0-a643-4b6a-aee5-6ae8d0811b89 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:20.132440 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1218/2395] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:39:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 20:39:20.356683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492023c-bc85-4c12-8f1b-722cc9afc7cc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:20.357043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492023c-bc85-4c12-8f1b-722cc9afc7cc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:20.357333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492023c-bc85-4c12-8f1b-722cc9afc7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:20.385093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5492023c-bc85-4c12-8f1b-722cc9afc7cc None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:20.386369 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5492023c-bc85-4c12-8f1b-722cc9afc7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:20.394161 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1178/2396] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:39:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:20.410191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dc0f0-a643-4b6a-aee5-6ae8d0811b89 service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:20.421519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dc0f0-a643-4b6a-aee5-6ae8d0811b89 service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:20.429064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa4bb1-bd13-4130-8d61-3f8d05af517e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:20.429893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa4bb1-bd13-4130-8d61-3f8d05af517e service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:20.430104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa4bb1-bd13-4130-8d61-3f8d05af517e service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:20.430389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa4bb1-bd13-4130-8d61-3f8d05af517e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:20.439611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa4bb1-bd13-4130-8d61-3f8d05af517e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:20.441282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa4bb1-bd13-4130-8d61-3f8d05af517e service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:20.452083 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1219/2397] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:39:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 20:39:20.588596 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492023c-bc85-4c12-8f1b-722cc9afc7cc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:20.595601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5492023c-bc85-4c12-8f1b-722cc9afc7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:20.693745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492023c-bc85-4c12-8f1b-722cc9afc7cc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:20.700538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7fb66-4fbc-45a6-ad70-87bade36e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:20.701537 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7fb66-4fbc-45a6-ad70-87bade36e047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:20.701820 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7fb66-4fbc-45a6-ad70-87bade36e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:20.702107 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7fb66-4fbc-45a6-ad70-87bade36e047 admin admin] PATH_INFO: `/v3/users/932ad1f03da24593a6ad444f6cb95e6d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:20.704423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7fb66-4fbc-45a6-ad70-87bade36e047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932ad1f03da24593a6ad444f6cb95e6d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:20.706366 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7fb66-4fbc-45a6-ad70-87bade36e047 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:20.793083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dbe7fb66-4fbc-45a6-ad70-87bade36e047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932ad1f03da24593a6ad444f6cb95e6d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:20.821698 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dbe7fb66-4fbc-45a6-ad70-87bade36e047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932ad1f03da24593a6ad444f6cb95e6d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:20.823113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dbe7fb66-4fbc-45a6-ad70-87bade36e047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932ad1f03da24593a6ad444f6cb95e6d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:20.845635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dbe7fb66-4fbc-45a6-ad70-87bade36e047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932ad1f03da24593a6ad444f6cb95e6d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:20.846613 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dbe7fb66-4fbc-45a6-ad70-87bade36e047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932ad1f03da24593a6ad444f6cb95e6d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:20.869808 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1179/2398] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:39:20 2022] DELETE /identity/v3/users/932ad1f03da24593a6ad444f6cb95e6d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:39:20.923378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8095dd-0c50-477d-bd45-45474f1a5cd8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:20.924217 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8095dd-0c50-477d-bd45-45474f1a5cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:20.924680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8095dd-0c50-477d-bd45-45474f1a5cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:20.946954 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2d8095dd-0c50-477d-bd45-45474f1a5cd8 None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:20.948419 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2d8095dd-0c50-477d-bd45-45474f1a5cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:21.058857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1220/2399] 10.222.0.66 () {58 vars in 967 bytes} [Fri Jul 15 20:39:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:21.076087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7fb66-4fbc-45a6-ad70-87bade36e047 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:21.077999 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dbe7fb66-4fbc-45a6-ad70-87bade36e047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:21.155068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:21.166213 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8095dd-0c50-477d-bd45-45474f1a5cd8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:21.168448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2d8095dd-0c50-477d-bd45-45474f1a5cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:21.184261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7fb66-4fbc-45a6-ad70-87bade36e047 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:21.189757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f7930-ed4d-4506-a5c8-32837308bab5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:21.190428 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7930-ed4d-4506-a5c8-32837308bab5 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:21.191022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7930-ed4d-4506-a5c8-32837308bab5 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:21.191487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7930-ed4d-4506-a5c8-32837308bab5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:21.201039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f7930-ed4d-4506-a5c8-32837308bab5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:21.202814 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f7930-ed4d-4506-a5c8-32837308bab5 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:21.213263 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1180/2400] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:39:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 20:39:21.285319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8095dd-0c50-477d-bd45-45474f1a5cd8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:21.293100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb54dec-ff0a-479d-84a6-b84d2f18829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:21.294391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb54dec-ff0a-479d-84a6-b84d2f18829e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:21.294895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb54dec-ff0a-479d-84a6-b84d2f18829e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:21.295339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb54dec-ff0a-479d-84a6-b84d2f18829e admin admin] PATH_INFO: `/v3/projects/3129a35d484445db9e141028b2e77497` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:21.297471 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb54dec-ff0a-479d-84a6-b84d2f18829e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3129a35d484445db9e141028b2e77497)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:21.299909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb54dec-ff0a-479d-84a6-b84d2f18829e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:21.362527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bbb54dec-ff0a-479d-84a6-b84d2f18829e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3129a35d484445db9e141028b2e77497', 'request_id': 'req-bbb54dec-ff0a-479d-84a6-b84d2f18829e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:21.369820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bbb54dec-ff0a-479d-84a6-b84d2f18829e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3129a35d484445db9e141028b2e77497', 'request_id': 'req-bbb54dec-ff0a-479d-84a6-b84d2f18829e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:21.377294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:21.382494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bbb54dec-ff0a-479d-84a6-b84d2f18829e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3129a35d484445db9e141028b2e77497', 'request_id': 'req-bbb54dec-ff0a-479d-84a6-b84d2f18829e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:21.397931 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bbb54dec-ff0a-479d-84a6-b84d2f18829e admin admin] The token cache is being invalidate because project 3129a35d484445db9e141028b2e77497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:39:21.398390 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bbb54dec-ff0a-479d-84a6-b84d2f18829e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:21.400868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bbb54dec-ff0a-479d-84a6-b84d2f18829e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:21.404703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1221/2401] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:39:21 2022] DELETE /identity/v3/projects/3129a35d484445db9e141028b2e77497 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:39:21.410174 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f6cb4-c9f6-4d24-9700-d584982d9954 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:21.410469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f6cb4-c9f6-4d24-9700-d584982d9954 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:21.410751 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f6cb4-c9f6-4d24-9700-d584982d9954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:21.431635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b42f6cb4-c9f6-4d24-9700-d584982d9954 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:21.433282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b42f6cb4-c9f6-4d24-9700-d584982d9954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:21.525506 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1181/2402] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:21.533394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f0c0e-3cd5-4e76-b457-562a4d7cf14f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:21.533694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f0c0e-3cd5-4e76-b457-562a4d7cf14f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:21.533981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f0c0e-3cd5-4e76-b457-562a4d7cf14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:21.555508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-334f0c0e-3cd5-4e76-b457-562a4d7cf14f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:21.557463 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-334f0c0e-3cd5-4e76-b457-562a4d7cf14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:21.568600 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1222/2403] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:21.570498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f6cb4-c9f6-4d24-9700-d584982d9954 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:21.581284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f6cb4-c9f6-4d24-9700-d584982d9954 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:21.588807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafaf62-bbba-4d27-8a91-45e6ff574edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:21.589619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafaf62-bbba-4d27-8a91-45e6ff574edc admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:21.590000 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafaf62-bbba-4d27-8a91-45e6ff574edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:21.590279 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafaf62-bbba-4d27-8a91-45e6ff574edc admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:21.591017 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafaf62-bbba-4d27-8a91-45e6ff574edc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:21.591324 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafaf62-bbba-4d27-8a91-45e6ff574edc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:21.592961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafaf62-bbba-4d27-8a91-45e6ff574edc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:21.606563 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1182/2404] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:21.612215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f0c0e-3cd5-4e76-b457-562a4d7cf14f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:21.622448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f0c0e-3cd5-4e76-b457-562a4d7cf14f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:21.629132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fbdf4-47d6-45a1-b02c-cf22f232fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:21.629869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fbdf4-47d6-45a1-b02c-cf22f232fb65 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:21.630178 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fbdf4-47d6-45a1-b02c-cf22f232fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:21.630437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fbdf4-47d6-45a1-b02c-cf22f232fb65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:21.631132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fbdf4-47d6-45a1-b02c-cf22f232fb65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:21.633137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fbdf4-47d6-45a1-b02c-cf22f232fb65 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:21.670337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafaf62-bbba-4d27-8a91-45e6ff574edc admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:21.670542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1223/2405] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:39:21 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:39:21.679432 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafaf62-bbba-4d27-8a91-45e6ff574edc admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:21.752514 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf3d41-2824-4594-bb10-d9011b0b98a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:21.753279 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf3d41-2824-4594-bb10-d9011b0b98a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:21.753614 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf3d41-2824-4594-bb10-d9011b0b98a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:21.753965 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf3d41-2824-4594-bb10-d9011b0b98a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:21.754813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf3d41-2824-4594-bb10-d9011b0b98a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:21.756776 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf3d41-2824-4594-bb10-d9011b0b98a5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:21.786077 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1183/2406] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:39:21 2022] POST /identity/v3/users => generated 285 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:39:21.786421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fbdf4-47d6-45a1-b02c-cf22f232fb65 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:21.798526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fbdf4-47d6-45a1-b02c-cf22f232fb65 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:21.803472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2f6b5-ad62-4178-aa34-b1a2105c7b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:21.804148 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2f6b5-ad62-4178-aa34-b1a2105c7b51 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:21.804508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2f6b5-ad62-4178-aa34-b1a2105c7b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:21.804792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2f6b5-ad62-4178-aa34-b1a2105c7b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:21.811081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2f6b5-ad62-4178-aa34-b1a2105c7b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:21.811081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2f6b5-ad62-4178-aa34-b1a2105c7b51 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:21.823451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1224/2407] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:39:21.827431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf3d41-2824-4594-bb10-d9011b0b98a5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:21.839348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf3d41-2824-4594-bb10-d9011b0b98a5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:21.845492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210eb34-2155-447f-b869-e77b3fdcafc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:21.847044 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210eb34-2155-447f-b869-e77b3fdcafc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:21.847044 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210eb34-2155-447f-b869-e77b3fdcafc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:21.847044 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210eb34-2155-447f-b869-e77b3fdcafc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:21.847621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210eb34-2155-447f-b869-e77b3fdcafc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:21.849343 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210eb34-2155-447f-b869-e77b3fdcafc9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:21.860676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1184/2408] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:39:21.864602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2f6b5-ad62-4178-aa34-b1a2105c7b51 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:21.880957 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2f6b5-ad62-4178-aa34-b1a2105c7b51 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:21.885685 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774e2af-0344-41a5-80fd-9a16fbf1990e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:21.886668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774e2af-0344-41a5-80fd-9a16fbf1990e admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:21.887069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774e2af-0344-41a5-80fd-9a16fbf1990e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:21.887410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774e2af-0344-41a5-80fd-9a16fbf1990e admin admin] PATH_INFO: `/v3/projects/fa56a97c7ebc4f648c56d2e4fd8de8c5/users/c2e50b081c4c46c7a2d85b2855c81e00/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:21.906378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774e2af-0344-41a5-80fd-9a16fbf1990e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa56a97c7ebc4f648c56d2e4fd8de8c5, user_id=c2e50b081c4c46c7a2d85b2855c81e00, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:21.910856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774e2af-0344-41a5-80fd-9a16fbf1990e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:21.929590 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1225/2409] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:39:21 2022] PUT /identity/v3/projects/fa56a97c7ebc4f648c56d2e4fd8de8c5/users/c2e50b081c4c46c7a2d85b2855c81e00/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:39:21.940520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4820d-8680-4759-8d3e-e41caaa264bf None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:21.940818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4820d-8680-4759-8d3e-e41caaa264bf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:21.941098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4820d-8680-4759-8d3e-e41caaa264bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:21.970597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc65176-2b34-4875-8259-5242b4aca1a1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:21.970902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc65176-2b34-4875-8259-5242b4aca1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:21.971185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc65176-2b34-4875-8259-5242b4aca1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:21.972495 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8ad4820d-8680-4759-8d3e-e41caaa264bf None None] MFA Rules not processed for user `c2e50b081c4c46c7a2d85b2855c81e00`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:21.973698 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8ad4820d-8680-4759-8d3e-e41caaa264bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:21.990955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5bc65176-2b34-4875-8259-5242b4aca1a1 None None] MFA Rules not processed for user `e13d5d7068e348248387b512c55dec5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:21.992298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5bc65176-2b34-4875-8259-5242b4aca1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:22.031111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:22.070442 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1226/2410] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:39:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:39:22.074982 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1185/2411] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:39:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:22.087987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc65176-2b34-4875-8259-5242b4aca1a1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:22.089551 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5bc65176-2b34-4875-8259-5242b4aca1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:22.217041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc65176-2b34-4875-8259-5242b4aca1a1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:22.221867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75967148-2d8c-421c-b604-31a8018c045a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93958c7dad0540b296b316169932d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:22.222614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75967148-2d8c-421c-b604-31a8018c045a service glance] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:22.223022 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75967148-2d8c-421c-b604-31a8018c045a service glance] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:22.223381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75967148-2d8c-421c-b604-31a8018c045a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:22.237990 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75967148-2d8c-421c-b604-31a8018c045a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:22.239448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75967148-2d8c-421c-b604-31a8018c045a service glance] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:22.260497 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1227/2412] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:39:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:39:23.562079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4820d-8680-4759-8d3e-e41caaa264bf None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:23.565249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8ad4820d-8680-4759-8d3e-e41caaa264bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:23.638675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4820d-8680-4759-8d3e-e41caaa264bf None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:23.646037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954b7a4-b1a4-45ea-b05a-1f4fda9222a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:23.648096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954b7a4-b1a4-45ea-b05a-1f4fda9222a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:23.648478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954b7a4-b1a4-45ea-b05a-1f4fda9222a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:23.652337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954b7a4-b1a4-45ea-b05a-1f4fda9222a3 admin admin] PATH_INFO: `/v3/users/d204ddb1baba4bf497d25115cf76a83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:23.653818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954b7a4-b1a4-45ea-b05a-1f4fda9222a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d204ddb1baba4bf497d25115cf76a83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:23.655917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954b7a4-b1a4-45ea-b05a-1f4fda9222a3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:23.718182 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4954b7a4-b1a4-45ea-b05a-1f4fda9222a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd204ddb1baba4bf497d25115cf76a83b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:23.736670 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4954b7a4-b1a4-45ea-b05a-1f4fda9222a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd204ddb1baba4bf497d25115cf76a83b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:23.738318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4954b7a4-b1a4-45ea-b05a-1f4fda9222a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd204ddb1baba4bf497d25115cf76a83b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:23.748880 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4954b7a4-b1a4-45ea-b05a-1f4fda9222a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd204ddb1baba4bf497d25115cf76a83b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:23.750099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4954b7a4-b1a4-45ea-b05a-1f4fda9222a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd204ddb1baba4bf497d25115cf76a83b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:23.768472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1186/2413] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:39:23 2022] DELETE /identity/v3/users/d204ddb1baba4bf497d25115cf76a83b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:39:23.778411 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a0c11-4fdd-4e66-aafc-4ece831f9ea8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:23.778938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a0c11-4fdd-4e66-aafc-4ece831f9ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:23.779018 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a0c11-4fdd-4e66-aafc-4ece831f9ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:23.791091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:23.804098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-220a0c11-4fdd-4e66-aafc-4ece831f9ea8 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:23.805623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-220a0c11-4fdd-4e66-aafc-4ece831f9ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:23.877905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1228/2414] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:23.888092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954b7a4-b1a4-45ea-b05a-1f4fda9222a3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:23.891150 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4954b7a4-b1a4-45ea-b05a-1f4fda9222a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:23.988430 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954b7a4-b1a4-45ea-b05a-1f4fda9222a3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:23.996142 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b68d3-4108-4f28-b3cc-7dc9007f3f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:23.997090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b68d3-4108-4f28-b3cc-7dc9007f3f24 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:23.997639 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b68d3-4108-4f28-b3cc-7dc9007f3f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:23.998067 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b68d3-4108-4f28-b3cc-7dc9007f3f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:24.010668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b68d3-4108-4f28-b3cc-7dc9007f3f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:24.013520 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b68d3-4108-4f28-b3cc-7dc9007f3f24 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:24.021314 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:24.032807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1187/2415] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:39:24.223256 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a0c11-4fdd-4e66-aafc-4ece831f9ea8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:24.224767 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-220a0c11-4fdd-4e66-aafc-4ece831f9ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:24.243145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a0c11-4fdd-4e66-aafc-4ece831f9ea8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:24.251594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94940a99-35b1-4331-860e-9d80d9edc426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:24.253006 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940a99-35b1-4331-860e-9d80d9edc426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:24.253660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940a99-35b1-4331-860e-9d80d9edc426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:24.254087 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940a99-35b1-4331-860e-9d80d9edc426 admin admin] PATH_INFO: `/v3/projects/5c6d9917fc484639a0e0793ae14496b2` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:24.256728 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94940a99-35b1-4331-860e-9d80d9edc426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6d9917fc484639a0e0793ae14496b2)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:24.259694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94940a99-35b1-4331-860e-9d80d9edc426 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:24.325526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-94940a99-35b1-4331-860e-9d80d9edc426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6d9917fc484639a0e0793ae14496b2', 'request_id': 'req-94940a99-35b1-4331-860e-9d80d9edc426'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:24.334946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-94940a99-35b1-4331-860e-9d80d9edc426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6d9917fc484639a0e0793ae14496b2', 'request_id': 'req-94940a99-35b1-4331-860e-9d80d9edc426'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:24.346646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-94940a99-35b1-4331-860e-9d80d9edc426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6d9917fc484639a0e0793ae14496b2', 'request_id': 'req-94940a99-35b1-4331-860e-9d80d9edc426'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:24.369993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-94940a99-35b1-4331-860e-9d80d9edc426 admin admin] The token cache is being invalidate because project 5c6d9917fc484639a0e0793ae14496b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:39:24.370255 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-94940a99-35b1-4331-860e-9d80d9edc426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:24.371007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-94940a99-35b1-4331-860e-9d80d9edc426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:39:24.373266 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1229/2416] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:39:24 2022] DELETE /identity/v3/projects/5c6d9917fc484639a0e0793ae14496b2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:39:24.380534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca265a0-19de-428a-a600-a548190a9cb7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:24.380825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca265a0-19de-428a-a600-a548190a9cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:24.381108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca265a0-19de-428a-a600-a548190a9cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:24.401691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cca265a0-19de-428a-a600-a548190a9cb7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:24.402897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cca265a0-19de-428a-a600-a548190a9cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:24.469651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1188/2417] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:24.477401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecfa99-c540-4eec-bcc2-510c497059ae None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:24.477695 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecfa99-c540-4eec-bcc2-510c497059ae None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:24.477970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecfa99-c540-4eec-bcc2-510c497059ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:24.496169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8fecfa99-c540-4eec-bcc2-510c497059ae None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:24.497472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8fecfa99-c540-4eec-bcc2-510c497059ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:24.506317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1230/2418] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:39:24.510384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca265a0-19de-428a-a600-a548190a9cb7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:24.521770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca265a0-19de-428a-a600-a548190a9cb7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:24.528220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120aea33-0448-495a-8f5c-b932050b339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:24.528978 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120aea33-0448-495a-8f5c-b932050b339c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:24.529387 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120aea33-0448-495a-8f5c-b932050b339c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:24.529542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120aea33-0448-495a-8f5c-b932050b339c admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:24.530376 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120aea33-0448-495a-8f5c-b932050b339c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:39:24.530835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120aea33-0448-495a-8f5c-b932050b339c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:24.532699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120aea33-0448-495a-8f5c-b932050b339c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:24.546736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1189/2419] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:39:24.551041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecfa99-c540-4eec-bcc2-510c497059ae None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:24.560281 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecfa99-c540-4eec-bcc2-510c497059ae None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:24.565721 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e64886-8385-445f-a945-677c860bfb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:24.566378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64886-8385-445f-a945-677c860bfb80 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:24.566659 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64886-8385-445f-a945-677c860bfb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:24.566935 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64886-8385-445f-a945-677c860bfb80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:24.567634 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e64886-8385-445f-a945-677c860bfb80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:24.569563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e64886-8385-445f-a945-677c860bfb80 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:24.602220 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1231/2420] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:39:24 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:39:24.603966 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120aea33-0448-495a-8f5c-b932050b339c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:24.614980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120aea33-0448-495a-8f5c-b932050b339c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:24.679133 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447642bb-0f9b-4097-937d-0da11f9a7eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:24.679804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447642bb-0f9b-4097-937d-0da11f9a7eef admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:24.680085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447642bb-0f9b-4097-937d-0da11f9a7eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:24.680358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447642bb-0f9b-4097-937d-0da11f9a7eef admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:24.681096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447642bb-0f9b-4097-937d-0da11f9a7eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:24.683020 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447642bb-0f9b-4097-937d-0da11f9a7eef admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:24.703053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1190/2421] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:39:24 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:39:24.707243 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e64886-8385-445f-a945-677c860bfb80 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:24.717855 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e64886-8385-445f-a945-677c860bfb80 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:24.722923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736a6e7-7b59-4be1-be68-ca3bdf2d9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:24.723550 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736a6e7-7b59-4be1-be68-ca3bdf2d9476 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:24.723852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736a6e7-7b59-4be1-be68-ca3bdf2d9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:24.724108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736a6e7-7b59-4be1-be68-ca3bdf2d9476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:24.724866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736a6e7-7b59-4be1-be68-ca3bdf2d9476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:24.726507 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736a6e7-7b59-4be1-be68-ca3bdf2d9476 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:24.739060 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1232/2422] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:39:24.743273 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447642bb-0f9b-4097-937d-0da11f9a7eef admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:24.754742 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447642bb-0f9b-4097-937d-0da11f9a7eef admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:24.759662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73cd14-326e-49a4-9ec4-1ee486eeb83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:24.760335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73cd14-326e-49a4-9ec4-1ee486eeb83c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:24.760654 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73cd14-326e-49a4-9ec4-1ee486eeb83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:24.760942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73cd14-326e-49a4-9ec4-1ee486eeb83c admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:24.761701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73cd14-326e-49a4-9ec4-1ee486eeb83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:24.763319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73cd14-326e-49a4-9ec4-1ee486eeb83c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:24.774764 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1191/2423] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:39:24.779199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736a6e7-7b59-4be1-be68-ca3bdf2d9476 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:24.790401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736a6e7-7b59-4be1-be68-ca3bdf2d9476 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:24.795539 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2957226-6521-435f-aedc-3fe994194fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:24.797192 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2957226-6521-435f-aedc-3fe994194fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:24.797517 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2957226-6521-435f-aedc-3fe994194fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:24.797801 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2957226-6521-435f-aedc-3fe994194fb7 admin admin] PATH_INFO: `/v3/projects/37d62130d6f74b8e919e429cbb3afc55/users/30a573525d244ab3ab69095db8871f20/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:24.817147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2957226-6521-435f-aedc-3fe994194fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d62130d6f74b8e919e429cbb3afc55, user_id=30a573525d244ab3ab69095db8871f20, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:24.819861 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2957226-6521-435f-aedc-3fe994194fb7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:24.833682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1233/2424] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:39:24 2022] PUT /identity/v3/projects/37d62130d6f74b8e919e429cbb3afc55/users/30a573525d244ab3ab69095db8871f20/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:39:24.838784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d529fa3-b929-4444-9959-b15d822a52ce None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:24.839085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d529fa3-b929-4444-9959-b15d822a52ce None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:24.839392 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d529fa3-b929-4444-9959-b15d822a52ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:24.857697 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8d529fa3-b929-4444-9959-b15d822a52ce None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:24.859771 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8d529fa3-b929-4444-9959-b15d822a52ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:24.926226 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1192/2425] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:24.937109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2957226-6521-435f-aedc-3fe994194fb7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:24.938914 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b2957226-6521-435f-aedc-3fe994194fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:24.971577 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:25.008691 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2957226-6521-435f-aedc-3fe994194fb7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:25.013611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878149a0-126c-456d-8979-a2cc4c5d3d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:25.014395 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878149a0-126c-456d-8979-a2cc4c5d3d23 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:25.014690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878149a0-126c-456d-8979-a2cc4c5d3d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:25.015705 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878149a0-126c-456d-8979-a2cc4c5d3d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:25.029437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878149a0-126c-456d-8979-a2cc4c5d3d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:25.031422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878149a0-126c-456d-8979-a2cc4c5d3d23 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:25.045950 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1234/2426] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:39:30.331778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f6d7c-e99f-4efd-9afd-f5703a64e721 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:30.332291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f6d7c-e99f-4efd-9afd-f5703a64e721 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:30.332291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f6d7c-e99f-4efd-9afd-f5703a64e721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:30.345197 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:30.368105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e75f6d7c-e99f-4efd-9afd-f5703a64e721 None None] MFA Rules not processed for user `30a573525d244ab3ab69095db8871f20`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:30.379628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e75f6d7c-e99f-4efd-9afd-f5703a64e721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:30.477441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1193/2427] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:39:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:30.482183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878149a0-126c-456d-8979-a2cc4c5d3d23 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:30.495807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878149a0-126c-456d-8979-a2cc4c5d3d23 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:30.501509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575a285-8ed6-47ff-91cf-b616f6c88e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:30.502205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575a285-8ed6-47ff-91cf-b616f6c88e58 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:30.502556 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575a285-8ed6-47ff-91cf-b616f6c88e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:30.502882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575a285-8ed6-47ff-91cf-b616f6c88e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:30.503441 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575a285-8ed6-47ff-91cf-b616f6c88e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:30.511270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575a285-8ed6-47ff-91cf-b616f6c88e58 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:30.551967 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1235/2428] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:39:30 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:39:30.555569 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f6d7c-e99f-4efd-9afd-f5703a64e721 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:30.568177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f6d7c-e99f-4efd-9afd-f5703a64e721 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:30.652459 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1e824-4ba3-4ac4-ac7d-490722578b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:30.653235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e824-4ba3-4ac4-ac7d-490722578b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:30.653591 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e824-4ba3-4ac4-ac7d-490722578b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:30.653934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e824-4ba3-4ac4-ac7d-490722578b9d admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:30.654800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1e824-4ba3-4ac4-ac7d-490722578b9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:30.657014 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1e824-4ba3-4ac4-ac7d-490722578b9d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:30.679840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1194/2429] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:39:30 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:39:30.685345 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575a285-8ed6-47ff-91cf-b616f6c88e58 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:30.707034 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575a285-8ed6-47ff-91cf-b616f6c88e58 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:30.712062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d569e-4448-46de-94f9-b73c0c6e218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:30.714303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d569e-4448-46de-94f9-b73c0c6e218a admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:30.714303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d569e-4448-46de-94f9-b73c0c6e218a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:30.714303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d569e-4448-46de-94f9-b73c0c6e218a admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:30.715722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d569e-4448-46de-94f9-b73c0c6e218a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:30.717482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d569e-4448-46de-94f9-b73c0c6e218a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:30.735337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1236/2430] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:39:30.738974 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1e824-4ba3-4ac4-ac7d-490722578b9d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:30.757661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1e824-4ba3-4ac4-ac7d-490722578b9d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:30.762495 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e5184-2c9a-4000-a55e-5b7eda2a3789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:30.763391 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e5184-2c9a-4000-a55e-5b7eda2a3789 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:30.763678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e5184-2c9a-4000-a55e-5b7eda2a3789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:30.764628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e5184-2c9a-4000-a55e-5b7eda2a3789 admin admin] PATH_INFO: `/v3/projects/229a376694984d26a63117f0030f31eb/users/2d56745a014d4d12bcc514d1fd98447b/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:30.784285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e5184-2c9a-4000-a55e-5b7eda2a3789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229a376694984d26a63117f0030f31eb, user_id=2d56745a014d4d12bcc514d1fd98447b, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:30.787530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e5184-2c9a-4000-a55e-5b7eda2a3789 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:30.805836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1195/2431] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:39:30 2022] PUT /identity/v3/projects/229a376694984d26a63117f0030f31eb/users/2d56745a014d4d12bcc514d1fd98447b/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:39:30.809750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d569e-4448-46de-94f9-b73c0c6e218a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:30.821143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d569e-4448-46de-94f9-b73c0c6e218a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:30.887278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083f628-873b-4749-be9f-6dcd3dc74e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:30.887960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f628-873b-4749-be9f-6dcd3dc74e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:30.888249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f628-873b-4749-be9f-6dcd3dc74e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:30.888573 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f628-873b-4749-be9f-6dcd3dc74e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:30.889307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083f628-873b-4749-be9f-6dcd3dc74e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:30.891550 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083f628-873b-4749-be9f-6dcd3dc74e36 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:30.909223 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1237/2432] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:39:30.910693 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e5184-2c9a-4000-a55e-5b7eda2a3789 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:30.921565 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e5184-2c9a-4000-a55e-5b7eda2a3789 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:30.926622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e7540-39f6-459a-a06b-72b9a38efadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:30.927568 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e7540-39f6-459a-a06b-72b9a38efadd admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:30.927864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e7540-39f6-459a-a06b-72b9a38efadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:30.928159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e7540-39f6-459a-a06b-72b9a38efadd admin admin] PATH_INFO: `/v3/projects/229a376694984d26a63117f0030f31eb/users/2d56745a014d4d12bcc514d1fd98447b/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:30.930243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e7540-39f6-459a-a06b-72b9a38efadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=229a376694984d26a63117f0030f31eb, user_id=2d56745a014d4d12bcc514d1fd98447b, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:30.932975 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e7540-39f6-459a-a06b-72b9a38efadd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:30.945059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1196/2433] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:39:30 2022] PUT /identity/v3/projects/229a376694984d26a63117f0030f31eb/users/2d56745a014d4d12bcc514d1fd98447b/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:39:36.464298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c8a6a-1370-4e09-90b8-24f56cb34cd5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:36.464859 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c8a6a-1370-4e09-90b8-24f56cb34cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:36.464959 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c8a6a-1370-4e09-90b8-24f56cb34cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:36.493615 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-043c8a6a-1370-4e09-90b8-24f56cb34cd5 None None] MFA Rules not processed for user `2d56745a014d4d12bcc514d1fd98447b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:36.495107 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-043c8a6a-1370-4e09-90b8-24f56cb34cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:36.592533 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1238/2434] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:39:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:36.607008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e7540-39f6-459a-a06b-72b9a38efadd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:36.609410 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f80e7540-39f6-459a-a06b-72b9a38efadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:36.675616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:36.680669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e7540-39f6-459a-a06b-72b9a38efadd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:36.685635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2f819-4239-49ce-a3f6-226b49208ee0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93958c7dad0540b296b316169932d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:36.686570 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2f819-4239-49ce-a3f6-226b49208ee0 service glance] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:36.687420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2f819-4239-49ce-a3f6-226b49208ee0 service glance] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:36.687897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2f819-4239-49ce-a3f6-226b49208ee0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:36.760482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2f819-4239-49ce-a3f6-226b49208ee0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:36.762101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2f819-4239-49ce-a3f6-226b49208ee0 service glance] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:36.774207 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1197/2435] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:39:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:39:36.893088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dfa4f-5874-4f37-8ba0-d002b2b2f7a4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:36.893519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dfa4f-5874-4f37-8ba0-d002b2b2f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:36.893906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dfa4f-5874-4f37-8ba0-d002b2b2f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:36.918264 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-396dfa4f-5874-4f37-8ba0-d002b2b2f7a4 None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:36.919749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-396dfa4f-5874-4f37-8ba0-d002b2b2f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:36.942480 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:36.997421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1239/2436] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:39:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:37.009816 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2f819-4239-49ce-a3f6-226b49208ee0 service glance] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:37.011317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a2c2f819-4239-49ce-a3f6-226b49208ee0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:37.084652 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2f819-4239-49ce-a3f6-226b49208ee0 service glance] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:37.089602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72dd4b-058e-4c9e-8fb1-5dc495499519 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:37.090237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72dd4b-058e-4c9e-8fb1-5dc495499519 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:37.090523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72dd4b-058e-4c9e-8fb1-5dc495499519 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:37.090808 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72dd4b-058e-4c9e-8fb1-5dc495499519 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:37.100313 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72dd4b-058e-4c9e-8fb1-5dc495499519 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:37.101965 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72dd4b-058e-4c9e-8fb1-5dc495499519 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:37.111386 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1198/2437] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:39:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 20:39:39.488062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904902c7-0680-4ffe-84a1-f7707293d9af None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:39.488651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904902c7-0680-4ffe-84a1-f7707293d9af None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:39.488651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904902c7-0680-4ffe-84a1-f7707293d9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:39.516369 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-904902c7-0680-4ffe-84a1-f7707293d9af None None] MFA Rules not processed for user `145cee1016d349ceb93323a170bc957e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:39.517793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-904902c7-0680-4ffe-84a1-f7707293d9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:39.628468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1240/2438] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:39:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:47.094496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189c213-75ee-4b80-a99a-1b5539ab8352 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:47.094995 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189c213-75ee-4b80-a99a-1b5539ab8352 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:47.095092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189c213-75ee-4b80-a99a-1b5539ab8352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:47.115363 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d189c213-75ee-4b80-a99a-1b5539ab8352 None None] MFA Rules not processed for user `30a573525d244ab3ab69095db8871f20`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:47.116687 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d189c213-75ee-4b80-a99a-1b5539ab8352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:47.125017 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1199/2439] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:39:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:47.620085 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904902c7-0680-4ffe-84a1-f7707293d9af None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:47.622067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-904902c7-0680-4ffe-84a1-f7707293d9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:47.718701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904902c7-0680-4ffe-84a1-f7707293d9af None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:47.724240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f02b1-2f66-4743-b40c-44e73ace4875 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6693dd1ea26049c1ac8460faf1bc9b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:47.726038 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f02b1-2f66-4743-b40c-44e73ace4875 service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:47.727539 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f02b1-2f66-4743-b40c-44e73ace4875 service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:47.728240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f02b1-2f66-4743-b40c-44e73ace4875 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:47.731180 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3c3f02b1-2f66-4743-b40c-44e73ace4875 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:47.749977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f02b1-2f66-4743-b40c-44e73ace4875 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:47.751626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f02b1-2f66-4743-b40c-44e73ace4875 service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:47.763053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1241/2440] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:39:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:39:49.505109 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132a3ad-653a-40fe-a8ee-90c530f0e717 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:49.506007 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132a3ad-653a-40fe-a8ee-90c530f0e717 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:49.506435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132a3ad-653a-40fe-a8ee-90c530f0e717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:49.525333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f132a3ad-653a-40fe-a8ee-90c530f0e717 None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:39:49.526558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f132a3ad-653a-40fe-a8ee-90c530f0e717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:39:49.535578 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1200/2441] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:39:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:39:49.565761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f02b1-2f66-4743-b40c-44e73ace4875 service placement] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:39:49.578184 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f02b1-2f66-4743-b40c-44e73ace4875 service placement] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:39:49.600050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bf2df-9521-4d61-bc8c-e279b35c25f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:39:49.601144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bf2df-9521-4d61-bc8c-e279b35c25f7 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:39:49.601443 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bf2df-9521-4d61-bc8c-e279b35c25f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:39:49.601728 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bf2df-9521-4d61-bc8c-e279b35c25f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:39:49.615674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bf2df-9521-4d61-bc8c-e279b35c25f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:39:49.617561 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bf2df-9521-4d61-bc8c-e279b35c25f7 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:39:49.631369 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1242/2442] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:39:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 20:39:59.520444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=64 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:59.626143 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=80 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:00.097483 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132a3ad-653a-40fe-a8ee-90c530f0e717 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:00.099024 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f132a3ad-653a-40fe-a8ee-90c530f0e717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:00.172980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132a3ad-653a-40fe-a8ee-90c530f0e717 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:00.182599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b17300-79be-4bc1-acc0-b48f2199e0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:00.183743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b17300-79be-4bc1-acc0-b48f2199e0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:00.184033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b17300-79be-4bc1-acc0-b48f2199e0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:00.184316 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b17300-79be-4bc1-acc0-b48f2199e0e4 admin admin] PATH_INFO: `/v3/users/c2e50b081c4c46c7a2d85b2855c81e00` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:00.185911 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b17300-79be-4bc1-acc0-b48f2199e0e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e50b081c4c46c7a2d85b2855c81e00)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:00.188484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b17300-79be-4bc1-acc0-b48f2199e0e4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:00.243249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-41b17300-79be-4bc1-acc0-b48f2199e0e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e50b081c4c46c7a2d85b2855c81e00'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:40:00.262569 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-41b17300-79be-4bc1-acc0-b48f2199e0e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e50b081c4c46c7a2d85b2855c81e00'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:40:00.263287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-41b17300-79be-4bc1-acc0-b48f2199e0e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e50b081c4c46c7a2d85b2855c81e00'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:40:00.274481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-41b17300-79be-4bc1-acc0-b48f2199e0e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e50b081c4c46c7a2d85b2855c81e00'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:40:00.275434 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-41b17300-79be-4bc1-acc0-b48f2199e0e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e50b081c4c46c7a2d85b2855c81e00'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:40:00.293730 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1201/2443] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:40:00 2022] DELETE /identity/v3/users/c2e50b081c4c46c7a2d85b2855c81e00 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:40:00.298185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185569c-22fc-4789-a32e-eaa91b1ee427 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:00.298482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185569c-22fc-4789-a32e-eaa91b1ee427 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:00.298791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185569c-22fc-4789-a32e-eaa91b1ee427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:00.316994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2185569c-22fc-4789-a32e-eaa91b1ee427 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:40:00.318186 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2185569c-22fc-4789-a32e-eaa91b1ee427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:00.377771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1243/2444] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:40:00.387991 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b17300-79be-4bc1-acc0-b48f2199e0e4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:00.390050 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-41b17300-79be-4bc1-acc0-b48f2199e0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:00.447084 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b17300-79be-4bc1-acc0-b48f2199e0e4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:00.450901 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104c668-c5df-4b3e-97ba-b7b3114fb778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:00.452674 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104c668-c5df-4b3e-97ba-b7b3114fb778 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:00.452891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104c668-c5df-4b3e-97ba-b7b3114fb778 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:00.453213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104c668-c5df-4b3e-97ba-b7b3114fb778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:00.463008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104c668-c5df-4b3e-97ba-b7b3114fb778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:00.464554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104c668-c5df-4b3e-97ba-b7b3114fb778 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:00.474667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1202/2445] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:40:00.741213 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185569c-22fc-4789-a32e-eaa91b1ee427 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:00.742963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2185569c-22fc-4789-a32e-eaa91b1ee427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:00.763391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185569c-22fc-4789-a32e-eaa91b1ee427 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:00.771141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9498f-a468-470b-9006-cc1e02cd8cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:00.772282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9498f-a468-470b-9006-cc1e02cd8cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:00.772724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9498f-a468-470b-9006-cc1e02cd8cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:00.772909 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9498f-a468-470b-9006-cc1e02cd8cdc admin admin] PATH_INFO: `/v3/projects/fa56a97c7ebc4f648c56d2e4fd8de8c5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:00.774353 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9498f-a468-470b-9006-cc1e02cd8cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa56a97c7ebc4f648c56d2e4fd8de8c5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:00.777280 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9498f-a468-470b-9006-cc1e02cd8cdc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:00.825482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3fb9498f-a468-470b-9006-cc1e02cd8cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa56a97c7ebc4f648c56d2e4fd8de8c5', 'request_id': 'req-3fb9498f-a468-470b-9006-cc1e02cd8cdc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:40:00.831709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3fb9498f-a468-470b-9006-cc1e02cd8cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa56a97c7ebc4f648c56d2e4fd8de8c5', 'request_id': 'req-3fb9498f-a468-470b-9006-cc1e02cd8cdc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:40:00.837368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3fb9498f-a468-470b-9006-cc1e02cd8cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa56a97c7ebc4f648c56d2e4fd8de8c5', 'request_id': 'req-3fb9498f-a468-470b-9006-cc1e02cd8cdc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:40:00.849850 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3fb9498f-a468-470b-9006-cc1e02cd8cdc admin admin] The token cache is being invalidate because project fa56a97c7ebc4f648c56d2e4fd8de8c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:40:00.850142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3fb9498f-a468-470b-9006-cc1e02cd8cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:40:00.850785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3fb9498f-a468-470b-9006-cc1e02cd8cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:40:00.852334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1244/2446] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:40:00 2022] DELETE /identity/v3/projects/fa56a97c7ebc4f648c56d2e4fd8de8c5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:40:00.857947 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d85dd-9e01-45a0-8680-227e8ab639cb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:00.858450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d85dd-9e01-45a0-8680-227e8ab639cb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:00.858558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d85dd-9e01-45a0-8680-227e8ab639cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:00.877110 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-848d85dd-9e01-45a0-8680-227e8ab639cb None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:40:00.878312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-848d85dd-9e01-45a0-8680-227e8ab639cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:00.896789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:00.946447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1203/2447] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:40:00.955155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6e39-ab26-4b91-a7bc-afc2ea011e60 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:00.955450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6e39-ab26-4b91-a7bc-afc2ea011e60 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:00.955731 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6e39-ab26-4b91-a7bc-afc2ea011e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:00.974977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b72c6e39-ab26-4b91-a7bc-afc2ea011e60 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:40:00.976215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b72c6e39-ab26-4b91-a7bc-afc2ea011e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:00.985154 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1245/2448] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:40:00.989607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d85dd-9e01-45a0-8680-227e8ab639cb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:01.000141 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d85dd-9e01-45a0-8680-227e8ab639cb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:01.004906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cad689-7ec0-47e4-8ba2-1c3290c40b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:01.005684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cad689-7ec0-47e4-8ba2-1c3290c40b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:01.006038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cad689-7ec0-47e4-8ba2-1c3290c40b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:01.006396 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cad689-7ec0-47e4-8ba2-1c3290c40b0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:01.007211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cad689-7ec0-47e4-8ba2-1c3290c40b0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:40:01.007583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cad689-7ec0-47e4-8ba2-1c3290c40b0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:01.009300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cad689-7ec0-47e4-8ba2-1c3290c40b0d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:01.024346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1204/2449] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:40:01.025652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c6e39-ab26-4b91-a7bc-afc2ea011e60 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:01.036000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c6e39-ab26-4b91-a7bc-afc2ea011e60 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:01.040806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674cc47-fc86-42d4-a831-a54c4ad06c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:01.041765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674cc47-fc86-42d4-a831-a54c4ad06c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:01.042108 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674cc47-fc86-42d4-a831-a54c4ad06c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:01.042396 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674cc47-fc86-42d4-a831-a54c4ad06c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:01.043095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674cc47-fc86-42d4-a831-a54c4ad06c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:01.045572 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674cc47-fc86-42d4-a831-a54c4ad06c4a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:01.074868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1246/2450] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:40:01 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:40:01.076621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cad689-7ec0-47e4-8ba2-1c3290c40b0d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:01.086455 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cad689-7ec0-47e4-8ba2-1c3290c40b0d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:01.148238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f2d48-ab27-423b-b058-5ddffbad6542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:01.148949 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f2d48-ab27-423b-b058-5ddffbad6542 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:01.149237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f2d48-ab27-423b-b058-5ddffbad6542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:01.149512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f2d48-ab27-423b-b058-5ddffbad6542 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:01.150196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f2d48-ab27-423b-b058-5ddffbad6542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:01.152127 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f2d48-ab27-423b-b058-5ddffbad6542 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:01.175530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1205/2451] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:40:01 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:40:01.179616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674cc47-fc86-42d4-a831-a54c4ad06c4a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:01.190196 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674cc47-fc86-42d4-a831-a54c4ad06c4a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:01.195509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee016758-13ca-4e4b-b64e-0b553a2db77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:01.196329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee016758-13ca-4e4b-b64e-0b553a2db77f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:01.196665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee016758-13ca-4e4b-b64e-0b553a2db77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:01.196988 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee016758-13ca-4e4b-b64e-0b553a2db77f admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:01.197872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee016758-13ca-4e4b-b64e-0b553a2db77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:01.199748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee016758-13ca-4e4b-b64e-0b553a2db77f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:01.210908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1247/2452] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:40:01.214844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f2d48-ab27-423b-b058-5ddffbad6542 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:01.226331 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f2d48-ab27-423b-b058-5ddffbad6542 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:01.231206 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5abbb8-8c59-4505-8481-e8d39ee5a6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:01.231879 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5abbb8-8c59-4505-8481-e8d39ee5a6bf admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:01.232181 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5abbb8-8c59-4505-8481-e8d39ee5a6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:01.233101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5abbb8-8c59-4505-8481-e8d39ee5a6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:01.234068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5abbb8-8c59-4505-8481-e8d39ee5a6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:01.235690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5abbb8-8c59-4505-8481-e8d39ee5a6bf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:01.247354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1206/2453] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:40:01.252890 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee016758-13ca-4e4b-b64e-0b553a2db77f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:01.265040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee016758-13ca-4e4b-b64e-0b553a2db77f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:01.272837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5c245-988b-482f-9181-0eaa18cd9269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:01.273910 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5c245-988b-482f-9181-0eaa18cd9269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:01.274337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5c245-988b-482f-9181-0eaa18cd9269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:01.274790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5c245-988b-482f-9181-0eaa18cd9269 admin admin] PATH_INFO: `/v3/projects/13e1593c67704dbbafad13310ca35448/users/e2e27fccbf854a8b8c9d6d099893f783/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:01.293242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5c245-988b-482f-9181-0eaa18cd9269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e1593c67704dbbafad13310ca35448, user_id=e2e27fccbf854a8b8c9d6d099893f783, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:01.297779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5c245-988b-482f-9181-0eaa18cd9269 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:01.332681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1248/2454] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:40:01 2022] PUT /identity/v3/projects/13e1593c67704dbbafad13310ca35448/users/e2e27fccbf854a8b8c9d6d099893f783/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:40:01.333170 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd8a72-f2d5-4fed-be4c-2e123655ad74 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:01.333758 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd8a72-f2d5-4fed-be4c-2e123655ad74 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:01.334163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd8a72-f2d5-4fed-be4c-2e123655ad74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:01.359805 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b8fd8a72-f2d5-4fed-be4c-2e123655ad74 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:40:01.361330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b8fd8a72-f2d5-4fed-be4c-2e123655ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:01.564652 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1207/2455] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:40:01.574744 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5c245-988b-482f-9181-0eaa18cd9269 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:01.577120 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-70b5c245-988b-482f-9181-0eaa18cd9269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:01.600962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:01.640376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5c245-988b-482f-9181-0eaa18cd9269 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:01.644150 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c1b86-b739-4fa6-9ce7-0a4e2fbcad6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:01.644851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c1b86-b739-4fa6-9ce7-0a4e2fbcad6e service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:01.645134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c1b86-b739-4fa6-9ce7-0a4e2fbcad6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:01.645409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c1b86-b739-4fa6-9ce7-0a4e2fbcad6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:01.655003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c1b86-b739-4fa6-9ce7-0a4e2fbcad6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:01.656486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c1b86-b739-4fa6-9ce7-0a4e2fbcad6e service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:01.666720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1249/2456] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:40:07.006087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa9120-866f-4f64-901c-d989548c7b43 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:07.006546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa9120-866f-4f64-901c-d989548c7b43 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:07.007327 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa9120-866f-4f64-901c-d989548c7b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:07.043721 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ebaa9120-866f-4f64-901c-d989548c7b43 None None] MFA Rules not processed for user `e2e27fccbf854a8b8c9d6d099893f783`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:40:07.046379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ebaa9120-866f-4f64-901c-d989548c7b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:07.087096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:07.159188 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1208/2457] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:40:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:40:07.160700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c1b86-b739-4fa6-9ce7-0a4e2fbcad6e service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:07.177921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c1b86-b739-4fa6-9ce7-0a4e2fbcad6e service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:07.182990 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f433c19-6635-4d52-9957-ca1758681188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:07.183888 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f433c19-6635-4d52-9957-ca1758681188 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:07.184176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f433c19-6635-4d52-9957-ca1758681188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:07.184514 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f433c19-6635-4d52-9957-ca1758681188 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:07.185476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f433c19-6635-4d52-9957-ca1758681188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:07.192026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f433c19-6635-4d52-9957-ca1758681188 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:07.222265 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1250/2458] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:40:07 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:40:07.226275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa9120-866f-4f64-901c-d989548c7b43 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:07.238392 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa9120-866f-4f64-901c-d989548c7b43 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:07.297747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96ac2d-5fe9-4d4d-8f87-13bc1026de97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:07.298431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96ac2d-5fe9-4d4d-8f87-13bc1026de97 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:07.298864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96ac2d-5fe9-4d4d-8f87-13bc1026de97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:07.299147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96ac2d-5fe9-4d4d-8f87-13bc1026de97 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:07.299867 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96ac2d-5fe9-4d4d-8f87-13bc1026de97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:07.301847 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96ac2d-5fe9-4d4d-8f87-13bc1026de97 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:07.329296 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1209/2459] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:40:07 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:40:07.333615 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f433c19-6635-4d52-9957-ca1758681188 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:07.345329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f433c19-6635-4d52-9957-ca1758681188 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:07.350124 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b3bd5-ee66-4d18-8060-5f314fa127e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:07.350972 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b3bd5-ee66-4d18-8060-5f314fa127e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:07.351329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b3bd5-ee66-4d18-8060-5f314fa127e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:07.351683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b3bd5-ee66-4d18-8060-5f314fa127e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:07.352531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b3bd5-ee66-4d18-8060-5f314fa127e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:07.354221 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b3bd5-ee66-4d18-8060-5f314fa127e2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:07.366630 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1251/2460] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:40:07.370955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96ac2d-5fe9-4d4d-8f87-13bc1026de97 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:07.382167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96ac2d-5fe9-4d4d-8f87-13bc1026de97 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:07.396318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0f42e-4769-407e-b16d-c59120224103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:07.397290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0f42e-4769-407e-b16d-c59120224103 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:07.397643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0f42e-4769-407e-b16d-c59120224103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:07.398098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0f42e-4769-407e-b16d-c59120224103 admin admin] PATH_INFO: `/v3/projects/5f4833ade1b146408b2a5b653f179fb2/users/5204aba60887459eb502e7345a6c39fc/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:07.417023 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0f42e-4769-407e-b16d-c59120224103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4833ade1b146408b2a5b653f179fb2, user_id=5204aba60887459eb502e7345a6c39fc, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:07.420438 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0f42e-4769-407e-b16d-c59120224103 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:07.436706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1210/2461] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:40:07 2022] PUT /identity/v3/projects/5f4833ade1b146408b2a5b653f179fb2/users/5204aba60887459eb502e7345a6c39fc/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:40:07.440739 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b3bd5-ee66-4d18-8060-5f314fa127e2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:07.452581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b3bd5-ee66-4d18-8060-5f314fa127e2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:07.536636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618c069-0407-4286-ac49-7bf70cd3af91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:07.537439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618c069-0407-4286-ac49-7bf70cd3af91 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:07.537783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618c069-0407-4286-ac49-7bf70cd3af91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:07.538406 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618c069-0407-4286-ac49-7bf70cd3af91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:07.538860 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618c069-0407-4286-ac49-7bf70cd3af91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:07.540509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618c069-0407-4286-ac49-7bf70cd3af91 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:07.557220 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0f42e-4769-407e-b16d-c59120224103 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:07.558200 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1252/2462] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:40:07.568294 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0f42e-4769-407e-b16d-c59120224103 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:07.573044 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5be35b-acfb-4021-91d9-216d44cff92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:07.573936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5be35b-acfb-4021-91d9-216d44cff92b admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:07.574216 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5be35b-acfb-4021-91d9-216d44cff92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:07.574490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5be35b-acfb-4021-91d9-216d44cff92b admin admin] PATH_INFO: `/v3/projects/5f4833ade1b146408b2a5b653f179fb2/users/5204aba60887459eb502e7345a6c39fc/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:07.577043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5be35b-acfb-4021-91d9-216d44cff92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4833ade1b146408b2a5b653f179fb2, user_id=5204aba60887459eb502e7345a6c39fc, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:07.579692 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5be35b-acfb-4021-91d9-216d44cff92b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:07.594939 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1211/2463] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:40:07 2022] PUT /identity/v3/projects/5f4833ade1b146408b2a5b653f179fb2/users/5204aba60887459eb502e7345a6c39fc/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:40:12.785530 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda457f-b5d9-476b-8364-b3e23d2daed4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:12.786036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda457f-b5d9-476b-8364-b3e23d2daed4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:12.786036 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda457f-b5d9-476b-8364-b3e23d2daed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:12.827742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5dda457f-b5d9-476b-8364-b3e23d2daed4 None None] MFA Rules not processed for user `5204aba60887459eb502e7345a6c39fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:40:12.828992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5dda457f-b5d9-476b-8364-b3e23d2daed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:12.931154 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1253/2464] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:40:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:40:13.023922 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5be35b-acfb-4021-91d9-216d44cff92b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:13.026704 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1b5be35b-acfb-4021-91d9-216d44cff92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:13.138760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5be35b-acfb-4021-91d9-216d44cff92b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:13.148833 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b8b89-4be5-4d18-99ac-d2684031b17c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:13.149844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b8b89-4be5-4d18-99ac-d2684031b17c service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:13.150461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b8b89-4be5-4d18-99ac-d2684031b17c service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:13.150933 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b8b89-4be5-4d18-99ac-d2684031b17c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:13.168656 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:13.240644 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b8b89-4be5-4d18-99ac-d2684031b17c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:13.242338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b8b89-4be5-4d18-99ac-d2684031b17c service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:13.252875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1212/2465] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:40:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:40:15.170970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a2e64-25d2-4be3-aab4-4b6f991e46e0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:15.171582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a2e64-25d2-4be3-aab4-4b6f991e46e0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:15.172772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a2e64-25d2-4be3-aab4-4b6f991e46e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:15.203373 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-da1a2e64-25d2-4be3-aab4-4b6f991e46e0 None None] MFA Rules not processed for user `e2e27fccbf854a8b8c9d6d099893f783`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:40:15.206019 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-da1a2e64-25d2-4be3-aab4-4b6f991e46e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:15.233447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1254/2466] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:40:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:40:23.248775 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=24 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:25.195193 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:30.788895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b8b89-4be5-4d18-99ac-d2684031b17c service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:30.849852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b8b89-4be5-4d18-99ac-d2684031b17c service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:30.859614 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dbc9a-44c7-4450-802f-abce0ff0cf59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:30.860552 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dbc9a-44c7-4450-802f-abce0ff0cf59 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:30.860842 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dbc9a-44c7-4450-802f-abce0ff0cf59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:30.861207 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dbc9a-44c7-4450-802f-abce0ff0cf59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:30.863962 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f81dbc9a-44c7-4450-802f-abce0ff0cf59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:30.936996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dbc9a-44c7-4450-802f-abce0ff0cf59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:30.938482 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dbc9a-44c7-4450-802f-abce0ff0cf59 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:30.948780 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1213/2467] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:40:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:40:40.884173 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb8802-0aa6-4393-8dd0-5dfa00c4ee50 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:40.884763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb8802-0aa6-4393-8dd0-5dfa00c4ee50 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:40.884763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb8802-0aa6-4393-8dd0-5dfa00c4ee50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:40.908517 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e7eb8802-0aa6-4393-8dd0-5dfa00c4ee50 None None] MFA Rules not processed for user `c0b5962b37b2470099436609425f7423`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:40:40.909825 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e7eb8802-0aa6-4393-8dd0-5dfa00c4ee50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:40:40.944534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=50 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:40.977871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1255/2468] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:40:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:40:50.971052 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=25 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:56.520236 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dbc9a-44c7-4450-802f-abce0ff0cf59 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:40:56.529506 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dbc9a-44c7-4450-802f-abce0ff0cf59 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:40:56.533456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b012ef0-c5a0-4400-9b7c-ee170d8b0a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:40:56.534148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b012ef0-c5a0-4400-9b7c-ee170d8b0a66 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:40:56.534433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b012ef0-c5a0-4400-9b7c-ee170d8b0a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:40:56.534706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b012ef0-c5a0-4400-9b7c-ee170d8b0a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:40:56.543929 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b012ef0-c5a0-4400-9b7c-ee170d8b0a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:40:56.545473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b012ef0-c5a0-4400-9b7c-ee170d8b0a66 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:40:56.555479 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1214/2469] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:40:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:04.776141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb8802-0aa6-4393-8dd0-5dfa00c4ee50 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:04.777632 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e7eb8802-0aa6-4393-8dd0-5dfa00c4ee50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:04.849057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb8802-0aa6-4393-8dd0-5dfa00c4ee50 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:04.853436 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd79a5-5d53-4477-8d9f-8039f9e0fc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:04.854312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd79a5-5d53-4477-8d9f-8039f9e0fc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:04.854597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd79a5-5d53-4477-8d9f-8039f9e0fc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:04.854873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd79a5-5d53-4477-8d9f-8039f9e0fc99 admin admin] PATH_INFO: `/v3/users/145cee1016d349ceb93323a170bc957e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:04.856045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd79a5-5d53-4477-8d9f-8039f9e0fc99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=145cee1016d349ceb93323a170bc957e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:04.858157 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd79a5-5d53-4477-8d9f-8039f9e0fc99 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:04.902808 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a9cd79a5-5d53-4477-8d9f-8039f9e0fc99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145cee1016d349ceb93323a170bc957e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:04.911294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a9cd79a5-5d53-4477-8d9f-8039f9e0fc99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145cee1016d349ceb93323a170bc957e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:04.918387 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a9cd79a5-5d53-4477-8d9f-8039f9e0fc99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145cee1016d349ceb93323a170bc957e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:04.919105 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a9cd79a5-5d53-4477-8d9f-8039f9e0fc99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145cee1016d349ceb93323a170bc957e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:04.932613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a9cd79a5-5d53-4477-8d9f-8039f9e0fc99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145cee1016d349ceb93323a170bc957e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:04.938787 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1256/2470] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:41:04 2022] DELETE /identity/v3/users/145cee1016d349ceb93323a170bc957e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:41:05.115038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b012ef0-c5a0-4400-9b7c-ee170d8b0a66 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:05.127096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b012ef0-c5a0-4400-9b7c-ee170d8b0a66 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:05.186312 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abee82a-1401-43f4-a152-aec51be548bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:05.187102 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abee82a-1401-43f4-a152-aec51be548bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:05.187433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abee82a-1401-43f4-a152-aec51be548bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:05.187711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abee82a-1401-43f4-a152-aec51be548bc admin admin] PATH_INFO: `/v3/projects/1e9f9e0f8edb42848965b3c6141e88d0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:05.188906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abee82a-1401-43f4-a152-aec51be548bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e9f9e0f8edb42848965b3c6141e88d0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:05.190813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abee82a-1401-43f4-a152-aec51be548bc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:05.236680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2abee82a-1401-43f4-a152-aec51be548bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9f9e0f8edb42848965b3c6141e88d0', 'request_id': 'req-2abee82a-1401-43f4-a152-aec51be548bc'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:05.243868 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2abee82a-1401-43f4-a152-aec51be548bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9f9e0f8edb42848965b3c6141e88d0', 'request_id': 'req-2abee82a-1401-43f4-a152-aec51be548bc'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:05.251015 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2abee82a-1401-43f4-a152-aec51be548bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9f9e0f8edb42848965b3c6141e88d0', 'request_id': 'req-2abee82a-1401-43f4-a152-aec51be548bc'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:05.261156 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2abee82a-1401-43f4-a152-aec51be548bc admin admin] The token cache is being invalidate because project 1e9f9e0f8edb42848965b3c6141e88d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:41:05.261434 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2abee82a-1401-43f4-a152-aec51be548bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:05.262068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2abee82a-1401-43f4-a152-aec51be548bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:05.264541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1215/2471] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:41:05 2022] DELETE /identity/v3/projects/1e9f9e0f8edb42848965b3c6141e88d0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:41:05.269760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711411-62af-4323-bde7-4966d0d3487f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:05.270099 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711411-62af-4323-bde7-4966d0d3487f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:05.270405 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711411-62af-4323-bde7-4966d0d3487f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:05.288509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a6711411-62af-4323-bde7-4966d0d3487f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:05.289720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a6711411-62af-4323-bde7-4966d0d3487f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:05.355366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1257/2472] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:05.419534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6b1d1-3485-4077-823a-e4c8706fa320 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:05.419918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6b1d1-3485-4077-823a-e4c8706fa320 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:05.420303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6b1d1-3485-4077-823a-e4c8706fa320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:05.440452 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-09b6b1d1-3485-4077-823a-e4c8706fa320 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:05.441597 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-09b6b1d1-3485-4077-823a-e4c8706fa320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:05.450999 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1216/2473] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:05.455400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711411-62af-4323-bde7-4966d0d3487f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:05.465154 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711411-62af-4323-bde7-4966d0d3487f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:05.470276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6664c-21b7-4d4c-a864-1a9c36611922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:05.470944 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6664c-21b7-4d4c-a864-1a9c36611922 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:05.471228 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6664c-21b7-4d4c-a864-1a9c36611922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:05.471505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6664c-21b7-4d4c-a864-1a9c36611922 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:05.472235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6664c-21b7-4d4c-a864-1a9c36611922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:41:05.472580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6664c-21b7-4d4c-a864-1a9c36611922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:05.474177 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6664c-21b7-4d4c-a864-1a9c36611922 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:05.486067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1258/2474] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:41:05.490583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6b1d1-3485-4077-823a-e4c8706fa320 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:05.500995 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6b1d1-3485-4077-823a-e4c8706fa320 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:05.505667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e821131-7bb8-4ac4-bf0c-d5f0a090be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:05.506309 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e821131-7bb8-4ac4-bf0c-d5f0a090be3a admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:05.506593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e821131-7bb8-4ac4-bf0c-d5f0a090be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:05.506878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e821131-7bb8-4ac4-bf0c-d5f0a090be3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:05.507565 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e821131-7bb8-4ac4-bf0c-d5f0a090be3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:05.509505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e821131-7bb8-4ac4-bf0c-d5f0a090be3a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:05.536446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1217/2475] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:41:05 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:41:05.540715 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6664c-21b7-4d4c-a864-1a9c36611922 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:05.550941 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6664c-21b7-4d4c-a864-1a9c36611922 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:05.554482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:05.610112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaaafc-1381-497f-affc-b710e1237592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:05.610782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaaafc-1381-497f-affc-b710e1237592 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:05.611072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaaafc-1381-497f-affc-b710e1237592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:05.611354 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaaafc-1381-497f-affc-b710e1237592 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:05.612053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaaafc-1381-497f-affc-b710e1237592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:05.614018 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaaafc-1381-497f-affc-b710e1237592 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:05.633460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1259/2476] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:41:05 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:41:05.638450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e821131-7bb8-4ac4-bf0c-d5f0a090be3a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:05.648604 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e821131-7bb8-4ac4-bf0c-d5f0a090be3a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:05.653274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641d90f-e8f8-49d0-95a8-aa9c79fce930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:05.654464 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641d90f-e8f8-49d0-95a8-aa9c79fce930 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:05.654749 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641d90f-e8f8-49d0-95a8-aa9c79fce930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:05.655025 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641d90f-e8f8-49d0-95a8-aa9c79fce930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:05.655744 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641d90f-e8f8-49d0-95a8-aa9c79fce930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:05.657378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641d90f-e8f8-49d0-95a8-aa9c79fce930 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:05.667882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1218/2477] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:41:05.671822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaaafc-1381-497f-affc-b710e1237592 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:05.681873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaaafc-1381-497f-affc-b710e1237592 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:05.686617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a7246-9dab-49c6-9e81-ab471fc4a9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:05.687275 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a7246-9dab-49c6-9e81-ab471fc4a9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:05.687566 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a7246-9dab-49c6-9e81-ab471fc4a9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:05.687863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a7246-9dab-49c6-9e81-ab471fc4a9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:05.688608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a7246-9dab-49c6-9e81-ab471fc4a9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:05.690223 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a7246-9dab-49c6-9e81-ab471fc4a9f2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:05.701520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1260/2478] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:41:05.705498 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641d90f-e8f8-49d0-95a8-aa9c79fce930 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:05.715297 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641d90f-e8f8-49d0-95a8-aa9c79fce930 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:05.720909 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cf46-1074-447d-becc-500af5683486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:05.721777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cf46-1074-447d-becc-500af5683486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:05.722064 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cf46-1074-447d-becc-500af5683486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:05.722342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cf46-1074-447d-becc-500af5683486 admin admin] PATH_INFO: `/v3/projects/3f3bb54c45b24ca79701d1c8389a1a2a/users/da4715e1f7894c9c85adcd084b9eef25/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:05.736598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0cf46-1074-447d-becc-500af5683486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3bb54c45b24ca79701d1c8389a1a2a, user_id=da4715e1f7894c9c85adcd084b9eef25, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:05.739253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0cf46-1074-447d-becc-500af5683486 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:05.752043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1219/2479] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:41:05 2022] PUT /identity/v3/projects/3f3bb54c45b24ca79701d1c8389a1a2a/users/da4715e1f7894c9c85adcd084b9eef25/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:41:05.762101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f6079-3379-4699-9d8b-c27ac75df784 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:05.762430 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f6079-3379-4699-9d8b-c27ac75df784 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:05.763349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f6079-3379-4699-9d8b-c27ac75df784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:05.789918 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-979f6079-3379-4699-9d8b-c27ac75df784 None None] MFA Rules not processed for user `da4715e1f7894c9c85adcd084b9eef25`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:05.791385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-979f6079-3379-4699-9d8b-c27ac75df784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:05.855259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1261/2480] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:41:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:05.865984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cf46-1074-447d-becc-500af5683486 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:05.867677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-84e0cf46-1074-447d-becc-500af5683486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:05.882185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:05.926896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cf46-1074-447d-becc-500af5683486 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:05.930483 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fbe2c-0b52-4fa4-a0bd-3ae5a3937c74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:05.931125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fbe2c-0b52-4fa4-a0bd-3ae5a3937c74 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:05.931411 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fbe2c-0b52-4fa4-a0bd-3ae5a3937c74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:05.931686 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fbe2c-0b52-4fa4-a0bd-3ae5a3937c74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:05.940539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fbe2c-0b52-4fa4-a0bd-3ae5a3937c74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:05.941969 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fbe2c-0b52-4fa4-a0bd-3ae5a3937c74 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:05.951333 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1220/2481] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:15.852451 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:15.946669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=20 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:25.197208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f6079-3379-4699-9d8b-c27ac75df784 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:25.262065 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f6079-3379-4699-9d8b-c27ac75df784 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:25.266918 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abfd5d-86ea-4a46-b7f2-e27d4270e74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:25.268068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abfd5d-86ea-4a46-b7f2-e27d4270e74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:25.268377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abfd5d-86ea-4a46-b7f2-e27d4270e74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:25.268895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abfd5d-86ea-4a46-b7f2-e27d4270e74b admin admin] PATH_INFO: `/v3/users/da4715e1f7894c9c85adcd084b9eef25` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:25.270383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abfd5d-86ea-4a46-b7f2-e27d4270e74b admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4715e1f7894c9c85adcd084b9eef25)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:25.272521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abfd5d-86ea-4a46-b7f2-e27d4270e74b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:25.337926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-87abfd5d-86ea-4a46-b7f2-e27d4270e74b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4715e1f7894c9c85adcd084b9eef25'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:25.348793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-87abfd5d-86ea-4a46-b7f2-e27d4270e74b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4715e1f7894c9c85adcd084b9eef25'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:25.356919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-87abfd5d-86ea-4a46-b7f2-e27d4270e74b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4715e1f7894c9c85adcd084b9eef25'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:25.358873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-87abfd5d-86ea-4a46-b7f2-e27d4270e74b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4715e1f7894c9c85adcd084b9eef25'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:25.371385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-87abfd5d-86ea-4a46-b7f2-e27d4270e74b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4715e1f7894c9c85adcd084b9eef25'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:25.378200 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1262/2482] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:41:25 2022] DELETE /identity/v3/users/da4715e1f7894c9c85adcd084b9eef25 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:41:25.382829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820fac8-d0b1-4f83-9481-94d772e40623 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:25.383287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820fac8-d0b1-4f83-9481-94d772e40623 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:25.383383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820fac8-d0b1-4f83-9481-94d772e40623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:25.404849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2820fac8-d0b1-4f83-9481-94d772e40623 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:25.406630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2820fac8-d0b1-4f83-9481-94d772e40623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:25.475386 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1221/2483] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:41:25.486274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abfd5d-86ea-4a46-b7f2-e27d4270e74b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:25.487718 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-87abfd5d-86ea-4a46-b7f2-e27d4270e74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:25.545975 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abfd5d-86ea-4a46-b7f2-e27d4270e74b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:25.549701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e5984-9bbe-4dc1-b655-2ac90a68ac73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:25.550352 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5984-9bbe-4dc1-b655-2ac90a68ac73 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:25.550833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5984-9bbe-4dc1-b655-2ac90a68ac73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:25.551383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5984-9bbe-4dc1-b655-2ac90a68ac73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:25.563461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e5984-9bbe-4dc1-b655-2ac90a68ac73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:25.564998 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e5984-9bbe-4dc1-b655-2ac90a68ac73 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:25.574712 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1263/2484] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:25.893992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820fac8-d0b1-4f83-9481-94d772e40623 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:25.895468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2820fac8-d0b1-4f83-9481-94d772e40623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:25.908230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820fac8-d0b1-4f83-9481-94d772e40623 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:25.913034 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:25.913899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:25.914185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:25.914466 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] PATH_INFO: `/v3/projects/3f3bb54c45b24ca79701d1c8389a1a2a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:25.915649 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3bb54c45b24ca79701d1c8389a1a2a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:25.917859 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:25.964746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3bb54c45b24ca79701d1c8389a1a2a', 'request_id': 'req-c6bffa7a-2f26-4e55-a322-92769b531ee5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:25.972576 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3bb54c45b24ca79701d1c8389a1a2a', 'request_id': 'req-c6bffa7a-2f26-4e55-a322-92769b531ee5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:25.978815 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3bb54c45b24ca79701d1c8389a1a2a', 'request_id': 'req-c6bffa7a-2f26-4e55-a322-92769b531ee5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:25.989701 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] The token cache is being invalidate because project 3f3bb54c45b24ca79701d1c8389a1a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:41:25.990020 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:25.990650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:41:25.992166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1222/2485] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:41:25 2022] DELETE /identity/v3/projects/3f3bb54c45b24ca79701d1c8389a1a2a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:41:27.754604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5e14b-5b30-4a4c-ac09-ed7707b0a76d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:27.755080 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5e14b-5b30-4a4c-ac09-ed7707b0a76d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:27.755188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5e14b-5b30-4a4c-ac09-ed7707b0a76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:27.772701 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-11d5e14b-5b30-4a4c-ac09-ed7707b0a76d None None] MFA Rules not processed for user `e13d5d7068e348248387b512c55dec5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:41:27.773901 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-11d5e14b-5b30-4a4c-ac09-ed7707b0a76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:27.791106 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:27.830443 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1264/2486] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:41:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:41:35.986694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:37.823061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=15 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:40.939848 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:40.941335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:40.996473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bffa7a-2f26-4e55-a322-92769b531ee5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:41.001196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e97ba-b825-45e7-876b-34634ddb5024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:41.001873 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e97ba-b825-45e7-876b-34634ddb5024 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:41.002161 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e97ba-b825-45e7-876b-34634ddb5024 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:41.002442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e97ba-b825-45e7-876b-34634ddb5024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:41.004231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-160e97ba-b825-45e7-876b-34634ddb5024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:41.074897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e97ba-b825-45e7-876b-34634ddb5024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:41.076447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e97ba-b825-45e7-876b-34634ddb5024 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:41.087180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1223/2487] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:44.598952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5e14b-5b30-4a4c-ac09-ed7707b0a76d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:44.608762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5e14b-5b30-4a4c-ac09-ed7707b0a76d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:44.612282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e61735-b55c-458a-a6c9-05da20d8d83b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:44.612952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e61735-b55c-458a-a6c9-05da20d8d83b service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:44.613238 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e61735-b55c-458a-a6c9-05da20d8d83b service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:44.613519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e61735-b55c-458a-a6c9-05da20d8d83b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:44.615302 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-51e61735-b55c-458a-a6c9-05da20d8d83b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:44.628835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e61735-b55c-458a-a6c9-05da20d8d83b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:44.630269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e61735-b55c-458a-a6c9-05da20d8d83b service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:44.641915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1265/2488] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:51.082411 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=54 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:53.819593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e97ba-b825-45e7-876b-34634ddb5024 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:41:53.821025 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-160e97ba-b825-45e7-876b-34634ddb5024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:53.877791 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e97ba-b825-45e7-876b-34634ddb5024 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:41:53.881422 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d97b28-c395-4feb-a4d0-685c59495d0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:41:53.882059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97b28-c395-4feb-a4d0-685c59495d0f service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:41:53.882347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97b28-c395-4feb-a4d0-685c59495d0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:41:53.882628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97b28-c395-4feb-a4d0-685c59495d0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:41:53.884421 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-51d97b28-c395-4feb-a4d0-685c59495d0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:41:53.944453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d97b28-c395-4feb-a4d0-685c59495d0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:41:53.945897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d97b28-c395-4feb-a4d0-685c59495d0f service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:41:53.955462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1224/2489] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:41:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:41:54.636328 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:03.085578 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fec4a-5daf-444b-b29f-3fa1354ea6e0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:03.086179 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fec4a-5daf-444b-b29f-3fa1354ea6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:03.086179 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fec4a-5daf-444b-b29f-3fa1354ea6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:03.104687 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5e9fec4a-5daf-444b-b29f-3fa1354ea6e0 None None] MFA Rules not processed for user `c0b5962b37b2470099436609425f7423`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:03.105926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5e9fec4a-5daf-444b-b29f-3fa1354ea6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:03.112952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1266/2490] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:42:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:03.412525 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d97b28-c395-4feb-a4d0-685c59495d0f service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:03.422719 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d97b28-c395-4feb-a4d0-685c59495d0f service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:03.426388 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363f253-e335-4cdf-84c3-eee412e28697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:03.427053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363f253-e335-4cdf-84c3-eee412e28697 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:03.427340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363f253-e335-4cdf-84c3-eee412e28697 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:03.427617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363f253-e335-4cdf-84c3-eee412e28697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:03.429412 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5363f253-e335-4cdf-84c3-eee412e28697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:03.439475 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363f253-e335-4cdf-84c3-eee412e28697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:03.441034 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363f253-e335-4cdf-84c3-eee412e28697 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:03.449592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1225/2491] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:03.983674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fec4a-5daf-444b-b29f-3fa1354ea6e0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:03.985088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5e9fec4a-5daf-444b-b29f-3fa1354ea6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:04.065025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fec4a-5daf-444b-b29f-3fa1354ea6e0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:04.070241 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa8f0a-7c45-48d0-804f-e75e0378deef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6693dd1ea26049c1ac8460faf1bc9b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:04.070917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa8f0a-7c45-48d0-804f-e75e0378deef service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:04.071202 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa8f0a-7c45-48d0-804f-e75e0378deef service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:04.071478 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa8f0a-7c45-48d0-804f-e75e0378deef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:04.073229 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-10fa8f0a-7c45-48d0-804f-e75e0378deef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:04.084682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa8f0a-7c45-48d0-804f-e75e0378deef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:04.086211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa8f0a-7c45-48d0-804f-e75e0378deef service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:04.096723 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1267/2492] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:05.847317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363f253-e335-4cdf-84c3-eee412e28697 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:05.848906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5363f253-e335-4cdf-84c3-eee412e28697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:05.860104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363f253-e335-4cdf-84c3-eee412e28697 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:05.863756 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14440340-0e01-4340-bdea-245945c5823e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:05.864453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14440340-0e01-4340-bdea-245945c5823e service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:05.864787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14440340-0e01-4340-bdea-245945c5823e service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:05.865062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14440340-0e01-4340-bdea-245945c5823e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:05.866834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-14440340-0e01-4340-bdea-245945c5823e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:05.877103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14440340-0e01-4340-bdea-245945c5823e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:05.878547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14440340-0e01-4340-bdea-245945c5823e service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:05.887275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1226/2493] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:11.719189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa8f0a-7c45-48d0-804f-e75e0378deef service placement] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:11.720635 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-10fa8f0a-7c45-48d0-804f-e75e0378deef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:11.732125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa8f0a-7c45-48d0-804f-e75e0378deef service placement] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:11.735888 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8da2d3-b8ec-4812-92b0-a7150885eb3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:11.736574 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8da2d3-b8ec-4812-92b0-a7150885eb3e service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:11.736862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8da2d3-b8ec-4812-92b0-a7150885eb3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:11.737138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8da2d3-b8ec-4812-92b0-a7150885eb3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:11.738908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-af8da2d3-b8ec-4812-92b0-a7150885eb3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:11.751184 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8da2d3-b8ec-4812-92b0-a7150885eb3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:11.752665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8da2d3-b8ec-4812-92b0-a7150885eb3e service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:11.761859 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1268/2494] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:15.883126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=60 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:17.238898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14440340-0e01-4340-bdea-245945c5823e service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:17.241139 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-14440340-0e01-4340-bdea-245945c5823e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:17.259881 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14440340-0e01-4340-bdea-245945c5823e service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:17.266097 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39104b-d57d-4ed8-9ca9-0ccde4c51652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:17.266779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39104b-d57d-4ed8-9ca9-0ccde4c51652 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:17.267066 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39104b-d57d-4ed8-9ca9-0ccde4c51652 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:17.267347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39104b-d57d-4ed8-9ca9-0ccde4c51652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:17.269142 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7a39104b-d57d-4ed8-9ca9-0ccde4c51652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:17.283205 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39104b-d57d-4ed8-9ca9-0ccde4c51652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:17.284844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39104b-d57d-4ed8-9ca9-0ccde4c51652 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:17.296003 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1227/2495] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:21.319978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8da2d3-b8ec-4812-92b0-a7150885eb3e service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:21.322245 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-af8da2d3-b8ec-4812-92b0-a7150885eb3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:21.342894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8da2d3-b8ec-4812-92b0-a7150885eb3e service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:21.349449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02364-9cc6-4009-8406-b9f8a39e6487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:21.350094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02364-9cc6-4009-8406-b9f8a39e6487 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:21.350384 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02364-9cc6-4009-8406-b9f8a39e6487 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:21.350666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02364-9cc6-4009-8406-b9f8a39e6487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:21.352474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b5f02364-9cc6-4009-8406-b9f8a39e6487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:21.373420 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f02364-9cc6-4009-8406-b9f8a39e6487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:21.375276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f02364-9cc6-4009-8406-b9f8a39e6487 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:21.393895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1269/2496] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:22.596832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d0e33-02ef-4b9a-934d-be31c64ec0f7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:22.597311 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d0e33-02ef-4b9a-934d-be31c64ec0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:22.597393 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d0e33-02ef-4b9a-934d-be31c64ec0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:22.617096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-812d0e33-02ef-4b9a-934d-be31c64ec0f7 None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:22.618331 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-812d0e33-02ef-4b9a-934d-be31c64ec0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:22.676941 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1228/2497] 10.222.0.66 () {58 vars in 967 bytes} [Fri Jul 15 20:42:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:22.720493 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02364-9cc6-4009-8406-b9f8a39e6487 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:22.721968 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b5f02364-9cc6-4009-8406-b9f8a39e6487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:22.795223 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02364-9cc6-4009-8406-b9f8a39e6487 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:22.800147 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d3657-3a2b-490c-9ed7-a5203dc89702 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:22.800836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d3657-3a2b-490c-9ed7-a5203dc89702 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:22.801246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d3657-3a2b-490c-9ed7-a5203dc89702 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:22.801534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d3657-3a2b-490c-9ed7-a5203dc89702 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:22.810310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d3657-3a2b-490c-9ed7-a5203dc89702 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:22.812055 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d3657-3a2b-490c-9ed7-a5203dc89702 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:22.820413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1270/2498] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:42:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 20:42:26.581492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d0e33-02ef-4b9a-934d-be31c64ec0f7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:26.594405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d0e33-02ef-4b9a-934d-be31c64ec0f7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:26.599372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f3775-90ed-45bf-96b3-ea5924e4d64b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6693dd1ea26049c1ac8460faf1bc9b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:26.600013 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3775-90ed-45bf-96b3-ea5924e4d64b service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:26.600323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3775-90ed-45bf-96b3-ea5924e4d64b service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:26.600630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3775-90ed-45bf-96b3-ea5924e4d64b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:26.602391 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d02f3775-90ed-45bf-96b3-ea5924e4d64b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:26.614632 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f3775-90ed-45bf-96b3-ea5924e4d64b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:26.616217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f3775-90ed-45bf-96b3-ea5924e4d64b service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:26.630642 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1229/2499] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:30.265400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d3657-3a2b-490c-9ed7-a5203dc89702 service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:30.267053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fd0d3657-3a2b-490c-9ed7-a5203dc89702 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:30.274790 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=80 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:30.352319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d3657-3a2b-490c-9ed7-a5203dc89702 service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:30.357004 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c336ac-c9b7-4f79-bb02-a5104745c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:30.357874 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c336ac-c9b7-4f79-bb02-a5104745c936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:30.358165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c336ac-c9b7-4f79-bb02-a5104745c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:30.358447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c336ac-c9b7-4f79-bb02-a5104745c936 admin admin] PATH_INFO: `/v3/users/30a573525d244ab3ab69095db8871f20` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:30.359870 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c336ac-c9b7-4f79-bb02-a5104745c936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a573525d244ab3ab69095db8871f20)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:30.361788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c336ac-c9b7-4f79-bb02-a5104745c936 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:30.426258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c2c336ac-c9b7-4f79-bb02-a5104745c936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a573525d244ab3ab69095db8871f20'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:30.436158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c2c336ac-c9b7-4f79-bb02-a5104745c936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a573525d244ab3ab69095db8871f20'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:30.446821 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c2c336ac-c9b7-4f79-bb02-a5104745c936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a573525d244ab3ab69095db8871f20'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:30.448420 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c2c336ac-c9b7-4f79-bb02-a5104745c936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a573525d244ab3ab69095db8871f20'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:30.465498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c2c336ac-c9b7-4f79-bb02-a5104745c936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a573525d244ab3ab69095db8871f20'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:30.476151 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1271/2500] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:42:30 2022] DELETE /identity/v3/users/30a573525d244ab3ab69095db8871f20 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:42:30.681261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f3775-90ed-45bf-96b3-ea5924e4d64b service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:30.695454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f3775-90ed-45bf-96b3-ea5924e4d64b service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:30.754413 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:30.756691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:30.756982 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:30.757286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] PATH_INFO: `/v3/projects/37d62130d6f74b8e919e429cbb3afc55` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:30.760839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d62130d6f74b8e919e429cbb3afc55)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:30.763637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:30.813437 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d62130d6f74b8e919e429cbb3afc55', 'request_id': 'req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:30.821364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d62130d6f74b8e919e429cbb3afc55', 'request_id': 'req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:30.830535 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d62130d6f74b8e919e429cbb3afc55', 'request_id': 'req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:30.843549 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] The token cache is being invalidate because project 37d62130d6f74b8e919e429cbb3afc55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:42:30.843891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:30.844648 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:30.846275 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1230/2501] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:42:30 2022] DELETE /identity/v3/projects/37d62130d6f74b8e919e429cbb3afc55 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:42:30.850276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c336ac-c9b7-4f79-bb02-a5104745c936 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:30.851712 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c2c336ac-c9b7-4f79-bb02-a5104745c936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:30.865899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c336ac-c9b7-4f79-bb02-a5104745c936 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:30.925877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71c72e-3568-4a3d-8f39-54731eb9f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:30.926786 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71c72e-3568-4a3d-8f39-54731eb9f535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:30.927050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71c72e-3568-4a3d-8f39-54731eb9f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:30.927330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71c72e-3568-4a3d-8f39-54731eb9f535 admin admin] PATH_INFO: `/v3/users/2d56745a014d4d12bcc514d1fd98447b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:30.928672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71c72e-3568-4a3d-8f39-54731eb9f535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d56745a014d4d12bcc514d1fd98447b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:30.930616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71c72e-3568-4a3d-8f39-54731eb9f535 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:30.957001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:30.988482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6b71c72e-3568-4a3d-8f39-54731eb9f535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d56745a014d4d12bcc514d1fd98447b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:30.995986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6b71c72e-3568-4a3d-8f39-54731eb9f535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d56745a014d4d12bcc514d1fd98447b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:31.003287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6b71c72e-3568-4a3d-8f39-54731eb9f535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d56745a014d4d12bcc514d1fd98447b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:31.004039 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6b71c72e-3568-4a3d-8f39-54731eb9f535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d56745a014d4d12bcc514d1fd98447b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:31.016498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6b71c72e-3568-4a3d-8f39-54731eb9f535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d56745a014d4d12bcc514d1fd98447b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:31.022554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1272/2502] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:42:30 2022] DELETE /identity/v3/users/2d56745a014d4d12bcc514d1fd98447b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:42:31.198143 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:31.199612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:31.212411 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5932ee-f5ab-45b7-97a0-68cdb5720b91 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:31.218253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:31.270698 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665a720-edf0-4826-bc0e-922678964e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:31.271564 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665a720-edf0-4826-bc0e-922678964e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:31.271849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665a720-edf0-4826-bc0e-922678964e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:31.272118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665a720-edf0-4826-bc0e-922678964e13 admin admin] PATH_INFO: `/v3/projects/229a376694984d26a63117f0030f31eb` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:31.273381 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665a720-edf0-4826-bc0e-922678964e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=229a376694984d26a63117f0030f31eb)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:31.275372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665a720-edf0-4826-bc0e-922678964e13 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:31.319622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9665a720-edf0-4826-bc0e-922678964e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229a376694984d26a63117f0030f31eb', 'request_id': 'req-9665a720-edf0-4826-bc0e-922678964e13'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:31.326893 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9665a720-edf0-4826-bc0e-922678964e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229a376694984d26a63117f0030f31eb', 'request_id': 'req-9665a720-edf0-4826-bc0e-922678964e13'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:31.333278 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9665a720-edf0-4826-bc0e-922678964e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229a376694984d26a63117f0030f31eb', 'request_id': 'req-9665a720-edf0-4826-bc0e-922678964e13'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:31.344146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9665a720-edf0-4826-bc0e-922678964e13 admin admin] The token cache is being invalidate because project 229a376694984d26a63117f0030f31eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:42:31.344468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9665a720-edf0-4826-bc0e-922678964e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:31.345100 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9665a720-edf0-4826-bc0e-922678964e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:31.347212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1231/2503] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:42:31 2022] DELETE /identity/v3/projects/229a376694984d26a63117f0030f31eb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:42:36.853612 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71c72e-3568-4a3d-8f39-54731eb9f535 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:36.855070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6b71c72e-3568-4a3d-8f39-54731eb9f535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:36.921535 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71c72e-3568-4a3d-8f39-54731eb9f535 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:36.983787 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360102d-3f2f-4e77-bfc0-103a5593915f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:36.984890 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360102d-3f2f-4e77-bfc0-103a5593915f service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:36.985290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360102d-3f2f-4e77-bfc0-103a5593915f service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:36.986100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360102d-3f2f-4e77-bfc0-103a5593915f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:36.989178 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a360102d-3f2f-4e77-bfc0-103a5593915f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:37.062748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360102d-3f2f-4e77-bfc0-103a5593915f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:37.064150 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360102d-3f2f-4e77-bfc0-103a5593915f service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:37.074366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1273/2504] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:40.583672 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28559613-9a91-4f9b-adcb-841c240e17c1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:40.584221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28559613-9a91-4f9b-adcb-841c240e17c1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:40.584221 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28559613-9a91-4f9b-adcb-841c240e17c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:40.604883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-28559613-9a91-4f9b-adcb-841c240e17c1 None None] MFA Rules not processed for user `75d12a685d9b419fa3606b5f4d1309fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:40.606961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-28559613-9a91-4f9b-adcb-841c240e17c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:40.675812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1232/2505] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:42:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:41.204905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360102d-3f2f-4e77-bfc0-103a5593915f service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:41.206382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a360102d-3f2f-4e77-bfc0-103a5593915f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:41.207392 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28559613-9a91-4f9b-adcb-841c240e17c1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:41.208893 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-28559613-9a91-4f9b-adcb-841c240e17c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:41.220142 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360102d-3f2f-4e77-bfc0-103a5593915f service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:41.223024 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28559613-9a91-4f9b-adcb-841c240e17c1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:41.225101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493a26f-7fe1-48d0-8b24-7bf65ee9743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:41.225977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493a26f-7fe1-48d0-8b24-7bf65ee9743e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:41.226323 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493a26f-7fe1-48d0-8b24-7bf65ee9743e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:41.226563 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493a26f-7fe1-48d0-8b24-7bf65ee9743e admin admin] PATH_INFO: `/v3/users/e13d5d7068e348248387b512c55dec5e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:41.226987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6480f1-781a-4ab1-9bca-76c0abf1d397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:41.227713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6480f1-781a-4ab1-9bca-76c0abf1d397 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:41.227827 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493a26f-7fe1-48d0-8b24-7bf65ee9743e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13d5d7068e348248387b512c55dec5e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:41.228240 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6480f1-781a-4ab1-9bca-76c0abf1d397 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:41.228619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6480f1-781a-4ab1-9bca-76c0abf1d397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:41.229731 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493a26f-7fe1-48d0-8b24-7bf65ee9743e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:41.230495 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-da6480f1-781a-4ab1-9bca-76c0abf1d397 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:41.231945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:41.243320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6480f1-781a-4ab1-9bca-76c0abf1d397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:41.244969 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6480f1-781a-4ab1-9bca-76c0abf1d397 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:41.254345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1233/2506] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:41.283487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b493a26f-7fe1-48d0-8b24-7bf65ee9743e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13d5d7068e348248387b512c55dec5e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:41.291121 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b493a26f-7fe1-48d0-8b24-7bf65ee9743e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13d5d7068e348248387b512c55dec5e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:41.298968 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b493a26f-7fe1-48d0-8b24-7bf65ee9743e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13d5d7068e348248387b512c55dec5e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:41.299690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b493a26f-7fe1-48d0-8b24-7bf65ee9743e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13d5d7068e348248387b512c55dec5e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:41.312659 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b493a26f-7fe1-48d0-8b24-7bf65ee9743e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13d5d7068e348248387b512c55dec5e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:41.319109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1274/2507] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:42:41 2022] DELETE /identity/v3/users/e13d5d7068e348248387b512c55dec5e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:42:41.518393 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6480f1-781a-4ab1-9bca-76c0abf1d397 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:41.532148 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6480f1-781a-4ab1-9bca-76c0abf1d397 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:41.567424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:41.606097 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1084ed-1270-4dc1-8050-fae9f63702cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:41.606917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1084ed-1270-4dc1-8050-fae9f63702cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:41.607200 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1084ed-1270-4dc1-8050-fae9f63702cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:41.607478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1084ed-1270-4dc1-8050-fae9f63702cb admin admin] PATH_INFO: `/v3/projects/0395d91380b34e968d7e39be3bc88b0f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:41.608722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1084ed-1270-4dc1-8050-fae9f63702cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0395d91380b34e968d7e39be3bc88b0f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:41.610696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1084ed-1270-4dc1-8050-fae9f63702cb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:41.660835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf1084ed-1270-4dc1-8050-fae9f63702cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0395d91380b34e968d7e39be3bc88b0f', 'request_id': 'req-cf1084ed-1270-4dc1-8050-fae9f63702cb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:41.669254 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf1084ed-1270-4dc1-8050-fae9f63702cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0395d91380b34e968d7e39be3bc88b0f', 'request_id': 'req-cf1084ed-1270-4dc1-8050-fae9f63702cb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:41.675709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf1084ed-1270-4dc1-8050-fae9f63702cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0395d91380b34e968d7e39be3bc88b0f', 'request_id': 'req-cf1084ed-1270-4dc1-8050-fae9f63702cb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:41.687024 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf1084ed-1270-4dc1-8050-fae9f63702cb admin admin] The token cache is being invalidate because project 0395d91380b34e968d7e39be3bc88b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:42:41.687461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf1084ed-1270-4dc1-8050-fae9f63702cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:41.688131 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf1084ed-1270-4dc1-8050-fae9f63702cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:42:41.689973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1234/2508] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:42:41 2022] DELETE /identity/v3/projects/0395d91380b34e968d7e39be3bc88b0f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:42:41.694595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dbb7d-7605-41c1-8f4d-80aa4ac6d345 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:41.694893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dbb7d-7605-41c1-8f4d-80aa4ac6d345 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:41.695177 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dbb7d-7605-41c1-8f4d-80aa4ac6d345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:41.713930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f02dbb7d-7605-41c1-8f4d-80aa4ac6d345 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:41.715226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f02dbb7d-7605-41c1-8f4d-80aa4ac6d345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:41.776156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1275/2509] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:41.785536 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39a6be-84d9-484a-b1d8-728d37548bef None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:41.785964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39a6be-84d9-484a-b1d8-728d37548bef None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:41.786345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39a6be-84d9-484a-b1d8-728d37548bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:41.811936 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ed39a6be-84d9-484a-b1d8-728d37548bef None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:41.813349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ed39a6be-84d9-484a-b1d8-728d37548bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:41.822905 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1235/2510] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:41.828064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dbb7d-7605-41c1-8f4d-80aa4ac6d345 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:41.838736 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dbb7d-7605-41c1-8f4d-80aa4ac6d345 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:41.844364 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fbe82-6228-4262-98ae-cc8f1c6c0666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:41.845234 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fbe82-6228-4262-98ae-cc8f1c6c0666 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:41.845675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fbe82-6228-4262-98ae-cc8f1c6c0666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:41.846132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fbe82-6228-4262-98ae-cc8f1c6c0666 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:41.847034 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fbe82-6228-4262-98ae-cc8f1c6c0666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:42:41.847560 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fbe82-6228-4262-98ae-cc8f1c6c0666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:41.849752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fbe82-6228-4262-98ae-cc8f1c6c0666 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:41.865286 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1276/2511] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:42:41.869891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39a6be-84d9-484a-b1d8-728d37548bef None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:41.880340 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39a6be-84d9-484a-b1d8-728d37548bef None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:41.885228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821a0c0-bb25-48fb-9412-16a101994455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:41.885887 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821a0c0-bb25-48fb-9412-16a101994455 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:41.886171 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821a0c0-bb25-48fb-9412-16a101994455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:41.887387 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821a0c0-bb25-48fb-9412-16a101994455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:41.888341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821a0c0-bb25-48fb-9412-16a101994455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:41.890292 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821a0c0-bb25-48fb-9412-16a101994455 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:41.919669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1236/2512] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:42:41 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:42:41.923749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fbe82-6228-4262-98ae-cc8f1c6c0666 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:41.935206 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fbe82-6228-4262-98ae-cc8f1c6c0666 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:41.994333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbcac4-4315-4448-9d26-a10787408683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:41.995101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbcac4-4315-4448-9d26-a10787408683 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:41.995394 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbcac4-4315-4448-9d26-a10787408683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:41.995670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbcac4-4315-4448-9d26-a10787408683 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:41.996524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbcac4-4315-4448-9d26-a10787408683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:41.999298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbcac4-4315-4448-9d26-a10787408683 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:42.009396 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:42.025411 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821a0c0-bb25-48fb-9412-16a101994455 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:42.030973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1277/2513] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:42:41 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:42:42.039234 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821a0c0-bb25-48fb-9412-16a101994455 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:42.044364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418f59f-2af4-4c04-bb5c-eb7393cedab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:42.045078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418f59f-2af4-4c04-bb5c-eb7393cedab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:42.045350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418f59f-2af4-4c04-bb5c-eb7393cedab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:42.045624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418f59f-2af4-4c04-bb5c-eb7393cedab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:42.046342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418f59f-2af4-4c04-bb5c-eb7393cedab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:42.048026 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418f59f-2af4-4c04-bb5c-eb7393cedab1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:42.058783 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1237/2514] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:42:42.062906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbcac4-4315-4448-9d26-a10787408683 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:42.073466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbcac4-4315-4448-9d26-a10787408683 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:42.079332 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849ea7c-e408-4e09-bf0e-8ec9e4d384b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:42.080007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849ea7c-e408-4e09-bf0e-8ec9e4d384b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:42.080299 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849ea7c-e408-4e09-bf0e-8ec9e4d384b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:42.080626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849ea7c-e408-4e09-bf0e-8ec9e4d384b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:42.081390 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849ea7c-e408-4e09-bf0e-8ec9e4d384b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:42.083617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849ea7c-e408-4e09-bf0e-8ec9e4d384b8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:42.094915 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1278/2515] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:42:42.099040 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418f59f-2af4-4c04-bb5c-eb7393cedab1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:42.109405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418f59f-2af4-4c04-bb5c-eb7393cedab1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:42.114331 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbb461-5344-42e5-a1d4-e8cc5a0408f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:42.115216 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbb461-5344-42e5-a1d4-e8cc5a0408f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:42.115497 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbb461-5344-42e5-a1d4-e8cc5a0408f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:42.115888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbb461-5344-42e5-a1d4-e8cc5a0408f6 admin admin] PATH_INFO: `/v3/projects/f852483a41394ef699c09ccee827fa28/users/fbe7070e9384403ca998a996e8dd6b50/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:42.131586 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbb461-5344-42e5-a1d4-e8cc5a0408f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f852483a41394ef699c09ccee827fa28, user_id=fbe7070e9384403ca998a996e8dd6b50, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:42.134349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbb461-5344-42e5-a1d4-e8cc5a0408f6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:42.149360 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1238/2516] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:42:42 2022] PUT /identity/v3/projects/f852483a41394ef699c09ccee827fa28/users/fbe7070e9384403ca998a996e8dd6b50/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:42:42.154992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9b0e-9071-4736-a375-6a2c1c17a4e2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:42.155358 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9b0e-9071-4736-a375-6a2c1c17a4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:42.155600 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9b0e-9071-4736-a375-6a2c1c17a4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:42.174426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9eae9b0e-9071-4736-a375-6a2c1c17a4e2 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:42.175648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9eae9b0e-9071-4736-a375-6a2c1c17a4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:42.239537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1279/2517] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:42.249726 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbb461-5344-42e5-a1d4-e8cc5a0408f6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:42.251499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-14bbb461-5344-42e5-a1d4-e8cc5a0408f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:42.326158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbb461-5344-42e5-a1d4-e8cc5a0408f6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:42.329854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd96a4-4d1f-452e-9186-c9515b350433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:42.330596 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd96a4-4d1f-452e-9186-c9515b350433 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:42.330856 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd96a4-4d1f-452e-9186-c9515b350433 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:42.331145 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd96a4-4d1f-452e-9186-c9515b350433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:42.340744 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd96a4-4d1f-452e-9186-c9515b350433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:42.342192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd96a4-4d1f-452e-9186-c9515b350433 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:42.352781 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:42.355042 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1239/2518] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:47.673416 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5590d-8080-42eb-b53f-98d84ecfd474 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:47.673969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5590d-8080-42eb-b53f-98d84ecfd474 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:47.673969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5590d-8080-42eb-b53f-98d84ecfd474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:47.729547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-16a5590d-8080-42eb-b53f-98d84ecfd474 None None] MFA Rules not processed for user `fbe7070e9384403ca998a996e8dd6b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:47.731015 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-16a5590d-8080-42eb-b53f-98d84ecfd474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:47.842727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1280/2519] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:42:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:47.858126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd96a4-4d1f-452e-9186-c9515b350433 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:47.859667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cdcd96a4-4d1f-452e-9186-c9515b350433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:47.947598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd96a4-4d1f-452e-9186-c9515b350433 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:47.953565 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a1c47-0d1b-4ddd-9bc3-42e07250aae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:47.954805 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a1c47-0d1b-4ddd-9bc3-42e07250aae6 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:47.954805 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a1c47-0d1b-4ddd-9bc3-42e07250aae6 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:47.954805 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a1c47-0d1b-4ddd-9bc3-42e07250aae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:47.963332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a1c47-0d1b-4ddd-9bc3-42e07250aae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:47.965895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a1c47-0d1b-4ddd-9bc3-42e07250aae6 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:47.976259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1240/2520] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:49.431828 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84992469-73cd-4ec7-9b13-fe37151ae451 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:49.432378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84992469-73cd-4ec7-9b13-fe37151ae451 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:49.432516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84992469-73cd-4ec7-9b13-fe37151ae451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:49.454101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-84992469-73cd-4ec7-9b13-fe37151ae451 None None] MFA Rules not processed for user `fbe7070e9384403ca998a996e8dd6b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:42:49.455367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-84992469-73cd-4ec7-9b13-fe37151ae451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:49.464333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1281/2521] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:42:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:42:50.367049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a1c47-0d1b-4ddd-9bc3-42e07250aae6 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:42:50.368661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-657a1c47-0d1b-4ddd-9bc3-42e07250aae6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:50.393030 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a1c47-0d1b-4ddd-9bc3-42e07250aae6 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:42:50.409374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2713de-e0af-47a1-bde7-8779d666fa26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:42:50.410503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2713de-e0af-47a1-bde7-8779d666fa26 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:42:50.410790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2713de-e0af-47a1-bde7-8779d666fa26 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:42:50.411245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2713de-e0af-47a1-bde7-8779d666fa26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:42:50.414324 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6e2713de-e0af-47a1-bde7-8779d666fa26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:42:50.431490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2713de-e0af-47a1-bde7-8779d666fa26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:42:50.433602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2713de-e0af-47a1-bde7-8779d666fa26 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:42:50.466513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1241/2522] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:42:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:42:59.447472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=69 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:00.449324 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=40 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:11.269964 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84992469-73cd-4ec7-9b13-fe37151ae451 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:11.271349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-84992469-73cd-4ec7-9b13-fe37151ae451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:11.284207 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84992469-73cd-4ec7-9b13-fe37151ae451 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:11.287901 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f93d5-91ff-4ded-b735-db5ad9d33c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:11.288589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f93d5-91ff-4ded-b735-db5ad9d33c2f service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:11.288885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f93d5-91ff-4ded-b735-db5ad9d33c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:11.289165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f93d5-91ff-4ded-b735-db5ad9d33c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:11.291163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b43f93d5-91ff-4ded-b735-db5ad9d33c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:11.303359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f93d5-91ff-4ded-b735-db5ad9d33c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:11.305016 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f93d5-91ff-4ded-b735-db5ad9d33c2f service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:11.315298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1282/2523] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:14.588876 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2713de-e0af-47a1-bde7-8779d666fa26 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:14.593453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6e2713de-e0af-47a1-bde7-8779d666fa26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:14.612802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2713de-e0af-47a1-bde7-8779d666fa26 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:14.617595 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c0f38-8f28-4220-ba14-ff9087f029de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:14.618484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c0f38-8f28-4220-ba14-ff9087f029de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:14.618763 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c0f38-8f28-4220-ba14-ff9087f029de admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:14.619038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c0f38-8f28-4220-ba14-ff9087f029de admin admin] PATH_INFO: `/v3/users/c0b5962b37b2470099436609425f7423` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:14.621134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c0f38-8f28-4220-ba14-ff9087f029de admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b5962b37b2470099436609425f7423)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:14.623014 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c0f38-8f28-4220-ba14-ff9087f029de admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:14.681463 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e85c0f38-8f28-4220-ba14-ff9087f029de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b5962b37b2470099436609425f7423'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:14.697308 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e85c0f38-8f28-4220-ba14-ff9087f029de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b5962b37b2470099436609425f7423'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:14.698028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e85c0f38-8f28-4220-ba14-ff9087f029de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b5962b37b2470099436609425f7423'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:14.705101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e85c0f38-8f28-4220-ba14-ff9087f029de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b5962b37b2470099436609425f7423'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:14.705756 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e85c0f38-8f28-4220-ba14-ff9087f029de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b5962b37b2470099436609425f7423'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:14.719342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1242/2524] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:43:14 2022] DELETE /identity/v3/users/c0b5962b37b2470099436609425f7423 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:14.900496 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f93d5-91ff-4ded-b735-db5ad9d33c2f service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:14.911987 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f93d5-91ff-4ded-b735-db5ad9d33c2f service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:14.973747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:14.974611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:14.974895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:14.975169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a admin admin] PATH_INFO: `/v3/projects/78a593e163e74a7b9db61133e5c22035` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:14.976341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a593e163e74a7b9db61133e5c22035)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:14.978289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:15.025368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a593e163e74a7b9db61133e5c22035', 'request_id': 'req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:15.033105 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a593e163e74a7b9db61133e5c22035', 'request_id': 'req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:15.038592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a593e163e74a7b9db61133e5c22035', 'request_id': 'req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:15.051924 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a admin admin] The token cache is being invalidate because project 78a593e163e74a7b9db61133e5c22035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:43:15.052215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:15.052877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4232568f-1b8a-41fe-9ab3-f4064a45ca2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:15.054515 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1283/2525] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:43:14 2022] DELETE /identity/v3/projects/78a593e163e74a7b9db61133e5c22035 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:15.059619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10200-1a96-4e58-9410-ae5b9eb21aa1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:15.059891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10200-1a96-4e58-9410-ae5b9eb21aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:15.060170 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10200-1a96-4e58-9410-ae5b9eb21aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:15.077925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b1f10200-1a96-4e58-9410-ae5b9eb21aa1 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:15.079106 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b1f10200-1a96-4e58-9410-ae5b9eb21aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:15.137424 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1243/2526] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:43:15.145055 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3a51e-d70e-4e88-a418-7dc0c3aea81c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:15.145356 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3a51e-d70e-4e88-a418-7dc0c3aea81c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:15.145642 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3a51e-d70e-4e88-a418-7dc0c3aea81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:15.288706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c0e3a51e-d70e-4e88-a418-7dc0c3aea81c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:15.289852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c0e3a51e-d70e-4e88-a418-7dc0c3aea81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:15.299053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1284/2527] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:15.303373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f10200-1a96-4e58-9410-ae5b9eb21aa1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:15.313802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f10200-1a96-4e58-9410-ae5b9eb21aa1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:15.318505 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133490a-7600-4595-b0f8-bb886e0e5db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:15.319163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133490a-7600-4595-b0f8-bb886e0e5db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:15.319448 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133490a-7600-4595-b0f8-bb886e0e5db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:15.319729 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133490a-7600-4595-b0f8-bb886e0e5db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:15.320490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133490a-7600-4595-b0f8-bb886e0e5db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:43:15.320799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133490a-7600-4595-b0f8-bb886e0e5db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:15.322433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133490a-7600-4595-b0f8-bb886e0e5db1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:15.333955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1244/2528] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:43:15.337999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3a51e-d70e-4e88-a418-7dc0c3aea81c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:15.347322 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3a51e-d70e-4e88-a418-7dc0c3aea81c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:15.352123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ea915-cc51-4505-b602-e1ac15835b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:15.352803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ea915-cc51-4505-b602-e1ac15835b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:15.353086 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ea915-cc51-4505-b602-e1ac15835b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:15.353359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ea915-cc51-4505-b602-e1ac15835b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:15.354053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ea915-cc51-4505-b602-e1ac15835b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:15.356499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ea915-cc51-4505-b602-e1ac15835b47 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:15.381602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1285/2529] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:43:15 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:43:15.385838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133490a-7600-4595-b0f8-bb886e0e5db1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:15.395873 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133490a-7600-4595-b0f8-bb886e0e5db1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:15.451242 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34583f-f87b-479e-bbf1-5ffa7fbb410b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:15.451912 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34583f-f87b-479e-bbf1-5ffa7fbb410b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:15.452225 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34583f-f87b-479e-bbf1-5ffa7fbb410b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:15.452538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34583f-f87b-479e-bbf1-5ffa7fbb410b admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:15.453238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34583f-f87b-479e-bbf1-5ffa7fbb410b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:15.455487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34583f-f87b-479e-bbf1-5ffa7fbb410b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:15.466012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:15.481721 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1245/2530] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:43:15 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:43:15.486398 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ea915-cc51-4505-b602-e1ac15835b47 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:15.497292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ea915-cc51-4505-b602-e1ac15835b47 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:15.501817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f8b62-4c2d-45f1-8727-4708e691bd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:15.502490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f8b62-4c2d-45f1-8727-4708e691bd13 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:15.502773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f8b62-4c2d-45f1-8727-4708e691bd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:15.503049 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f8b62-4c2d-45f1-8727-4708e691bd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:15.503771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f8b62-4c2d-45f1-8727-4708e691bd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:15.505402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f8b62-4c2d-45f1-8727-4708e691bd13 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:15.515465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1286/2531] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:43:15.519590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34583f-f87b-479e-bbf1-5ffa7fbb410b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:15.530133 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34583f-f87b-479e-bbf1-5ffa7fbb410b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:15.534760 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e9554-2339-468e-82de-6c9bde477073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:15.535419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e9554-2339-468e-82de-6c9bde477073 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:15.535706 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e9554-2339-468e-82de-6c9bde477073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:15.535984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e9554-2339-468e-82de-6c9bde477073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:15.536756 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e9554-2339-468e-82de-6c9bde477073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:15.538347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e9554-2339-468e-82de-6c9bde477073 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:15.549208 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1246/2532] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:43:15.553187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f8b62-4c2d-45f1-8727-4708e691bd13 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:15.563076 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f8b62-4c2d-45f1-8727-4708e691bd13 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:15.567534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe9925-a8c4-43d7-98e1-ebcf013935d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:15.568413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe9925-a8c4-43d7-98e1-ebcf013935d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:15.568696 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe9925-a8c4-43d7-98e1-ebcf013935d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:15.568970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe9925-a8c4-43d7-98e1-ebcf013935d7 admin admin] PATH_INFO: `/v3/projects/ff813ccaf61a48fe998c4447dc35c6f3/users/a30b38a10b8c41ac894d4beb9de74510/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:15.583274 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe9925-a8c4-43d7-98e1-ebcf013935d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff813ccaf61a48fe998c4447dc35c6f3, user_id=a30b38a10b8c41ac894d4beb9de74510, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:15.585931 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe9925-a8c4-43d7-98e1-ebcf013935d7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:15.599817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1287/2533] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:43:15 2022] PUT /identity/v3/projects/ff813ccaf61a48fe998c4447dc35c6f3/users/a30b38a10b8c41ac894d4beb9de74510/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:15.611029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdfebb-2123-412e-b30f-fd70fc0dc9ed None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:15.611486 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdfebb-2123-412e-b30f-fd70fc0dc9ed None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:15.611580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdfebb-2123-412e-b30f-fd70fc0dc9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:15.638065 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3ccdfebb-2123-412e-b30f-fd70fc0dc9ed None None] MFA Rules not processed for user `a30b38a10b8c41ac894d4beb9de74510`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:15.639273 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3ccdfebb-2123-412e-b30f-fd70fc0dc9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:15.702420 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1247/2534] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:15.713401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe9925-a8c4-43d7-98e1-ebcf013935d7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:15.715858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cffe9925-a8c4-43d7-98e1-ebcf013935d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:15.730633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:15.794087 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe9925-a8c4-43d7-98e1-ebcf013935d7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:15.799734 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95a0d7-36dd-441c-bfc6-6c3b059b5e4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:15.800324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95a0d7-36dd-441c-bfc6-6c3b059b5e4a service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:15.800641 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95a0d7-36dd-441c-bfc6-6c3b059b5e4a service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:15.800919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95a0d7-36dd-441c-bfc6-6c3b059b5e4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:15.809022 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95a0d7-36dd-441c-bfc6-6c3b059b5e4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:15.810584 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95a0d7-36dd-441c-bfc6-6c3b059b5e4a service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:15.822262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1288/2535] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:23.078287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdfebb-2123-412e-b30f-fd70fc0dc9ed None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:23.141182 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdfebb-2123-412e-b30f-fd70fc0dc9ed None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:23.145810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb176e3a-00cd-40a8-9701-e8b469deda13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:23.146682 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb176e3a-00cd-40a8-9701-e8b469deda13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:23.146968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb176e3a-00cd-40a8-9701-e8b469deda13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:23.147247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb176e3a-00cd-40a8-9701-e8b469deda13 admin admin] PATH_INFO: `/v3/users/a30b38a10b8c41ac894d4beb9de74510` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:23.148464 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb176e3a-00cd-40a8-9701-e8b469deda13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a30b38a10b8c41ac894d4beb9de74510)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:23.150725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb176e3a-00cd-40a8-9701-e8b469deda13 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:23.200373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fb176e3a-00cd-40a8-9701-e8b469deda13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a30b38a10b8c41ac894d4beb9de74510'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:23.212887 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fb176e3a-00cd-40a8-9701-e8b469deda13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a30b38a10b8c41ac894d4beb9de74510'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:23.214035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fb176e3a-00cd-40a8-9701-e8b469deda13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a30b38a10b8c41ac894d4beb9de74510'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:23.218753 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:23.222832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fb176e3a-00cd-40a8-9701-e8b469deda13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a30b38a10b8c41ac894d4beb9de74510'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:23.223747 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fb176e3a-00cd-40a8-9701-e8b469deda13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a30b38a10b8c41ac894d4beb9de74510'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:23.237851 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1248/2536] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:43:23 2022] DELETE /identity/v3/users/a30b38a10b8c41ac894d4beb9de74510 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:23.242423 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf54b7-d2a0-4a6d-9439-fe02325512d2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:23.242885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf54b7-d2a0-4a6d-9439-fe02325512d2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:23.243022 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf54b7-d2a0-4a6d-9439-fe02325512d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:23.261002 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f8cf54b7-d2a0-4a6d-9439-fe02325512d2 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:23.262230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f8cf54b7-d2a0-4a6d-9439-fe02325512d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:23.320223 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1289/2537] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:43:23.330010 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb176e3a-00cd-40a8-9701-e8b469deda13 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:23.331437 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fb176e3a-00cd-40a8-9701-e8b469deda13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:23.388833 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb176e3a-00cd-40a8-9701-e8b469deda13 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:23.392445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1814709-faf9-47d7-a5c0-3faf91fcc1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:23.393088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1814709-faf9-47d7-a5c0-3faf91fcc1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:23.393371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1814709-faf9-47d7-a5c0-3faf91fcc1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:23.393647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1814709-faf9-47d7-a5c0-3faf91fcc1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:23.403546 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1814709-faf9-47d7-a5c0-3faf91fcc1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:23.405059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1814709-faf9-47d7-a5c0-3faf91fcc1d7 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:23.414497 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1249/2538] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:23.693713 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf54b7-d2a0-4a6d-9439-fe02325512d2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:23.695190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f8cf54b7-d2a0-4a6d-9439-fe02325512d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:23.707213 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf54b7-d2a0-4a6d-9439-fe02325512d2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:23.712035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:23.712861 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:23.713145 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:23.713417 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310 admin admin] PATH_INFO: `/v3/projects/ff813ccaf61a48fe998c4447dc35c6f3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:23.715720 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff813ccaf61a48fe998c4447dc35c6f3)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:23.717678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:23.764617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff813ccaf61a48fe998c4447dc35c6f3', 'request_id': 'req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:23.770599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff813ccaf61a48fe998c4447dc35c6f3', 'request_id': 'req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:23.776026 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff813ccaf61a48fe998c4447dc35c6f3', 'request_id': 'req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:23.787818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310 admin admin] The token cache is being invalidate because project ff813ccaf61a48fe998c4447dc35c6f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:43:23.788215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:23.788861 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2a2b4586-12dc-4cca-89ac-a5e5ccabb310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:23.790666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1290/2539] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:43:23 2022] DELETE /identity/v3/projects/ff813ccaf61a48fe998c4447dc35c6f3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:23.796588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a239a85-cff5-4679-ac53-fe678cdfea65 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:23.796883 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a239a85-cff5-4679-ac53-fe678cdfea65 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:23.797166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a239a85-cff5-4679-ac53-fe678cdfea65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:23.816783 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3a239a85-cff5-4679-ac53-fe678cdfea65 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:23.817983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3a239a85-cff5-4679-ac53-fe678cdfea65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:23.875899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1250/2540] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:23.883391 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a87f7-4795-4ad8-8abd-1675678def0c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:23.883686 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a87f7-4795-4ad8-8abd-1675678def0c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:23.883967 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a87f7-4795-4ad8-8abd-1675678def0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:23.901891 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3f4a87f7-4795-4ad8-8abd-1675678def0c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:23.903168 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3f4a87f7-4795-4ad8-8abd-1675678def0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:23.911393 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1291/2541] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:23.915818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a239a85-cff5-4679-ac53-fe678cdfea65 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:23.926298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a239a85-cff5-4679-ac53-fe678cdfea65 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:23.931024 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce384b-afcd-41c9-b096-03256d6c11cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:23.931676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce384b-afcd-41c9-b096-03256d6c11cc admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:23.931958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce384b-afcd-41c9-b096-03256d6c11cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:23.932234 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce384b-afcd-41c9-b096-03256d6c11cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:23.933569 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce384b-afcd-41c9-b096-03256d6c11cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:43:23.933876 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce384b-afcd-41c9-b096-03256d6c11cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:23.935472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce384b-afcd-41c9-b096-03256d6c11cc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:23.947101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1251/2542] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:43:23.951906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a87f7-4795-4ad8-8abd-1675678def0c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:23.961357 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a87f7-4795-4ad8-8abd-1675678def0c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:23.966097 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6f881-fa2a-444e-8ff5-45de82768374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:23.966748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6f881-fa2a-444e-8ff5-45de82768374 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:23.967052 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6f881-fa2a-444e-8ff5-45de82768374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:23.967360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6f881-fa2a-444e-8ff5-45de82768374 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:23.968061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6f881-fa2a-444e-8ff5-45de82768374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:23.970038 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6f881-fa2a-444e-8ff5-45de82768374 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:23.984276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:23.999647 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1292/2543] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:43:23 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:43:24.003869 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce384b-afcd-41c9-b096-03256d6c11cc admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:24.014355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce384b-afcd-41c9-b096-03256d6c11cc admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:24.072519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e7021-d05a-4084-aa13-1966ebab12f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:24.073251 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e7021-d05a-4084-aa13-1966ebab12f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:24.073549 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e7021-d05a-4084-aa13-1966ebab12f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:24.073830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e7021-d05a-4084-aa13-1966ebab12f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:24.074768 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e7021-d05a-4084-aa13-1966ebab12f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:24.076802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e7021-d05a-4084-aa13-1966ebab12f7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:24.099852 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1252/2544] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:43:24 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:43:24.102008 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6f881-fa2a-444e-8ff5-45de82768374 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:24.113373 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6f881-fa2a-444e-8ff5-45de82768374 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:24.117920 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1912c24-a3b5-4aa6-8d90-6526770aca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:24.118648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1912c24-a3b5-4aa6-8d90-6526770aca3a admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:24.118997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1912c24-a3b5-4aa6-8d90-6526770aca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:24.119338 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1912c24-a3b5-4aa6-8d90-6526770aca3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:24.120919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1912c24-a3b5-4aa6-8d90-6526770aca3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:24.122534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1912c24-a3b5-4aa6-8d90-6526770aca3a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:24.133278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1293/2545] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:43:24.137690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e7021-d05a-4084-aa13-1966ebab12f7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:24.147578 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e7021-d05a-4084-aa13-1966ebab12f7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:24.152693 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e0f54-b158-4d59-8ab6-89d59ae2725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:24.153360 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0f54-b158-4d59-8ab6-89d59ae2725e admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:24.153648 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0f54-b158-4d59-8ab6-89d59ae2725e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:24.153930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0f54-b158-4d59-8ab6-89d59ae2725e admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:24.154655 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e0f54-b158-4d59-8ab6-89d59ae2725e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:24.156248 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e0f54-b158-4d59-8ab6-89d59ae2725e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:24.157583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:24.170137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1253/2546] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:43:24.173591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1912c24-a3b5-4aa6-8d90-6526770aca3a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:24.184135 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1912c24-a3b5-4aa6-8d90-6526770aca3a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:24.189480 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da858677-82df-4dea-bc00-1bca64ebb494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:24.190363 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da858677-82df-4dea-bc00-1bca64ebb494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:24.190649 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da858677-82df-4dea-bc00-1bca64ebb494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:24.190921 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da858677-82df-4dea-bc00-1bca64ebb494 admin admin] PATH_INFO: `/v3/projects/903ea9037db14ff4ad965c1abfcb56fd/users/5cffc33f997f491fa5715617146b73bb/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:24.206820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da858677-82df-4dea-bc00-1bca64ebb494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903ea9037db14ff4ad965c1abfcb56fd, user_id=5cffc33f997f491fa5715617146b73bb, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:24.209508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da858677-82df-4dea-bc00-1bca64ebb494 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:24.223658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1294/2547] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:43:24 2022] PUT /identity/v3/projects/903ea9037db14ff4ad965c1abfcb56fd/users/5cffc33f997f491fa5715617146b73bb/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:24.237556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86643117-d486-49fc-8707-14a63fb34b52 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:24.237556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86643117-d486-49fc-8707-14a63fb34b52 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:24.237556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86643117-d486-49fc-8707-14a63fb34b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:24.264942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-86643117-d486-49fc-8707-14a63fb34b52 None None] MFA Rules not processed for user `5cffc33f997f491fa5715617146b73bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:24.266176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-86643117-d486-49fc-8707-14a63fb34b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:24.279234 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c42a2b-716e-4c9f-90c7-1c1e0488da27 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:24.279813 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c42a2b-716e-4c9f-90c7-1c1e0488da27 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:24.279899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c42a2b-716e-4c9f-90c7-1c1e0488da27 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:24.282070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1295/2548] 10.222.0.66 () {54 vars in 921 bytes} [Fri Jul 15 20:43:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:24.291014 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf84474-6a76-43d3-98f3-dc86b0c32eea None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:24.291683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf84474-6a76-43d3-98f3-dc86b0c32eea None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:24.293594 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf84474-6a76-43d3-98f3-dc86b0c32eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:24.317211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2cf84474-6a76-43d3-98f3-dc86b0c32eea None None] MFA Rules not processed for user `633e05f021544b669749f941f40cbf58`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:24.318604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2cf84474-6a76-43d3-98f3-dc86b0c32eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:24.349460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1254/2549] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:24.361383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86643117-d486-49fc-8707-14a63fb34b52 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:24.363450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-86643117-d486-49fc-8707-14a63fb34b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:24.382778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1296/2550] 10.222.0.66 () {58 vars in 1018 bytes} [Fri Jul 15 20:43:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:43:24.404240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf84474-6a76-43d3-98f3-dc86b0c32eea None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:24.406619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2cf84474-6a76-43d3-98f3-dc86b0c32eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:24.418722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf84474-6a76-43d3-98f3-dc86b0c32eea None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:24.422505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0c421-e2cd-4308-bd43-d87cf543f056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:24.423155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0c421-e2cd-4308-bd43-d87cf543f056 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:24.423445 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0c421-e2cd-4308-bd43-d87cf543f056 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:24.423817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0c421-e2cd-4308-bd43-d87cf543f056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:24.424684 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86643117-d486-49fc-8707-14a63fb34b52 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:24.428947 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2559c-853f-40a1-a950-b741d2a2c922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:24.429688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2559c-853f-40a1-a950-b741d2a2c922 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:24.430037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2559c-853f-40a1-a950-b741d2a2c922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:24.430374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2559c-853f-40a1-a950-b741d2a2c922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:24.433746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0c421-e2cd-4308-bd43-d87cf543f056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:24.435205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0c421-e2cd-4308-bd43-d87cf543f056 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:24.443790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2559c-853f-40a1-a950-b741d2a2c922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:24.444409 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2559c-853f-40a1-a950-b741d2a2c922 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:24.446622 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1297/2551] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:43:24.455378 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1255/2552] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:43:24.533075 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc62ca-7e7d-4a1a-9f54-dd6f54edf5be None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:24.533493 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc62ca-7e7d-4a1a-9f54-dd6f54edf5be None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:24.533837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc62ca-7e7d-4a1a-9f54-dd6f54edf5be None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:24.535283 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1298/2553] 10.222.0.66 () {54 vars in 921 bytes} [Fri Jul 15 20:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:43:24.540873 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079fe2-6346-4df7-b960-9ddd8b86e97f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:24.541198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079fe2-6346-4df7-b960-9ddd8b86e97f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:24.541497 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079fe2-6346-4df7-b960-9ddd8b86e97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:24.561377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-05079fe2-6346-4df7-b960-9ddd8b86e97f None None] MFA Rules not processed for user `b042da9298894712a0a29787a343bf85`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:24.562573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-05079fe2-6346-4df7-b960-9ddd8b86e97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:24.640619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1256/2554] 10.222.0.66 () {58 vars in 1018 bytes} [Fri Jul 15 20:43:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:24.655901 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc62ca-7e7d-4a1a-9f54-dd6f54edf5be None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:24.658189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b7bc62ca-7e7d-4a1a-9f54-dd6f54edf5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:24.674680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc62ca-7e7d-4a1a-9f54-dd6f54edf5be None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:24.678637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362f94b-3500-4c44-9d46-56683bdb8189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:24.679401 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f94b-3500-4c44-9d46-56683bdb8189 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:24.679758 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f94b-3500-4c44-9d46-56683bdb8189 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:24.680217 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f94b-3500-4c44-9d46-56683bdb8189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:24.692266 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362f94b-3500-4c44-9d46-56683bdb8189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:24.693754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362f94b-3500-4c44-9d46-56683bdb8189 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:24.706637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1299/2555] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:31.279811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079fe2-6346-4df7-b960-9ddd8b86e97f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:31.281304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-05079fe2-6346-4df7-b960-9ddd8b86e97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:31.297575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079fe2-6346-4df7-b960-9ddd8b86e97f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:31.304039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08d9e7-eae4-4c6e-ae7c-4ce3c9e0a9f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:31.304730 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08d9e7-eae4-4c6e-ae7c-4ce3c9e0a9f6 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:31.305018 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08d9e7-eae4-4c6e-ae7c-4ce3c9e0a9f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:31.305301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08d9e7-eae4-4c6e-ae7c-4ce3c9e0a9f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:31.307112 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ff08d9e7-eae4-4c6e-ae7c-4ce3c9e0a9f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:31.326664 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:31.368621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08d9e7-eae4-4c6e-ae7c-4ce3c9e0a9f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:31.370800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08d9e7-eae4-4c6e-ae7c-4ce3c9e0a9f6 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:31.379971 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1257/2556] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:32.918869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362f94b-3500-4c44-9d46-56683bdb8189 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:32.992449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362f94b-3500-4c44-9d46-56683bdb8189 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:32.997149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d1df9-abdc-4718-a602-e8eaf75a684b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:32.998012 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d1df9-abdc-4718-a602-e8eaf75a684b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:32.998295 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d1df9-abdc-4718-a602-e8eaf75a684b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:32.998568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d1df9-abdc-4718-a602-e8eaf75a684b admin admin] PATH_INFO: `/v3/users/5cffc33f997f491fa5715617146b73bb` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:32.999748 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d1df9-abdc-4718-a602-e8eaf75a684b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cffc33f997f491fa5715617146b73bb)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:33.001908 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d1df9-abdc-4718-a602-e8eaf75a684b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:33.049430 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:33.052058 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3b9d1df9-abdc-4718-a602-e8eaf75a684b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cffc33f997f491fa5715617146b73bb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:33.067208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3b9d1df9-abdc-4718-a602-e8eaf75a684b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cffc33f997f491fa5715617146b73bb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:33.075202 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3b9d1df9-abdc-4718-a602-e8eaf75a684b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cffc33f997f491fa5715617146b73bb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:33.075843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3b9d1df9-abdc-4718-a602-e8eaf75a684b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cffc33f997f491fa5715617146b73bb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:33.087327 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3b9d1df9-abdc-4718-a602-e8eaf75a684b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cffc33f997f491fa5715617146b73bb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:33.093792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1300/2557] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:43:32 2022] DELETE /identity/v3/users/5cffc33f997f491fa5715617146b73bb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:33.098430 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297a909-49f6-4c5f-9aa6-08049c65ba17 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:33.098896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297a909-49f6-4c5f-9aa6-08049c65ba17 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:33.099001 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297a909-49f6-4c5f-9aa6-08049c65ba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:33.116350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3297a909-49f6-4c5f-9aa6-08049c65ba17 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:33.117586 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3297a909-49f6-4c5f-9aa6-08049c65ba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:33.176487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1258/2558] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:33.186644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d1df9-abdc-4718-a602-e8eaf75a684b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:33.188112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3b9d1df9-abdc-4718-a602-e8eaf75a684b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:33.249112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d1df9-abdc-4718-a602-e8eaf75a684b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:33.252655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a90c9-0170-4dc0-8a16-04ddbe22889d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:33.253307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a90c9-0170-4dc0-8a16-04ddbe22889d service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:33.253590 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a90c9-0170-4dc0-8a16-04ddbe22889d service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:33.253865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a90c9-0170-4dc0-8a16-04ddbe22889d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:33.263812 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a90c9-0170-4dc0-8a16-04ddbe22889d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:33.265314 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a90c9-0170-4dc0-8a16-04ddbe22889d service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:33.275500 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1301/2559] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:33.541248 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297a909-49f6-4c5f-9aa6-08049c65ba17 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:33.543790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3297a909-49f6-4c5f-9aa6-08049c65ba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:33.558885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297a909-49f6-4c5f-9aa6-08049c65ba17 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:33.564635 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:33.566021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:33.566190 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:33.566622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2 admin admin] PATH_INFO: `/v3/projects/903ea9037db14ff4ad965c1abfcb56fd` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:33.568354 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=903ea9037db14ff4ad965c1abfcb56fd)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:33.570325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:33.618866 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903ea9037db14ff4ad965c1abfcb56fd', 'request_id': 'req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:33.626094 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903ea9037db14ff4ad965c1abfcb56fd', 'request_id': 'req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:33.632198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903ea9037db14ff4ad965c1abfcb56fd', 'request_id': 'req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:33.642990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2 admin admin] The token cache is being invalidate because project 903ea9037db14ff4ad965c1abfcb56fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:43:33.643282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:33.643920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc1934ec-ad1f-4ca7-8d4b-6e679d08adb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:33.645470 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1259/2560] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:43:33 2022] DELETE /identity/v3/projects/903ea9037db14ff4ad965c1abfcb56fd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:33.650334 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bffdfa-31ff-41ef-a063-e5faf676550c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:33.650628 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bffdfa-31ff-41ef-a063-e5faf676550c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:33.650934 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bffdfa-31ff-41ef-a063-e5faf676550c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:33.669926 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e9bffdfa-31ff-41ef-a063-e5faf676550c None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:33.671631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e9bffdfa-31ff-41ef-a063-e5faf676550c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:33.734155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1302/2561] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:33.741882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50edfdd-76e0-4517-9c9e-83cc87fb5595 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:33.742172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50edfdd-76e0-4517-9c9e-83cc87fb5595 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:33.742451 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50edfdd-76e0-4517-9c9e-83cc87fb5595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:33.761860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c50edfdd-76e0-4517-9c9e-83cc87fb5595 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:33.763057 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c50edfdd-76e0-4517-9c9e-83cc87fb5595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:33.771060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1260/2562] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:33.775498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bffdfa-31ff-41ef-a063-e5faf676550c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:33.785863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bffdfa-31ff-41ef-a063-e5faf676550c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:33.790654 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b6110-5984-44f2-9e2d-12a07285a877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:33.791306 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6110-5984-44f2-9e2d-12a07285a877 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:33.791686 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6110-5984-44f2-9e2d-12a07285a877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:33.792149 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6110-5984-44f2-9e2d-12a07285a877 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:33.793343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b6110-5984-44f2-9e2d-12a07285a877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:43:33.793816 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b6110-5984-44f2-9e2d-12a07285a877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:33.795428 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b6110-5984-44f2-9e2d-12a07285a877 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:33.807311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1303/2563] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:43:33.811819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50edfdd-76e0-4517-9c9e-83cc87fb5595 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:33.820968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50edfdd-76e0-4517-9c9e-83cc87fb5595 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:33.826131 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a2eeb-3a22-4e67-bad4-485a02b3f27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:33.826779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a2eeb-3a22-4e67-bad4-485a02b3f27b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:33.827057 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a2eeb-3a22-4e67-bad4-485a02b3f27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:33.827327 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a2eeb-3a22-4e67-bad4-485a02b3f27b admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:33.828036 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a2eeb-3a22-4e67-bad4-485a02b3f27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:33.830014 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a2eeb-3a22-4e67-bad4-485a02b3f27b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:33.854710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1261/2564] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:43:33 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:43:33.858914 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b6110-5984-44f2-9e2d-12a07285a877 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:33.868876 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b6110-5984-44f2-9e2d-12a07285a877 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:33.917030 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:33.930903 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f783f-997e-4563-8eff-ddc4b1229abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:33.931691 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f783f-997e-4563-8eff-ddc4b1229abc admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:33.931984 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f783f-997e-4563-8eff-ddc4b1229abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:33.932853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f783f-997e-4563-8eff-ddc4b1229abc admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:33.933577 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f783f-997e-4563-8eff-ddc4b1229abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:33.935523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f783f-997e-4563-8eff-ddc4b1229abc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:33.958685 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1304/2565] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:43:33 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:43:33.963983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a2eeb-3a22-4e67-bad4-485a02b3f27b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:33.974737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a2eeb-3a22-4e67-bad4-485a02b3f27b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:33.979351 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1447d-a926-46cf-8cc8-7c3aaab05bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:33.980016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1447d-a926-46cf-8cc8-7c3aaab05bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:33.980299 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1447d-a926-46cf-8cc8-7c3aaab05bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:33.980611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1447d-a926-46cf-8cc8-7c3aaab05bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:33.981376 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1447d-a926-46cf-8cc8-7c3aaab05bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:33.982946 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1447d-a926-46cf-8cc8-7c3aaab05bf4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:33.994513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1262/2566] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:43:33.999094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f783f-997e-4563-8eff-ddc4b1229abc admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:34.009018 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f783f-997e-4563-8eff-ddc4b1229abc admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:34.014170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447a650-d486-4b46-8176-93bff162cbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:34.014826 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447a650-d486-4b46-8176-93bff162cbbb admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:34.015111 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447a650-d486-4b46-8176-93bff162cbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:34.015386 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447a650-d486-4b46-8176-93bff162cbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:34.016132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447a650-d486-4b46-8176-93bff162cbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:34.017766 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447a650-d486-4b46-8176-93bff162cbbb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:34.030683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1305/2567] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:43:34.034878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1447d-a926-46cf-8cc8-7c3aaab05bf4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:34.040325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:34.047326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1447d-a926-46cf-8cc8-7c3aaab05bf4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:34.053301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108bd3a-7ee1-4694-894d-3018b7b2fd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:34.054417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108bd3a-7ee1-4694-894d-3018b7b2fd13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:34.054700 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108bd3a-7ee1-4694-894d-3018b7b2fd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:34.055004 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108bd3a-7ee1-4694-894d-3018b7b2fd13 admin admin] PATH_INFO: `/v3/projects/77c9e7e22b6846cf8310589439231fed/users/5cfb1311bed249e39c01d7eae28baa96/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:34.069879 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108bd3a-7ee1-4694-894d-3018b7b2fd13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c9e7e22b6846cf8310589439231fed, user_id=5cfb1311bed249e39c01d7eae28baa96, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:34.072618 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108bd3a-7ee1-4694-894d-3018b7b2fd13 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:34.086462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1263/2568] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:43:34 2022] PUT /identity/v3/projects/77c9e7e22b6846cf8310589439231fed/users/5cfb1311bed249e39c01d7eae28baa96/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:34.097511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f904292-f857-42b5-9d80-3e3b12277e11 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:34.097853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f904292-f857-42b5-9d80-3e3b12277e11 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:34.098123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f904292-f857-42b5-9d80-3e3b12277e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:34.131499 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6f904292-f857-42b5-9d80-3e3b12277e11 None None] MFA Rules not processed for user `5cfb1311bed249e39c01d7eae28baa96`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:34.132777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6f904292-f857-42b5-9d80-3e3b12277e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:34.196737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1306/2569] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:34.201330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108bd3a-7ee1-4694-894d-3018b7b2fd13 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:34.263680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108bd3a-7ee1-4694-894d-3018b7b2fd13 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:34.269314 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05f6e1-ccae-46fc-81b7-2817c4dafb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:34.270112 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05f6e1-ccae-46fc-81b7-2817c4dafb78 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:34.270402 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05f6e1-ccae-46fc-81b7-2817c4dafb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:34.270685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05f6e1-ccae-46fc-81b7-2817c4dafb78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:34.271384 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05f6e1-ccae-46fc-81b7-2817c4dafb78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:34.273445 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05f6e1-ccae-46fc-81b7-2817c4dafb78 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:34.302766 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1264/2570] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:43:34 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:43:34.306734 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f904292-f857-42b5-9d80-3e3b12277e11 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:34.317533 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f904292-f857-42b5-9d80-3e3b12277e11 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:34.374104 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bd0d5-5564-407a-a760-319369817bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:34.374782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bd0d5-5564-407a-a760-319369817bfc admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:34.375067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bd0d5-5564-407a-a760-319369817bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:34.375346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bd0d5-5564-407a-a760-319369817bfc admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:34.376028 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bd0d5-5564-407a-a760-319369817bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:34.378011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bd0d5-5564-407a-a760-319369817bfc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:34.402122 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1307/2571] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:43:34 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:43:34.406398 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05f6e1-ccae-46fc-81b7-2817c4dafb78 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:34.417264 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05f6e1-ccae-46fc-81b7-2817c4dafb78 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:34.421961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c2f89-84e7-4bcb-8d7b-51db7a2eb018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:34.422770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c2f89-84e7-4bcb-8d7b-51db7a2eb018 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:34.423079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c2f89-84e7-4bcb-8d7b-51db7a2eb018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:34.423357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c2f89-84e7-4bcb-8d7b-51db7a2eb018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:34.424104 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c2f89-84e7-4bcb-8d7b-51db7a2eb018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:34.425789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c2f89-84e7-4bcb-8d7b-51db7a2eb018 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:34.436569 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1265/2572] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:43:34.440784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bd0d5-5564-407a-a760-319369817bfc admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:34.452382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bd0d5-5564-407a-a760-319369817bfc admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:34.457629 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5c07a-78ab-4ee0-a4d6-74b80fc1a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:34.458525 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5c07a-78ab-4ee0-a4d6-74b80fc1a9f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:34.458816 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5c07a-78ab-4ee0-a4d6-74b80fc1a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:34.459621 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5c07a-78ab-4ee0-a4d6-74b80fc1a9f0 admin admin] PATH_INFO: `/v3/projects/e80c9394e02c42de8cd04b12f9b69453/users/1a9d3f0138214fd892420b388db4cfa0/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:34.474864 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5c07a-78ab-4ee0-a4d6-74b80fc1a9f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80c9394e02c42de8cd04b12f9b69453, user_id=1a9d3f0138214fd892420b388db4cfa0, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:34.477702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5c07a-78ab-4ee0-a4d6-74b80fc1a9f0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:34.491028 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1308/2573] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:43:34 2022] PUT /identity/v3/projects/e80c9394e02c42de8cd04b12f9b69453/users/1a9d3f0138214fd892420b388db4cfa0/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:34.495155 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c2f89-84e7-4bcb-8d7b-51db7a2eb018 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:34.505984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c2f89-84e7-4bcb-8d7b-51db7a2eb018 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:34.568987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87f366-d8d3-487b-a077-a257e10379d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:34.569584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87f366-d8d3-487b-a077-a257e10379d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:34.569870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87f366-d8d3-487b-a077-a257e10379d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:34.570149 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87f366-d8d3-487b-a077-a257e10379d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:34.570875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87f366-d8d3-487b-a077-a257e10379d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:34.572512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87f366-d8d3-487b-a077-a257e10379d8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:34.586162 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1266/2574] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:43:34.587420 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5c07a-78ab-4ee0-a4d6-74b80fc1a9f0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:34.598063 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5c07a-78ab-4ee0-a4d6-74b80fc1a9f0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:34.602884 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425e4c4-a794-448d-8b75-98604b5e6195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:34.603772 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425e4c4-a794-448d-8b75-98604b5e6195 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:34.604603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425e4c4-a794-448d-8b75-98604b5e6195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:34.604890 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425e4c4-a794-448d-8b75-98604b5e6195 admin admin] PATH_INFO: `/v3/projects/e80c9394e02c42de8cd04b12f9b69453/users/1a9d3f0138214fd892420b388db4cfa0/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:34.607043 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425e4c4-a794-448d-8b75-98604b5e6195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80c9394e02c42de8cd04b12f9b69453, user_id=1a9d3f0138214fd892420b388db4cfa0, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:34.610766 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425e4c4-a794-448d-8b75-98604b5e6195 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:34.622137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1309/2575] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:43:34 2022] PUT /identity/v3/projects/e80c9394e02c42de8cd04b12f9b69453/users/1a9d3f0138214fd892420b388db4cfa0/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:34.633514 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b97a-e5b5-4007-bc76-0215770e9236 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:34.633807 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b97a-e5b5-4007-bc76-0215770e9236 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:34.634088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b97a-e5b5-4007-bc76-0215770e9236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:34.660539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bf44b97a-e5b5-4007-bc76-0215770e9236 None None] MFA Rules not processed for user `1a9d3f0138214fd892420b388db4cfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:34.661736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bf44b97a-e5b5-4007-bc76-0215770e9236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:34.702930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:34.738816 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1267/2576] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:34.751940 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425e4c4-a794-448d-8b75-98604b5e6195 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:34.753753 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f425e4c4-a794-448d-8b75-98604b5e6195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:34.770608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:34.815498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425e4c4-a794-448d-8b75-98604b5e6195 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:34.819231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22c617-1904-4b29-847c-3480a86c6b2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:34.819817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c617-1904-4b29-847c-3480a86c6b2c service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:34.820103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c617-1904-4b29-847c-3480a86c6b2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:34.820383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c617-1904-4b29-847c-3480a86c6b2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:34.880881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22c617-1904-4b29-847c-3480a86c6b2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:34.882333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22c617-1904-4b29-847c-3480a86c6b2c service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:34.892154 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1310/2577] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:39.114342 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44b97a-e5b5-4007-bc76-0215770e9236 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:39.124045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44b97a-e5b5-4007-bc76-0215770e9236 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:39.127528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e352d04-457b-4a4b-acff-42ffbb6dfdb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:39.128158 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e352d04-457b-4a4b-acff-42ffbb6dfdb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:39.128470 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e352d04-457b-4a4b-acff-42ffbb6dfdb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:39.128746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e352d04-457b-4a4b-acff-42ffbb6dfdb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:39.137980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e352d04-457b-4a4b-acff-42ffbb6dfdb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:39.139406 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e352d04-457b-4a4b-acff-42ffbb6dfdb5 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:39.148609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1268/2578] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:44.049520 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22c617-1904-4b29-847c-3480a86c6b2c service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:44.111062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22c617-1904-4b29-847c-3480a86c6b2c service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:44.116726 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfdd5b-d63e-499c-88e9-f9257c94f8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:44.117610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfdd5b-d63e-499c-88e9-f9257c94f8c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:44.117894 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfdd5b-d63e-499c-88e9-f9257c94f8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:44.118170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfdd5b-d63e-499c-88e9-f9257c94f8c9 admin admin] PATH_INFO: `/v3/users/5cfb1311bed249e39c01d7eae28baa96` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:44.119634 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfdd5b-d63e-499c-88e9-f9257c94f8c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cfb1311bed249e39c01d7eae28baa96)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:44.122131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfdd5b-d63e-499c-88e9-f9257c94f8c9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:44.200797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3dbfdd5b-d63e-499c-88e9-f9257c94f8c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cfb1311bed249e39c01d7eae28baa96'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:44.208092 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3dbfdd5b-d63e-499c-88e9-f9257c94f8c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cfb1311bed249e39c01d7eae28baa96'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:44.216289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3dbfdd5b-d63e-499c-88e9-f9257c94f8c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cfb1311bed249e39c01d7eae28baa96'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:44.216990 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3dbfdd5b-d63e-499c-88e9-f9257c94f8c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cfb1311bed249e39c01d7eae28baa96'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:44.221512 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:44.230945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3dbfdd5b-d63e-499c-88e9-f9257c94f8c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cfb1311bed249e39c01d7eae28baa96'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:44.237261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1311/2579] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:43:44 2022] DELETE /identity/v3/users/5cfb1311bed249e39c01d7eae28baa96 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:44.241816 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64ae08-a7ca-464a-9176-114c4071e064 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:44.242265 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64ae08-a7ca-464a-9176-114c4071e064 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:44.242404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64ae08-a7ca-464a-9176-114c4071e064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:44.259463 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4b64ae08-a7ca-464a-9176-114c4071e064 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:44.261192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4b64ae08-a7ca-464a-9176-114c4071e064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:44.317994 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1269/2580] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:44.328138 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfdd5b-d63e-499c-88e9-f9257c94f8c9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:44.329572 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3dbfdd5b-d63e-499c-88e9-f9257c94f8c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:44.385927 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfdd5b-d63e-499c-88e9-f9257c94f8c9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:44.389710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51b6d9-c6df-4891-b497-d60a32843192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:44.390361 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51b6d9-c6df-4891-b497-d60a32843192 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:44.390645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51b6d9-c6df-4891-b497-d60a32843192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:44.390920 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51b6d9-c6df-4891-b497-d60a32843192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:44.400021 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51b6d9-c6df-4891-b497-d60a32843192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:44.402268 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51b6d9-c6df-4891-b497-d60a32843192 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:44.412072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1312/2581] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:44.756844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64ae08-a7ca-464a-9176-114c4071e064 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:44.758271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4b64ae08-a7ca-464a-9176-114c4071e064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:44.772401 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64ae08-a7ca-464a-9176-114c4071e064 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:44.778088 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:44.779121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:44.779268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:44.779547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] PATH_INFO: `/v3/projects/77c9e7e22b6846cf8310589439231fed` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:44.780783 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c9e7e22b6846cf8310589439231fed)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:44.782801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:44.829156 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c9e7e22b6846cf8310589439231fed', 'request_id': 'req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:44.836055 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c9e7e22b6846cf8310589439231fed', 'request_id': 'req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:44.842988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c9e7e22b6846cf8310589439231fed', 'request_id': 'req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:44.853416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] The token cache is being invalidate because project 77c9e7e22b6846cf8310589439231fed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:43:44.853850 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:44.854447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:44.855956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1270/2582] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:43:44 2022] DELETE /identity/v3/projects/77c9e7e22b6846cf8310589439231fed => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:43:44.859950 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51b6d9-c6df-4891-b497-d60a32843192 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:44.869501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51b6d9-c6df-4891-b497-d60a32843192 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:44.926523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e192505-b556-48b9-9e7d-8aec7b311681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:44.927304 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e192505-b556-48b9-9e7d-8aec7b311681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:44.927588 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e192505-b556-48b9-9e7d-8aec7b311681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:44.927871 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e192505-b556-48b9-9e7d-8aec7b311681 admin admin] PATH_INFO: `/v3/users/1a9d3f0138214fd892420b388db4cfa0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:44.929107 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e192505-b556-48b9-9e7d-8aec7b311681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9d3f0138214fd892420b388db4cfa0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:44.931038 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e192505-b556-48b9-9e7d-8aec7b311681 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:44.977740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2e192505-b556-48b9-9e7d-8aec7b311681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9d3f0138214fd892420b388db4cfa0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:44.985476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2e192505-b556-48b9-9e7d-8aec7b311681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9d3f0138214fd892420b388db4cfa0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:44.992242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2e192505-b556-48b9-9e7d-8aec7b311681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9d3f0138214fd892420b388db4cfa0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:44.992907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2e192505-b556-48b9-9e7d-8aec7b311681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9d3f0138214fd892420b388db4cfa0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:45.005164 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2e192505-b556-48b9-9e7d-8aec7b311681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9d3f0138214fd892420b388db4cfa0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:45.011736 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1313/2583] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:43:44 2022] DELETE /identity/v3/users/1a9d3f0138214fd892420b388db4cfa0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:45.280091 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:45.282126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:45.302983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77223a-ab0c-4fa3-9272-2c77ef6fe505 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:45.347718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:45.363886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:45.364778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:45.365057 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:45.365326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1 admin admin] PATH_INFO: `/v3/projects/e80c9394e02c42de8cd04b12f9b69453` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:45.366496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80c9394e02c42de8cd04b12f9b69453)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:45.368451 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:45.413543 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80c9394e02c42de8cd04b12f9b69453', 'request_id': 'req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:45.422529 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80c9394e02c42de8cd04b12f9b69453', 'request_id': 'req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:45.429166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80c9394e02c42de8cd04b12f9b69453', 'request_id': 'req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:45.440637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1 admin admin] The token cache is being invalidate because project e80c9394e02c42de8cd04b12f9b69453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:43:45.440928 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:45.443916 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-227dfa17-dae2-4ad0-8781-6180a7e6ccc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:45.445742 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1271/2584] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:43:45 2022] DELETE /identity/v3/projects/e80c9394e02c42de8cd04b12f9b69453 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:45.452413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811e5d4-4f2a-424b-ab8e-a8e4fc6451a5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:45.452858 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811e5d4-4f2a-424b-ab8e-a8e4fc6451a5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:45.453001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811e5d4-4f2a-424b-ab8e-a8e4fc6451a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:45.466034 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:45.474991 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7811e5d4-4f2a-424b-ab8e-a8e4fc6451a5 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:45.475706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7811e5d4-4f2a-424b-ab8e-a8e4fc6451a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:45.537637 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1314/2585] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:45.547198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf7a31-c938-47aa-9a6a-b85cdfa4d9fc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:45.547485 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf7a31-c938-47aa-9a6a-b85cdfa4d9fc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:45.547764 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf7a31-c938-47aa-9a6a-b85cdfa4d9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:45.565839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-22bf7a31-c938-47aa-9a6a-b85cdfa4d9fc None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:45.567020 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-22bf7a31-c938-47aa-9a6a-b85cdfa4d9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:45.575365 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1272/2586] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:45.579513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811e5d4-4f2a-424b-ab8e-a8e4fc6451a5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:45.591177 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811e5d4-4f2a-424b-ab8e-a8e4fc6451a5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:45.595769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c49af-3e40-482f-b51a-7ee34b91c414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:45.596447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c49af-3e40-482f-b51a-7ee34b91c414 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:45.596733 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c49af-3e40-482f-b51a-7ee34b91c414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:45.597005 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c49af-3e40-482f-b51a-7ee34b91c414 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:45.597719 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c49af-3e40-482f-b51a-7ee34b91c414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:43:45.598019 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c49af-3e40-482f-b51a-7ee34b91c414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:45.599593 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c49af-3e40-482f-b51a-7ee34b91c414 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:45.611167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1315/2587] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:43:45.615543 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf7a31-c938-47aa-9a6a-b85cdfa4d9fc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:45.624879 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf7a31-c938-47aa-9a6a-b85cdfa4d9fc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:45.629438 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c74bd-9aac-4c35-8256-43a5cb5c0fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:45.630075 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c74bd-9aac-4c35-8256-43a5cb5c0fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:45.630353 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c74bd-9aac-4c35-8256-43a5cb5c0fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:45.630626 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c74bd-9aac-4c35-8256-43a5cb5c0fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:45.631313 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c74bd-9aac-4c35-8256-43a5cb5c0fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:45.633266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c74bd-9aac-4c35-8256-43a5cb5c0fc3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:45.659427 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1273/2588] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:43:45 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:43:45.663741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c49af-3e40-482f-b51a-7ee34b91c414 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:45.673628 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c49af-3e40-482f-b51a-7ee34b91c414 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:45.732532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c806d5e-bbe9-4a1c-9fb0-243ec3939319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:45.733371 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c806d5e-bbe9-4a1c-9fb0-243ec3939319 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:45.733680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c806d5e-bbe9-4a1c-9fb0-243ec3939319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:45.733985 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c806d5e-bbe9-4a1c-9fb0-243ec3939319 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:45.734723 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c806d5e-bbe9-4a1c-9fb0-243ec3939319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:45.736704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c806d5e-bbe9-4a1c-9fb0-243ec3939319 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:45.756472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1316/2589] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:43:45 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:43:45.761196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c74bd-9aac-4c35-8256-43a5cb5c0fc3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:45.771778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c74bd-9aac-4c35-8256-43a5cb5c0fc3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:45.777604 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f7f5-36e9-4f2a-8718-9119533ded0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:45.778272 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f7f5-36e9-4f2a-8718-9119533ded0e admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:45.778558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f7f5-36e9-4f2a-8718-9119533ded0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:45.778836 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f7f5-36e9-4f2a-8718-9119533ded0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:45.779566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2f7f5-36e9-4f2a-8718-9119533ded0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:45.781201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2f7f5-36e9-4f2a-8718-9119533ded0e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:45.792866 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1274/2590] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:43:45.796978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c806d5e-bbe9-4a1c-9fb0-243ec3939319 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:45.807889 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c806d5e-bbe9-4a1c-9fb0-243ec3939319 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:45.812722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865c098-882e-4dcf-a881-fe0fd97b03e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:45.813464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865c098-882e-4dcf-a881-fe0fd97b03e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:45.813821 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865c098-882e-4dcf-a881-fe0fd97b03e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:45.814173 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865c098-882e-4dcf-a881-fe0fd97b03e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:45.814970 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865c098-882e-4dcf-a881-fe0fd97b03e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:45.816660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865c098-882e-4dcf-a881-fe0fd97b03e0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:45.827782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1317/2591] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:43:45.832039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f7f5-36e9-4f2a-8718-9119533ded0e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:45.842511 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f7f5-36e9-4f2a-8718-9119533ded0e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:45.847456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161e2b6-c765-4500-8bd2-9842ef1383cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:45.848359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161e2b6-c765-4500-8bd2-9842ef1383cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:45.848671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161e2b6-c765-4500-8bd2-9842ef1383cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:45.848952 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161e2b6-c765-4500-8bd2-9842ef1383cc admin admin] PATH_INFO: `/v3/projects/7644b280f8d24bb694a7495d503a1b4b/users/27fe0c4deaad495bb7d32ac48faca056/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:45.864046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161e2b6-c765-4500-8bd2-9842ef1383cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7644b280f8d24bb694a7495d503a1b4b, user_id=27fe0c4deaad495bb7d32ac48faca056, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:45.866736 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161e2b6-c765-4500-8bd2-9842ef1383cc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:45.880300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1275/2592] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:43:45 2022] PUT /identity/v3/projects/7644b280f8d24bb694a7495d503a1b4b/users/27fe0c4deaad495bb7d32ac48faca056/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:45.893005 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee9d97-4aeb-49da-a5d6-787bf565977a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:45.893301 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee9d97-4aeb-49da-a5d6-787bf565977a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:45.893606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee9d97-4aeb-49da-a5d6-787bf565977a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:45.920444 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-94ee9d97-4aeb-49da-a5d6-787bf565977a None None] MFA Rules not processed for user `27fe0c4deaad495bb7d32ac48faca056`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:45.921580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-94ee9d97-4aeb-49da-a5d6-787bf565977a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:45.986033 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1318/2593] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:45.997899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161e2b6-c765-4500-8bd2-9842ef1383cc admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:45.999611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d161e2b6-c765-4500-8bd2-9842ef1383cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:46.054853 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161e2b6-c765-4500-8bd2-9842ef1383cc admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:46.059069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3afd7a-a2be-4229-a5be-20e35e0de815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:46.059710 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3afd7a-a2be-4229-a5be-20e35e0de815 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:46.059993 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3afd7a-a2be-4229-a5be-20e35e0de815 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:46.060271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3afd7a-a2be-4229-a5be-20e35e0de815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:46.068487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3afd7a-a2be-4229-a5be-20e35e0de815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:46.069957 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3afd7a-a2be-4229-a5be-20e35e0de815 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:46.079266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1276/2594] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:49.048305 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee9d97-4aeb-49da-a5d6-787bf565977a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:49.052575 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:49.118349 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee9d97-4aeb-49da-a5d6-787bf565977a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:49.123402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fd883-1e6b-4bf9-be20-55ec4884f5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:49.124297 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fd883-1e6b-4bf9-be20-55ec4884f5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:49.124608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fd883-1e6b-4bf9-be20-55ec4884f5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:49.124887 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fd883-1e6b-4bf9-be20-55ec4884f5de admin admin] PATH_INFO: `/v3/users/27fe0c4deaad495bb7d32ac48faca056` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:49.126071 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fd883-1e6b-4bf9-be20-55ec4884f5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=27fe0c4deaad495bb7d32ac48faca056)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:49.127986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fd883-1e6b-4bf9-be20-55ec4884f5de admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:49.177155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a43fd883-1e6b-4bf9-be20-55ec4884f5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27fe0c4deaad495bb7d32ac48faca056'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:49.185553 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a43fd883-1e6b-4bf9-be20-55ec4884f5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27fe0c4deaad495bb7d32ac48faca056'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:49.193373 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a43fd883-1e6b-4bf9-be20-55ec4884f5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27fe0c4deaad495bb7d32ac48faca056'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:49.194210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a43fd883-1e6b-4bf9-be20-55ec4884f5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27fe0c4deaad495bb7d32ac48faca056'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:49.207227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a43fd883-1e6b-4bf9-be20-55ec4884f5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27fe0c4deaad495bb7d32ac48faca056'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:49.213869 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1319/2595] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:43:49 2022] DELETE /identity/v3/users/27fe0c4deaad495bb7d32ac48faca056 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:49.218481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fdf0d-7cac-434c-b53e-5b7bde4dc310 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:49.218950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fdf0d-7cac-434c-b53e-5b7bde4dc310 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:49.219066 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fdf0d-7cac-434c-b53e-5b7bde4dc310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:49.236835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-621fdf0d-7cac-434c-b53e-5b7bde4dc310 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:49.238019 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-621fdf0d-7cac-434c-b53e-5b7bde4dc310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:49.264572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:49.347568 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1277/2596] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:49.357832 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fd883-1e6b-4bf9-be20-55ec4884f5de admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:49.359346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a43fd883-1e6b-4bf9-be20-55ec4884f5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:49.418585 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fd883-1e6b-4bf9-be20-55ec4884f5de admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:49.422803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faf5b5-2d0d-4f07-9e6e-5e2a1695bc4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:49.423659 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faf5b5-2d0d-4f07-9e6e-5e2a1695bc4e service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:49.423957 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faf5b5-2d0d-4f07-9e6e-5e2a1695bc4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:49.424254 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faf5b5-2d0d-4f07-9e6e-5e2a1695bc4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:49.435975 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faf5b5-2d0d-4f07-9e6e-5e2a1695bc4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:49.437613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faf5b5-2d0d-4f07-9e6e-5e2a1695bc4e service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:49.449095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1320/2597] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:43:49.970072 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fdf0d-7cac-434c-b53e-5b7bde4dc310 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:49.971540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-621fdf0d-7cac-434c-b53e-5b7bde4dc310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:50.000190 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fdf0d-7cac-434c-b53e-5b7bde4dc310 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:50.005618 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ac8ee-5170-46fe-83aa-159850c5847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:50.006645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ac8ee-5170-46fe-83aa-159850c5847c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:50.007030 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ac8ee-5170-46fe-83aa-159850c5847c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:50.007313 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ac8ee-5170-46fe-83aa-159850c5847c admin admin] PATH_INFO: `/v3/projects/7644b280f8d24bb694a7495d503a1b4b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:50.008541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ac8ee-5170-46fe-83aa-159850c5847c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7644b280f8d24bb694a7495d503a1b4b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:50.011055 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ac8ee-5170-46fe-83aa-159850c5847c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:50.061054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4d6ac8ee-5170-46fe-83aa-159850c5847c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7644b280f8d24bb694a7495d503a1b4b', 'request_id': 'req-4d6ac8ee-5170-46fe-83aa-159850c5847c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:50.069083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4d6ac8ee-5170-46fe-83aa-159850c5847c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7644b280f8d24bb694a7495d503a1b4b', 'request_id': 'req-4d6ac8ee-5170-46fe-83aa-159850c5847c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:50.075512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4d6ac8ee-5170-46fe-83aa-159850c5847c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7644b280f8d24bb694a7495d503a1b4b', 'request_id': 'req-4d6ac8ee-5170-46fe-83aa-159850c5847c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:50.085783 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4d6ac8ee-5170-46fe-83aa-159850c5847c admin admin] The token cache is being invalidate because project 7644b280f8d24bb694a7495d503a1b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:43:50.086073 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4d6ac8ee-5170-46fe-83aa-159850c5847c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:50.086727 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4d6ac8ee-5170-46fe-83aa-159850c5847c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:43:50.088443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1278/2598] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:43:49 2022] DELETE /identity/v3/projects/7644b280f8d24bb694a7495d503a1b4b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:50.094144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a25645-9c2c-49c6-9590-cc2a2cfa1c23 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:50.094608 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a25645-9c2c-49c6-9590-cc2a2cfa1c23 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:50.094703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a25645-9c2c-49c6-9590-cc2a2cfa1c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:50.113562 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c7a25645-9c2c-49c6-9590-cc2a2cfa1c23 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:50.114759 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c7a25645-9c2c-49c6-9590-cc2a2cfa1c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:50.134242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:50.183540 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1321/2599] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:43:50.191175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325bc7c-c8a5-49c8-ab64-73c4b7617d11 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:50.191474 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325bc7c-c8a5-49c8-ab64-73c4b7617d11 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:50.191766 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325bc7c-c8a5-49c8-ab64-73c4b7617d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:50.213545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6325bc7c-c8a5-49c8-ab64-73c4b7617d11 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:50.214753 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6325bc7c-c8a5-49c8-ab64-73c4b7617d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:50.223801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1279/2600] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:50.228158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a25645-9c2c-49c6-9590-cc2a2cfa1c23 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:50.239377 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a25645-9c2c-49c6-9590-cc2a2cfa1c23 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:50.244740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c05420-d837-4b34-9150-37006d7115a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:50.245609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c05420-d837-4b34-9150-37006d7115a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:50.245899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c05420-d837-4b34-9150-37006d7115a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:50.246175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c05420-d837-4b34-9150-37006d7115a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:50.246938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c05420-d837-4b34-9150-37006d7115a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:43:50.247245 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c05420-d837-4b34-9150-37006d7115a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:50.249012 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c05420-d837-4b34-9150-37006d7115a7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:50.261580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1322/2601] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:43:50.265931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325bc7c-c8a5-49c8-ab64-73c4b7617d11 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:50.275130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325bc7c-c8a5-49c8-ab64-73c4b7617d11 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:50.280447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969404a-3adb-46c3-98a0-e923665e010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:50.281101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969404a-3adb-46c3-98a0-e923665e010a admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:50.281320 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969404a-3adb-46c3-98a0-e923665e010a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:50.281593 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969404a-3adb-46c3-98a0-e923665e010a admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:50.282319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969404a-3adb-46c3-98a0-e923665e010a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:50.284178 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969404a-3adb-46c3-98a0-e923665e010a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:50.310668 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1280/2602] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:43:50 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:43:50.314754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c05420-d837-4b34-9150-37006d7115a7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:50.325045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c05420-d837-4b34-9150-37006d7115a7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:50.380091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c2c80-0d7a-4051-9054-4f11ab689c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:50.380788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c2c80-0d7a-4051-9054-4f11ab689c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:50.381077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c2c80-0d7a-4051-9054-4f11ab689c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:50.381360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c2c80-0d7a-4051-9054-4f11ab689c10 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:50.382038 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c2c80-0d7a-4051-9054-4f11ab689c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:50.383955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c2c80-0d7a-4051-9054-4f11ab689c10 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:50.404968 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1323/2603] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:43:50 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:43:50.409101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969404a-3adb-46c3-98a0-e923665e010a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:50.421218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969404a-3adb-46c3-98a0-e923665e010a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:50.426338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c2643-7423-4ac2-aa45-9ff243d7df3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:50.426996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c2643-7423-4ac2-aa45-9ff243d7df3b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:50.427281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c2643-7423-4ac2-aa45-9ff243d7df3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:50.427561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c2643-7423-4ac2-aa45-9ff243d7df3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:50.428377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c2643-7423-4ac2-aa45-9ff243d7df3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:50.430012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c2643-7423-4ac2-aa45-9ff243d7df3b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:50.441977 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1281/2604] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:43:50.446107 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c2c80-0d7a-4051-9054-4f11ab689c10 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:50.456613 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c2c80-0d7a-4051-9054-4f11ab689c10 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:50.461481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041abdbe-205a-4221-a16d-d3b07e56b4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:50.462158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041abdbe-205a-4221-a16d-d3b07e56b4ef admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:50.462449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041abdbe-205a-4221-a16d-d3b07e56b4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:50.463280 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041abdbe-205a-4221-a16d-d3b07e56b4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:50.464014 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041abdbe-205a-4221-a16d-d3b07e56b4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:50.465667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041abdbe-205a-4221-a16d-d3b07e56b4ef admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:50.475893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1324/2605] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:43:50.480855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c2643-7423-4ac2-aa45-9ff243d7df3b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:50.490953 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c2643-7423-4ac2-aa45-9ff243d7df3b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:50.495842 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05d5b6-a9a5-4d71-808f-2b247ef56ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:50.496814 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05d5b6-a9a5-4d71-808f-2b247ef56ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:50.497175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05d5b6-a9a5-4d71-808f-2b247ef56ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:50.497567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05d5b6-a9a5-4d71-808f-2b247ef56ccd admin admin] PATH_INFO: `/v3/projects/5da51e0fe43d4d789d801d82e3080319/users/bdf31e0226824f80bb4332444d1c0ad0/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:50.512886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05d5b6-a9a5-4d71-808f-2b247ef56ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da51e0fe43d4d789d801d82e3080319, user_id=bdf31e0226824f80bb4332444d1c0ad0, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:50.515678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05d5b6-a9a5-4d71-808f-2b247ef56ccd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:50.533947 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1282/2606] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:43:50 2022] PUT /identity/v3/projects/5da51e0fe43d4d789d801d82e3080319/users/bdf31e0226824f80bb4332444d1c0ad0/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:43:50.548127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762863f-507e-4d5a-be9b-7f27f84051a5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:50.548127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762863f-507e-4d5a-be9b-7f27f84051a5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:50.548127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762863f-507e-4d5a-be9b-7f27f84051a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:50.583201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b762863f-507e-4d5a-be9b-7f27f84051a5 None None] MFA Rules not processed for user `bdf31e0226824f80bb4332444d1c0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:50.584938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b762863f-507e-4d5a-be9b-7f27f84051a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:50.662441 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1325/2607] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:43:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:50.673686 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05d5b6-a9a5-4d71-808f-2b247ef56ccd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:50.675417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4d05d5b6-a9a5-4d71-808f-2b247ef56ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:50.713237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:50.736956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05d5b6-a9a5-4d71-808f-2b247ef56ccd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:50.741616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14515dcd-3bc9-4a3c-b36e-e4a5135fa33e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:50.742262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14515dcd-3bc9-4a3c-b36e-e4a5135fa33e service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:50.742550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14515dcd-3bc9-4a3c-b36e-e4a5135fa33e service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:50.742829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14515dcd-3bc9-4a3c-b36e-e4a5135fa33e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:50.754096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14515dcd-3bc9-4a3c-b36e-e4a5135fa33e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:50.755526 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14515dcd-3bc9-4a3c-b36e-e4a5135fa33e service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:50.765293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1283/2608] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:43:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:43:54.055198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c00a70-e48f-4da0-b3f0-f9516b7288fe None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:54.055716 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c00a70-e48f-4da0-b3f0-f9516b7288fe None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:54.055820 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c00a70-e48f-4da0-b3f0-f9516b7288fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:54.078125 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-09c00a70-e48f-4da0-b3f0-f9516b7288fe None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:43:54.079287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-09c00a70-e48f-4da0-b3f0-f9516b7288fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:54.093957 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:54.140646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1326/2609] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:43:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:43:54.193815 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14515dcd-3bc9-4a3c-b36e-e4a5135fa33e service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:43:54.194687 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-14515dcd-3bc9-4a3c-b36e-e4a5135fa33e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:43:54.268376 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14515dcd-3bc9-4a3c-b36e-e4a5135fa33e service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:43:54.273310 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69a6a6-f76d-4a34-bd0b-8fb61dbc1604 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:43:54.273956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69a6a6-f76d-4a34-bd0b-8fb61dbc1604 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:43:54.274241 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69a6a6-f76d-4a34-bd0b-8fb61dbc1604 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:43:54.274526 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69a6a6-f76d-4a34-bd0b-8fb61dbc1604 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:43:54.283299 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69a6a6-f76d-4a34-bd0b-8fb61dbc1604 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:43:54.284930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69a6a6-f76d-4a34-bd0b-8fb61dbc1604 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:43:54.293616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1284/2610] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:43:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 20:44:04.132072 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=16 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:04.290834 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=43 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:04.672455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c00a70-e48f-4da0-b3f0-f9516b7288fe None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:04.673998 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-09c00a70-e48f-4da0-b3f0-f9516b7288fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:04.735866 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c00a70-e48f-4da0-b3f0-f9516b7288fe None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:04.739447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebd28f-446e-4096-886e-7f834c4bcc03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:04.740095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebd28f-446e-4096-886e-7f834c4bcc03 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:04.740381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebd28f-446e-4096-886e-7f834c4bcc03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:04.740692 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebd28f-446e-4096-886e-7f834c4bcc03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:04.742432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-81ebd28f-446e-4096-886e-7f834c4bcc03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:04.809439 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebd28f-446e-4096-886e-7f834c4bcc03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:04.810877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebd28f-446e-4096-886e-7f834c4bcc03 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:04.820603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1327/2611] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:08.398209 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69a6a6-f76d-4a34-bd0b-8fb61dbc1604 service swift] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:08.400270 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1e69a6a6-f76d-4a34-bd0b-8fb61dbc1604 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:08.426151 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69a6a6-f76d-4a34-bd0b-8fb61dbc1604 service swift] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:08.430872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1e485-c6b9-4c7f-8788-f1514b4b0463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:08.431921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e485-c6b9-4c7f-8788-f1514b4b0463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:08.432200 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e485-c6b9-4c7f-8788-f1514b4b0463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:08.432503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e485-c6b9-4c7f-8788-f1514b4b0463 admin admin] PATH_INFO: `/v3/users/75d12a685d9b419fa3606b5f4d1309fe` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:08.433855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1e485-c6b9-4c7f-8788-f1514b4b0463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d12a685d9b419fa3606b5f4d1309fe)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:08.435858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1e485-c6b9-4c7f-8788-f1514b4b0463 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:08.507407 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0bf1e485-c6b9-4c7f-8788-f1514b4b0463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d12a685d9b419fa3606b5f4d1309fe'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:08.520804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0bf1e485-c6b9-4c7f-8788-f1514b4b0463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d12a685d9b419fa3606b5f4d1309fe'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:08.521442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0bf1e485-c6b9-4c7f-8788-f1514b4b0463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d12a685d9b419fa3606b5f4d1309fe'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:08.529823 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0bf1e485-c6b9-4c7f-8788-f1514b4b0463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d12a685d9b419fa3606b5f4d1309fe'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:08.530454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0bf1e485-c6b9-4c7f-8788-f1514b4b0463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d12a685d9b419fa3606b5f4d1309fe'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:08.544050 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1285/2612] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:44:08 2022] DELETE /identity/v3/users/75d12a685d9b419fa3606b5f4d1309fe => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:08.745407 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebd28f-446e-4096-886e-7f834c4bcc03 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:08.757675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b930-2907-464a-9e3c-51e80a150cbf None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:08.758175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b930-2907-464a-9e3c-51e80a150cbf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:08.758423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b930-2907-464a-9e3c-51e80a150cbf None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:08.759519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebd28f-446e-4096-886e-7f834c4bcc03 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:08.762343 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1286/2613] 10.222.0.66 () {54 vars in 921 bytes} [Fri Jul 15 20:44:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:44:08.770134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b81ada-8618-45c8-ae4c-d6afb519f400 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:08.770907 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b81ada-8618-45c8-ae4c-d6afb519f400 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:08.771374 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b81ada-8618-45c8-ae4c-d6afb519f400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:08.798973 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-60b81ada-8618-45c8-ae4c-d6afb519f400 None None] MFA Rules not processed for user `b042da9298894712a0a29787a343bf85`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:08.800634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-60b81ada-8618-45c8-ae4c-d6afb519f400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:08.847127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505917fb-2e8b-484e-bd5b-7a70eec9ea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:08.848117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505917fb-2e8b-484e-bd5b-7a70eec9ea79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:08.848426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505917fb-2e8b-484e-bd5b-7a70eec9ea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:08.848898 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505917fb-2e8b-484e-bd5b-7a70eec9ea79 admin admin] PATH_INFO: `/v3/projects/9af209f962144de4ae7e3575a3890096` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:08.850382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505917fb-2e8b-484e-bd5b-7a70eec9ea79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af209f962144de4ae7e3575a3890096)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:08.852795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505917fb-2e8b-484e-bd5b-7a70eec9ea79 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:08.886008 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1287/2614] 10.222.0.66 () {58 vars in 1018 bytes} [Fri Jul 15 20:44:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:08.897750 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b81ada-8618-45c8-ae4c-d6afb519f400 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:08.899128 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-60b81ada-8618-45c8-ae4c-d6afb519f400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:08.910907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-505917fb-2e8b-484e-bd5b-7a70eec9ea79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af209f962144de4ae7e3575a3890096', 'request_id': 'req-505917fb-2e8b-484e-bd5b-7a70eec9ea79'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:08.914156 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:08.920378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-505917fb-2e8b-484e-bd5b-7a70eec9ea79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af209f962144de4ae7e3575a3890096', 'request_id': 'req-505917fb-2e8b-484e-bd5b-7a70eec9ea79'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:08.929534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-505917fb-2e8b-484e-bd5b-7a70eec9ea79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af209f962144de4ae7e3575a3890096', 'request_id': 'req-505917fb-2e8b-484e-bd5b-7a70eec9ea79'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:08.943067 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-505917fb-2e8b-484e-bd5b-7a70eec9ea79 admin admin] The token cache is being invalidate because project 9af209f962144de4ae7e3575a3890096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:44:08.943351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-505917fb-2e8b-484e-bd5b-7a70eec9ea79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:08.943964 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-505917fb-2e8b-484e-bd5b-7a70eec9ea79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:08.945551 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1328/2615] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:44:08 2022] DELETE /identity/v3/projects/9af209f962144de4ae7e3575a3890096 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:08.950561 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31734b-c19c-4ffb-a0bf-b283e8ea3f03 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:08.950877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31734b-c19c-4ffb-a0bf-b283e8ea3f03 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:08.951160 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31734b-c19c-4ffb-a0bf-b283e8ea3f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:08.971318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ec31734b-c19c-4ffb-a0bf-b283e8ea3f03 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:08.972586 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ec31734b-c19c-4ffb-a0bf-b283e8ea3f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:08.973092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b81ada-8618-45c8-ae4c-d6afb519f400 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:08.989795 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:09.026499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0543d6-8f6f-4895-9310-d20970441bc7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93958c7dad0540b296b316169932d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:09.027149 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0543d6-8f6f-4895-9310-d20970441bc7 service glance] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.027426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0543d6-8f6f-4895-9310-d20970441bc7 service glance] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.027758 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0543d6-8f6f-4895-9310-d20970441bc7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.029592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ee0543d6-8f6f-4895-9310-d20970441bc7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:09.038801 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1329/2616] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:44:09.047797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c18863-f85e-4db3-a63f-adfaa744d8da None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.048120 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c18863-f85e-4db3-a63f-adfaa744d8da None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.048424 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c18863-f85e-4db3-a63f-adfaa744d8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.068101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c1c18863-f85e-4db3-a63f-adfaa744d8da None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:09.069526 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c1c18863-f85e-4db3-a63f-adfaa744d8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:09.077722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1330/2617] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:44:09.081837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c18863-f85e-4db3-a63f-adfaa744d8da None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:09.090690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c18863-f85e-4db3-a63f-adfaa744d8da None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:09.095267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecae4e5-4f13-46e4-ba5e-dd27b6567438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:09.095900 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecae4e5-4f13-46e4-ba5e-dd27b6567438 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.096183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecae4e5-4f13-46e4-ba5e-dd27b6567438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.096494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecae4e5-4f13-46e4-ba5e-dd27b6567438 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.097261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecae4e5-4f13-46e4-ba5e-dd27b6567438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:44:09.097549 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecae4e5-4f13-46e4-ba5e-dd27b6567438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:09.099119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecae4e5-4f13-46e4-ba5e-dd27b6567438 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:09.104699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0543d6-8f6f-4895-9310-d20970441bc7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:09.106134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0543d6-8f6f-4895-9310-d20970441bc7 service glance] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:09.111464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1331/2618] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 20:44:09.115835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecae4e5-4f13-46e4-ba5e-dd27b6567438 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:09.117597 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1288/2619] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:44:09.127200 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecae4e5-4f13-46e4-ba5e-dd27b6567438 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:09.131808 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783b55c-d531-446e-998d-2745a6ad6f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:09.132498 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783b55c-d531-446e-998d-2745a6ad6f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.132786 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783b55c-d531-446e-998d-2745a6ad6f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.133063 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783b55c-d531-446e-998d-2745a6ad6f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.133763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783b55c-d531-446e-998d-2745a6ad6f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:09.137949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783b55c-d531-446e-998d-2745a6ad6f48 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:09.173176 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1332/2620] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:44:09 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:44:09.174157 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0543d6-8f6f-4895-9310-d20970441bc7 service glance] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:09.190671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0543d6-8f6f-4895-9310-d20970441bc7 service glance] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:09.202329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a80c56-3e95-415e-8ee3-92465b462951 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.202623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a80c56-3e95-415e-8ee3-92465b462951 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.202906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a80c56-3e95-415e-8ee3-92465b462951 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.204425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1333/2621] 10.222.0.66 () {54 vars in 921 bytes} [Fri Jul 15 20:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:44:09.210522 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625c432-b2ac-48f0-b59b-81dc943fc1a1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.210812 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625c432-b2ac-48f0-b59b-81dc943fc1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.211090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625c432-b2ac-48f0-b59b-81dc943fc1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.230322 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e625c432-b2ac-48f0-b59b-81dc943fc1a1 None None] MFA Rules not processed for user `633e05f021544b669749f941f40cbf58`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:09.231539 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e625c432-b2ac-48f0-b59b-81dc943fc1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:09.249142 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3189a13-25a5-42e4-8c3a-d8dbe73cccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:09.249845 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3189a13-25a5-42e4-8c3a-d8dbe73cccfa admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.250130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3189a13-25a5-42e4-8c3a-d8dbe73cccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.250405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3189a13-25a5-42e4-8c3a-d8dbe73cccfa admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.251099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3189a13-25a5-42e4-8c3a-d8dbe73cccfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:09.253061 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3189a13-25a5-42e4-8c3a-d8dbe73cccfa admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:09.275728 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1289/2622] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:44:09 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:09.279956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3189a13-25a5-42e4-8c3a-d8dbe73cccfa admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:09.292411 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3189a13-25a5-42e4-8c3a-d8dbe73cccfa admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:09.292895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1334/2623] 10.222.0.66 () {58 vars in 1018 bytes} [Fri Jul 15 20:44:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:44:09.300990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20d956-affb-47c5-91a6-34aceb7839ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:09.301663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20d956-affb-47c5-91a6-34aceb7839ed admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.302060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20d956-affb-47c5-91a6-34aceb7839ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.302341 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20d956-affb-47c5-91a6-34aceb7839ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.303207 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20d956-affb-47c5-91a6-34aceb7839ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:09.304949 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625c432-b2ac-48f0-b59b-81dc943fc1a1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:09.305450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20d956-affb-47c5-91a6-34aceb7839ed admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:09.310952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e625c432-b2ac-48f0-b59b-81dc943fc1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:09.317537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625c432-b2ac-48f0-b59b-81dc943fc1a1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:09.324037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1290/2624] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:44:09.324185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39faaf1-26d7-4b32-8337-1fdd900c7a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:09.324185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39faaf1-26d7-4b32-8337-1fdd900c7a32 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.324185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39faaf1-26d7-4b32-8337-1fdd900c7a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.324185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39faaf1-26d7-4b32-8337-1fdd900c7a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.325108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20d956-affb-47c5-91a6-34aceb7839ed admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:09.330556 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39faaf1-26d7-4b32-8337-1fdd900c7a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:09.331986 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39faaf1-26d7-4b32-8337-1fdd900c7a32 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:09.334810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20d956-affb-47c5-91a6-34aceb7839ed admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:09.340116 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04a1dd-9584-487b-8a47-7662d32eb216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:09.340810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04a1dd-9584-487b-8a47-7662d32eb216 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.340978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1335/2625] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:44:09.341391 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04a1dd-9584-487b-8a47-7662d32eb216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.341686 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04a1dd-9584-487b-8a47-7662d32eb216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.342463 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04a1dd-9584-487b-8a47-7662d32eb216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:09.344069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04a1dd-9584-487b-8a47-7662d32eb216 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:09.356195 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1291/2626] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:09.360331 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39faaf1-26d7-4b32-8337-1fdd900c7a32 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:09.374089 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39faaf1-26d7-4b32-8337-1fdd900c7a32 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:09.378736 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c1e77-28a0-40e1-abf5-2e73f331cf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:09.379631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c1e77-28a0-40e1-abf5-2e73f331cf00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.379919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c1e77-28a0-40e1-abf5-2e73f331cf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.380199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c1e77-28a0-40e1-abf5-2e73f331cf00 admin admin] PATH_INFO: `/v3/projects/a9a405b5382d4c1ab2827f85286b0a04/users/148143bc6f184e31b88b123dcd74f759/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.395545 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c1e77-28a0-40e1-abf5-2e73f331cf00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a405b5382d4c1ab2827f85286b0a04, user_id=148143bc6f184e31b88b123dcd74f759, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:09.398247 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c1e77-28a0-40e1-abf5-2e73f331cf00 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:09.413030 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1336/2627] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:44:09 2022] PUT /identity/v3/projects/a9a405b5382d4c1ab2827f85286b0a04/users/148143bc6f184e31b88b123dcd74f759/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:09.425350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10138a2d-baac-4de3-b93e-e660eeec3f86 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.425350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10138a2d-baac-4de3-b93e-e660eeec3f86 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.425849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10138a2d-baac-4de3-b93e-e660eeec3f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.436831 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b908bd5-7c5a-4f95-97e6-656dc860f74e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.437126 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b908bd5-7c5a-4f95-97e6-656dc860f74e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.437406 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b908bd5-7c5a-4f95-97e6-656dc860f74e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.438809 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1337/2628] 10.222.0.66 () {54 vars in 921 bytes} [Fri Jul 15 20:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 20:44:09.445810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4e0d-dde7-491c-bf3b-598c693ac3db None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.446235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4e0d-dde7-491c-bf3b-598c693ac3db None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.447450 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4e0d-dde7-491c-bf3b-598c693ac3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.454890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-10138a2d-baac-4de3-b93e-e660eeec3f86 None None] MFA Rules not processed for user `148143bc6f184e31b88b123dcd74f759`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:09.456233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-10138a2d-baac-4de3-b93e-e660eeec3f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:09.472602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f60e4e0d-dde7-491c-bf3b-598c693ac3db None None] MFA Rules not processed for user `b042da9298894712a0a29787a343bf85`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:09.473841 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f60e4e0d-dde7-491c-bf3b-598c693ac3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:09.475987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:09.480796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:09.533977 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1292/2629] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:09.547743 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10138a2d-baac-4de3-b93e-e660eeec3f86 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:09.548942 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1338/2630] 10.222.0.66 () {58 vars in 1018 bytes} [Fri Jul 15 20:44:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:09.549266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-10138a2d-baac-4de3-b93e-e660eeec3f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:09.562917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e4e0d-dde7-491c-bf3b-598c693ac3db None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:09.564300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f60e4e0d-dde7-491c-bf3b-598c693ac3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:09.565982 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10138a2d-baac-4de3-b93e-e660eeec3f86 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:09.572383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b3afe-d94e-4434-9137-bcfa9839a5f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:09.573217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b3afe-d94e-4434-9137-bcfa9839a5f9 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.573503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b3afe-d94e-4434-9137-bcfa9839a5f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.573785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b3afe-d94e-4434-9137-bcfa9839a5f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.581993 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b3afe-d94e-4434-9137-bcfa9839a5f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:09.583633 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b3afe-d94e-4434-9137-bcfa9839a5f9 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:09.593022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1293/2631] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:44:09.622461 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e4e0d-dde7-491c-bf3b-598c693ac3db None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:09.629436 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8a8dc-9018-4a4e-bb59-94487c0911e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:09.629436 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8a8dc-9018-4a4e-bb59-94487c0911e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.629436 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8a8dc-9018-4a4e-bb59-94487c0911e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.632139 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8a8dc-9018-4a4e-bb59-94487c0911e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.643460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8a8dc-9018-4a4e-bb59-94487c0911e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:09.649133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8a8dc-9018-4a4e-bb59-94487c0911e4 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:09.656791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1339/2632] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:44:09.828098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b3afe-d94e-4434-9137-bcfa9839a5f9 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:09.907218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b3afe-d94e-4434-9137-bcfa9839a5f9 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:09.911816 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556fd5a-4d2d-466f-9f35-7736507994eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:09.912716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556fd5a-4d2d-466f-9f35-7736507994eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:09.912996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556fd5a-4d2d-466f-9f35-7736507994eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:09.913271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556fd5a-4d2d-466f-9f35-7736507994eb admin admin] PATH_INFO: `/v3/users/148143bc6f184e31b88b123dcd74f759` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:09.914756 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556fd5a-4d2d-466f-9f35-7736507994eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=148143bc6f184e31b88b123dcd74f759)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:09.917039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556fd5a-4d2d-466f-9f35-7736507994eb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:09.975813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7556fd5a-4d2d-466f-9f35-7736507994eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148143bc6f184e31b88b123dcd74f759'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:09.995414 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7556fd5a-4d2d-466f-9f35-7736507994eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148143bc6f184e31b88b123dcd74f759'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:09.996147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7556fd5a-4d2d-466f-9f35-7736507994eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148143bc6f184e31b88b123dcd74f759'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:10.004573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7556fd5a-4d2d-466f-9f35-7736507994eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148143bc6f184e31b88b123dcd74f759'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:10.005663 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7556fd5a-4d2d-466f-9f35-7736507994eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148143bc6f184e31b88b123dcd74f759'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:10.022108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1294/2633] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:44:09 2022] DELETE /identity/v3/users/148143bc6f184e31b88b123dcd74f759 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:10.027479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ac87c-9573-4ac6-a1c2-eb372937b2b1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:10.027943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ac87c-9573-4ac6-a1c2-eb372937b2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:10.028053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ac87c-9573-4ac6-a1c2-eb372937b2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:10.046464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ea5ac87c-9573-4ac6-a1c2-eb372937b2b1 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:10.047976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ea5ac87c-9573-4ac6-a1c2-eb372937b2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:10.112447 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1340/2634] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:10.123457 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556fd5a-4d2d-466f-9f35-7736507994eb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:10.125587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7556fd5a-4d2d-466f-9f35-7736507994eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:10.157407 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:10.193300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556fd5a-4d2d-466f-9f35-7736507994eb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:10.198224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad92e0-5f08-4115-8003-da62c2d17e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:10.198947 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad92e0-5f08-4115-8003-da62c2d17e84 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:10.199337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad92e0-5f08-4115-8003-da62c2d17e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:10.199685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad92e0-5f08-4115-8003-da62c2d17e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:10.209790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad92e0-5f08-4115-8003-da62c2d17e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:10.211314 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad92e0-5f08-4115-8003-da62c2d17e84 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:10.222694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1295/2635] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:10.522445 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ac87c-9573-4ac6-a1c2-eb372937b2b1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:10.524312 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ea5ac87c-9573-4ac6-a1c2-eb372937b2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:10.544120 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ac87c-9573-4ac6-a1c2-eb372937b2b1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:10.548923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0f80c-a9e9-406a-9c87-af047a07413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:10.549848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0f80c-a9e9-406a-9c87-af047a07413e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:10.550131 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0f80c-a9e9-406a-9c87-af047a07413e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:10.550418 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0f80c-a9e9-406a-9c87-af047a07413e admin admin] PATH_INFO: `/v3/projects/a9a405b5382d4c1ab2827f85286b0a04` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:10.551740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0f80c-a9e9-406a-9c87-af047a07413e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a405b5382d4c1ab2827f85286b0a04)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:10.554032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0f80c-a9e9-406a-9c87-af047a07413e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:10.604655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:10.613047 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b3a0f80c-a9e9-406a-9c87-af047a07413e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a405b5382d4c1ab2827f85286b0a04', 'request_id': 'req-b3a0f80c-a9e9-406a-9c87-af047a07413e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:10.620218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b3a0f80c-a9e9-406a-9c87-af047a07413e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a405b5382d4c1ab2827f85286b0a04', 'request_id': 'req-b3a0f80c-a9e9-406a-9c87-af047a07413e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:10.626041 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b3a0f80c-a9e9-406a-9c87-af047a07413e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a405b5382d4c1ab2827f85286b0a04', 'request_id': 'req-b3a0f80c-a9e9-406a-9c87-af047a07413e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:10.639484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b3a0f80c-a9e9-406a-9c87-af047a07413e admin admin] The token cache is being invalidate because project a9a405b5382d4c1ab2827f85286b0a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:44:10.639791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b3a0f80c-a9e9-406a-9c87-af047a07413e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:10.640708 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b3a0f80c-a9e9-406a-9c87-af047a07413e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:10.646163 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1341/2636] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:44:10 2022] DELETE /identity/v3/projects/a9a405b5382d4c1ab2827f85286b0a04 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:10.647927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b74009-4eaa-4eb7-86e2-15bd106000c7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:10.648423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b74009-4eaa-4eb7-86e2-15bd106000c7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:10.648621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b74009-4eaa-4eb7-86e2-15bd106000c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:10.670679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-94b74009-4eaa-4eb7-86e2-15bd106000c7 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:10.672235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-94b74009-4eaa-4eb7-86e2-15bd106000c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:10.736507 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1296/2637] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:44:10.745703 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f0f9-98e7-435f-bea8-9b62f7ab197f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:10.745999 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f0f9-98e7-435f-bea8-9b62f7ab197f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:10.746279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f0f9-98e7-435f-bea8-9b62f7ab197f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:10.766466 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6876f0f9-98e7-435f-bea8-9b62f7ab197f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:10.767756 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6876f0f9-98e7-435f-bea8-9b62f7ab197f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:10.777175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1342/2638] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:10.781131 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b74009-4eaa-4eb7-86e2-15bd106000c7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:10.792194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b74009-4eaa-4eb7-86e2-15bd106000c7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:10.797918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109eccb6-fb15-417f-b096-0fca0098d6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:10.798609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eccb6-fb15-417f-b096-0fca0098d6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:10.798896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eccb6-fb15-417f-b096-0fca0098d6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:10.799176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eccb6-fb15-417f-b096-0fca0098d6e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:10.799902 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109eccb6-fb15-417f-b096-0fca0098d6e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:44:10.800212 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109eccb6-fb15-417f-b096-0fca0098d6e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:10.801866 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109eccb6-fb15-417f-b096-0fca0098d6e5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:10.815252 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1297/2639] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:44:10.819930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876f0f9-98e7-435f-bea8-9b62f7ab197f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:10.831997 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876f0f9-98e7-435f-bea8-9b62f7ab197f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:10.837140 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a672f0-42bb-43d9-bfa8-af102bae2852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:10.838030 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a672f0-42bb-43d9-bfa8-af102bae2852 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:10.838360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a672f0-42bb-43d9-bfa8-af102bae2852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:10.838638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a672f0-42bb-43d9-bfa8-af102bae2852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:10.839339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a672f0-42bb-43d9-bfa8-af102bae2852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:10.841270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a672f0-42bb-43d9-bfa8-af102bae2852 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:10.872218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1343/2640] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:44:10 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:10.876364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109eccb6-fb15-417f-b096-0fca0098d6e5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:10.887723 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109eccb6-fb15-417f-b096-0fca0098d6e5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:10.949501 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb6836-54ad-41bd-9446-430d3984edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:10.950092 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb6836-54ad-41bd-9446-430d3984edda admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:10.950376 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb6836-54ad-41bd-9446-430d3984edda admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:10.950653 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb6836-54ad-41bd-9446-430d3984edda admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:10.951371 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb6836-54ad-41bd-9446-430d3984edda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:10.953391 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb6836-54ad-41bd-9446-430d3984edda admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:10.972681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1298/2641] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:44:10 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:44:10.976815 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a672f0-42bb-43d9-bfa8-af102bae2852 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:10.987216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a672f0-42bb-43d9-bfa8-af102bae2852 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:10.991885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c502786-797a-4cb2-bbe6-9d5758a66707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:10.992676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c502786-797a-4cb2-bbe6-9d5758a66707 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:10.992963 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c502786-797a-4cb2-bbe6-9d5758a66707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:10.993804 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c502786-797a-4cb2-bbe6-9d5758a66707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:10.994678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c502786-797a-4cb2-bbe6-9d5758a66707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:10.996285 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c502786-797a-4cb2-bbe6-9d5758a66707 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:11.007189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1344/2642] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:11.012061 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb6836-54ad-41bd-9446-430d3984edda admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:11.022040 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb6836-54ad-41bd-9446-430d3984edda admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:11.026855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93926a8-3d3b-4193-a494-da4c9f39413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:11.027512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93926a8-3d3b-4193-a494-da4c9f39413a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:11.027811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93926a8-3d3b-4193-a494-da4c9f39413a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:11.028096 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93926a8-3d3b-4193-a494-da4c9f39413a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:11.028942 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93926a8-3d3b-4193-a494-da4c9f39413a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:11.030434 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93926a8-3d3b-4193-a494-da4c9f39413a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:11.042585 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1299/2643] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:11.048379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c502786-797a-4cb2-bbe6-9d5758a66707 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:11.059199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c502786-797a-4cb2-bbe6-9d5758a66707 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:11.064252 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77419dc2-e225-4b7d-b117-76edd29efe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:11.065246 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77419dc2-e225-4b7d-b117-76edd29efe19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:11.065533 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77419dc2-e225-4b7d-b117-76edd29efe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:11.065807 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77419dc2-e225-4b7d-b117-76edd29efe19 admin admin] PATH_INFO: `/v3/projects/4565bd26a3f1458a86c63a9d8d206a6c/users/201430f8be3d41498646151f0bd564d7/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:11.081286 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77419dc2-e225-4b7d-b117-76edd29efe19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4565bd26a3f1458a86c63a9d8d206a6c, user_id=201430f8be3d41498646151f0bd564d7, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:11.083950 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77419dc2-e225-4b7d-b117-76edd29efe19 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:11.097467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1345/2644] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:44:11 2022] PUT /identity/v3/projects/4565bd26a3f1458a86c63a9d8d206a6c/users/201430f8be3d41498646151f0bd564d7/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:11.108990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134510b-cdf7-4945-87af-7e25cdf68906 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:11.109283 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134510b-cdf7-4945-87af-7e25cdf68906 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:11.109566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134510b-cdf7-4945-87af-7e25cdf68906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:11.136254 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e134510b-cdf7-4945-87af-7e25cdf68906 None None] MFA Rules not processed for user `201430f8be3d41498646151f0bd564d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:11.137689 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e134510b-cdf7-4945-87af-7e25cdf68906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:11.159348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:11.213627 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1300/2645] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:11.218340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77419dc2-e225-4b7d-b117-76edd29efe19 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:11.295859 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77419dc2-e225-4b7d-b117-76edd29efe19 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:11.302851 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70627e-f9be-4a08-880b-59de8216a6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:11.303923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70627e-f9be-4a08-880b-59de8216a6af admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:11.304806 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70627e-f9be-4a08-880b-59de8216a6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:11.305093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70627e-f9be-4a08-880b-59de8216a6af admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:11.306385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70627e-f9be-4a08-880b-59de8216a6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:11.308422 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70627e-f9be-4a08-880b-59de8216a6af admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:11.340467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1346/2646] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:44:11 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:11.342272 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134510b-cdf7-4945-87af-7e25cdf68906 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:11.360253 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134510b-cdf7-4945-87af-7e25cdf68906 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:11.426317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020297a-8d35-455e-98e1-12dfd06d7bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:11.426989 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020297a-8d35-455e-98e1-12dfd06d7bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:11.427272 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020297a-8d35-455e-98e1-12dfd06d7bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:11.427547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020297a-8d35-455e-98e1-12dfd06d7bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:11.428230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020297a-8d35-455e-98e1-12dfd06d7bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:11.430242 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020297a-8d35-455e-98e1-12dfd06d7bb3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:11.463677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1301/2647] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:44:11 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:11.467661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70627e-f9be-4a08-880b-59de8216a6af admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:11.478328 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70627e-f9be-4a08-880b-59de8216a6af admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:11.483214 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24333d-fb66-4357-a257-d8ad9747eed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:11.483878 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24333d-fb66-4357-a257-d8ad9747eed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:11.484170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24333d-fb66-4357-a257-d8ad9747eed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:11.484479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24333d-fb66-4357-a257-d8ad9747eed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:11.485210 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24333d-fb66-4357-a257-d8ad9747eed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:11.486814 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24333d-fb66-4357-a257-d8ad9747eed3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:11.499786 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1347/2648] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:44:11.503982 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020297a-8d35-455e-98e1-12dfd06d7bb3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:11.515116 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020297a-8d35-455e-98e1-12dfd06d7bb3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:11.520027 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc689eb-7e5c-4b06-8e81-2f508868cdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:11.520950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc689eb-7e5c-4b06-8e81-2f508868cdde admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:11.521238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc689eb-7e5c-4b06-8e81-2f508868cdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:11.521518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc689eb-7e5c-4b06-8e81-2f508868cdde admin admin] PATH_INFO: `/v3/projects/de63ee7f9c11469a89770fc27a0bfbc4/users/6a3cb9cde6254a74b1ac22e2b1bd76c5/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:11.538858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc689eb-7e5c-4b06-8e81-2f508868cdde admin admin] RBAC: Authorizing `identity:create_grant(project_id=de63ee7f9c11469a89770fc27a0bfbc4, user_id=6a3cb9cde6254a74b1ac22e2b1bd76c5, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:11.542111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc689eb-7e5c-4b06-8e81-2f508868cdde admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:11.572196 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1302/2649] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:44:11 2022] PUT /identity/v3/projects/de63ee7f9c11469a89770fc27a0bfbc4/users/6a3cb9cde6254a74b1ac22e2b1bd76c5/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:11.577722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24333d-fb66-4357-a257-d8ad9747eed3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:11.588345 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24333d-fb66-4357-a257-d8ad9747eed3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:11.630475 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:11.655011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeee9dc-81b7-4f67-aa94-39fff8ac6a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:11.655706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeee9dc-81b7-4f67-aa94-39fff8ac6a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:11.655992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeee9dc-81b7-4f67-aa94-39fff8ac6a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:11.656279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeee9dc-81b7-4f67-aa94-39fff8ac6a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:11.657058 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeee9dc-81b7-4f67-aa94-39fff8ac6a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:11.658849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeee9dc-81b7-4f67-aa94-39fff8ac6a7f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:11.670197 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1348/2650] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:11.674355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc689eb-7e5c-4b06-8e81-2f508868cdde admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:11.685406 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc689eb-7e5c-4b06-8e81-2f508868cdde admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:11.693697 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34c540-13c2-4b13-92f1-47839e361933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:11.694611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34c540-13c2-4b13-92f1-47839e361933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:11.694899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34c540-13c2-4b13-92f1-47839e361933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:11.695183 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34c540-13c2-4b13-92f1-47839e361933 admin admin] PATH_INFO: `/v3/projects/de63ee7f9c11469a89770fc27a0bfbc4/users/6a3cb9cde6254a74b1ac22e2b1bd76c5/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:11.698450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34c540-13c2-4b13-92f1-47839e361933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de63ee7f9c11469a89770fc27a0bfbc4, user_id=6a3cb9cde6254a74b1ac22e2b1bd76c5, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:11.701192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34c540-13c2-4b13-92f1-47839e361933 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:11.711849 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1303/2651] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:44:11 2022] PUT /identity/v3/projects/de63ee7f9c11469a89770fc27a0bfbc4/users/6a3cb9cde6254a74b1ac22e2b1bd76c5/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:11.723468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83873f-35fe-4b61-8be6-cdaaabc542cf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:11.723752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83873f-35fe-4b61-8be6-cdaaabc542cf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:11.724035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83873f-35fe-4b61-8be6-cdaaabc542cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:11.753233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cd83873f-35fe-4b61-8be6-cdaaabc542cf None None] MFA Rules not processed for user `6a3cb9cde6254a74b1ac22e2b1bd76c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:11.754465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cd83873f-35fe-4b61-8be6-cdaaabc542cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:11.831455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1349/2652] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:11.842961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34c540-13c2-4b13-92f1-47839e361933 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:11.844832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f34c540-13c2-4b13-92f1-47839e361933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:11.904756 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34c540-13c2-4b13-92f1-47839e361933 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:11.908619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cff675-4023-44d3-8028-4e52cb905591 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:11.909387 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cff675-4023-44d3-8028-4e52cb905591 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:11.909681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cff675-4023-44d3-8028-4e52cb905591 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:11.909969 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cff675-4023-44d3-8028-4e52cb905591 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:11.921999 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cff675-4023-44d3-8028-4e52cb905591 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:11.924006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cff675-4023-44d3-8028-4e52cb905591 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:11.935547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1304/2653] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:11.992758 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea8de2-cffa-4c12-a77d-026fc74cc4d8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:11.993059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea8de2-cffa-4c12-a77d-026fc74cc4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:11.993947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea8de2-cffa-4c12-a77d-026fc74cc4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:12.012598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cff675-4023-44d3-8028-4e52cb905591 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:12.014649 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c2ea8de2-cffa-4c12-a77d-026fc74cc4d8 None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:12.015897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c2ea8de2-cffa-4c12-a77d-026fc74cc4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:12.021523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cff675-4023-44d3-8028-4e52cb905591 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:12.025895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a507059-54bc-444b-998b-eb7b8808449f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:12.026526 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a507059-54bc-444b-998b-eb7b8808449f service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:12.026808 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a507059-54bc-444b-998b-eb7b8808449f service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:12.027082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a507059-54bc-444b-998b-eb7b8808449f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:12.040431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:12.075455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1350/2654] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:44:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:12.088437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea8de2-cffa-4c12-a77d-026fc74cc4d8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:12.089825 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c2ea8de2-cffa-4c12-a77d-026fc74cc4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:12.092561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a507059-54bc-444b-998b-eb7b8808449f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:12.094005 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a507059-54bc-444b-998b-eb7b8808449f service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:12.104468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1305/2655] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:12.163509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea8de2-cffa-4c12-a77d-026fc74cc4d8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:12.172865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f692f7-fc10-4474-983a-54203f3351ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:12.173602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f692f7-fc10-4474-983a-54203f3351ce service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:12.173922 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f692f7-fc10-4474-983a-54203f3351ce service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:12.174342 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f692f7-fc10-4474-983a-54203f3351ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:12.181794 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:12.184784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f692f7-fc10-4474-983a-54203f3351ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:12.187077 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f692f7-fc10-4474-983a-54203f3351ce service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:12.197442 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1351/2656] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:44:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 20:44:22.098927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=20 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:22.194059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:22.344708 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a507059-54bc-444b-998b-eb7b8808449f service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:22.406923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a507059-54bc-444b-998b-eb7b8808449f service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:22.411352 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f1bb8-ea46-4695-9b96-150699f27619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:22.412204 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f1bb8-ea46-4695-9b96-150699f27619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:22.412512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f1bb8-ea46-4695-9b96-150699f27619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:22.412788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f1bb8-ea46-4695-9b96-150699f27619 admin admin] PATH_INFO: `/v3/users/201430f8be3d41498646151f0bd564d7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:22.413951 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f1bb8-ea46-4695-9b96-150699f27619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=201430f8be3d41498646151f0bd564d7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:22.416106 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f1bb8-ea46-4695-9b96-150699f27619 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:22.463990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f15f1bb8-ea46-4695-9b96-150699f27619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201430f8be3d41498646151f0bd564d7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:22.476435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f15f1bb8-ea46-4695-9b96-150699f27619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201430f8be3d41498646151f0bd564d7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:22.477137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f15f1bb8-ea46-4695-9b96-150699f27619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201430f8be3d41498646151f0bd564d7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:22.483899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f15f1bb8-ea46-4695-9b96-150699f27619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201430f8be3d41498646151f0bd564d7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:22.484571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f15f1bb8-ea46-4695-9b96-150699f27619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201430f8be3d41498646151f0bd564d7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:22.497757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1306/2657] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:44:22 2022] DELETE /identity/v3/users/201430f8be3d41498646151f0bd564d7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:22.502206 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17dcd9-c0fc-4084-97f6-4b9c9c87bd4a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:22.502501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17dcd9-c0fc-4084-97f6-4b9c9c87bd4a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:22.502784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17dcd9-c0fc-4084-97f6-4b9c9c87bd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:22.520249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-eb17dcd9-c0fc-4084-97f6-4b9c9c87bd4a None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:22.521481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-eb17dcd9-c0fc-4084-97f6-4b9c9c87bd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:22.580136 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1352/2658] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:22.593808 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f1bb8-ea46-4695-9b96-150699f27619 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:22.595223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f15f1bb8-ea46-4695-9b96-150699f27619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:22.650612 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f1bb8-ea46-4695-9b96-150699f27619 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:22.654527 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f773fa-d52e-47f2-89ae-659f5e54e7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:22.655168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f773fa-d52e-47f2-89ae-659f5e54e7eb service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:22.655454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f773fa-d52e-47f2-89ae-659f5e54e7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:22.655734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f773fa-d52e-47f2-89ae-659f5e54e7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:22.665265 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f773fa-d52e-47f2-89ae-659f5e54e7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:22.666638 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f773fa-d52e-47f2-89ae-659f5e54e7eb service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:22.676789 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1307/2659] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:22.952081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17dcd9-c0fc-4084-97f6-4b9c9c87bd4a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:22.952081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-eb17dcd9-c0fc-4084-97f6-4b9c9c87bd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:22.962670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17dcd9-c0fc-4084-97f6-4b9c9c87bd4a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:22.967587 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:22.968474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:22.968764 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:22.969042 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] PATH_INFO: `/v3/projects/4565bd26a3f1458a86c63a9d8d206a6c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:22.970326 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4565bd26a3f1458a86c63a9d8d206a6c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:22.972245 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:23.022880 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4565bd26a3f1458a86c63a9d8d206a6c', 'request_id': 'req-69ce9caa-eb95-44f5-a8a5-960820277b99'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.029494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4565bd26a3f1458a86c63a9d8d206a6c', 'request_id': 'req-69ce9caa-eb95-44f5-a8a5-960820277b99'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.035316 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4565bd26a3f1458a86c63a9d8d206a6c', 'request_id': 'req-69ce9caa-eb95-44f5-a8a5-960820277b99'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.048939 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] The token cache is being invalidate because project 4565bd26a3f1458a86c63a9d8d206a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:44:23.049226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.049842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.051379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1353/2660] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:44:22 2022] DELETE /identity/v3/projects/4565bd26a3f1458a86c63a9d8d206a6c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:23.055415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f773fa-d52e-47f2-89ae-659f5e54e7eb service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:23.065616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f773fa-d52e-47f2-89ae-659f5e54e7eb service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:23.083413 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:23.123018 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618644c-9d99-4f14-9d70-a602cc2986b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:23.123888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618644c-9d99-4f14-9d70-a602cc2986b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:23.124172 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618644c-9d99-4f14-9d70-a602cc2986b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:23.124487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618644c-9d99-4f14-9d70-a602cc2986b1 admin admin] PATH_INFO: `/v3/users/6a3cb9cde6254a74b1ac22e2b1bd76c5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:23.125672 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618644c-9d99-4f14-9d70-a602cc2986b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a3cb9cde6254a74b1ac22e2b1bd76c5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:23.127584 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618644c-9d99-4f14-9d70-a602cc2986b1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:23.171997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c618644c-9d99-4f14-9d70-a602cc2986b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a3cb9cde6254a74b1ac22e2b1bd76c5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.184178 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c618644c-9d99-4f14-9d70-a602cc2986b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a3cb9cde6254a74b1ac22e2b1bd76c5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.184847 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c618644c-9d99-4f14-9d70-a602cc2986b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a3cb9cde6254a74b1ac22e2b1bd76c5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.192078 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c618644c-9d99-4f14-9d70-a602cc2986b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a3cb9cde6254a74b1ac22e2b1bd76c5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.192729 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c618644c-9d99-4f14-9d70-a602cc2986b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a3cb9cde6254a74b1ac22e2b1bd76c5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.205607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1308/2661] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:44:23 2022] DELETE /identity/v3/users/6a3cb9cde6254a74b1ac22e2b1bd76c5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:23.486566 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:23.488119 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:23.502886 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce9caa-eb95-44f5-a8a5-960820277b99 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:23.560343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673c032-f439-4bb1-abce-277b590183d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:23.561251 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673c032-f439-4bb1-abce-277b590183d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:23.561535 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673c032-f439-4bb1-abce-277b590183d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:23.561810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673c032-f439-4bb1-abce-277b590183d7 admin admin] PATH_INFO: `/v3/projects/de63ee7f9c11469a89770fc27a0bfbc4` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:23.562976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673c032-f439-4bb1-abce-277b590183d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de63ee7f9c11469a89770fc27a0bfbc4)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:23.564922 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673c032-f439-4bb1-abce-277b590183d7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:23.594400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:23.615064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6673c032-f439-4bb1-abce-277b590183d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de63ee7f9c11469a89770fc27a0bfbc4', 'request_id': 'req-6673c032-f439-4bb1-abce-277b590183d7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.621234 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6673c032-f439-4bb1-abce-277b590183d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de63ee7f9c11469a89770fc27a0bfbc4', 'request_id': 'req-6673c032-f439-4bb1-abce-277b590183d7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.626886 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6673c032-f439-4bb1-abce-277b590183d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de63ee7f9c11469a89770fc27a0bfbc4', 'request_id': 'req-6673c032-f439-4bb1-abce-277b590183d7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.639362 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6673c032-f439-4bb1-abce-277b590183d7 admin admin] The token cache is being invalidate because project de63ee7f9c11469a89770fc27a0bfbc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:44:23.639646 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6673c032-f439-4bb1-abce-277b590183d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.640277 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6673c032-f439-4bb1-abce-277b590183d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:23.641822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1354/2662] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:44:23 2022] DELETE /identity/v3/projects/de63ee7f9c11469a89770fc27a0bfbc4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:23.647917 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfadf3-aa56-4606-9457-d11e9916c12d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:23.648301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfadf3-aa56-4606-9457-d11e9916c12d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:23.648638 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfadf3-aa56-4606-9457-d11e9916c12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:23.667673 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-30dfadf3-aa56-4606-9457-d11e9916c12d None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:23.670357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-30dfadf3-aa56-4606-9457-d11e9916c12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:23.728970 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1309/2663] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:23.737592 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfddad-b6de-4300-b79e-1dd6c013537f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:23.737890 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfddad-b6de-4300-b79e-1dd6c013537f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:23.738172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfddad-b6de-4300-b79e-1dd6c013537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:23.756472 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-47bfddad-b6de-4300-b79e-1dd6c013537f None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:23.757676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-47bfddad-b6de-4300-b79e-1dd6c013537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:23.765546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1355/2664] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:23.769782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfadf3-aa56-4606-9457-d11e9916c12d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:23.780258 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfadf3-aa56-4606-9457-d11e9916c12d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:23.784877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509cd31-c213-4e66-bc11-437e2bf5694c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:23.785533 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509cd31-c213-4e66-bc11-437e2bf5694c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:23.785819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509cd31-c213-4e66-bc11-437e2bf5694c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:23.786132 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509cd31-c213-4e66-bc11-437e2bf5694c admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:23.786855 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509cd31-c213-4e66-bc11-437e2bf5694c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:44:23.787165 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509cd31-c213-4e66-bc11-437e2bf5694c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:23.788813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509cd31-c213-4e66-bc11-437e2bf5694c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:23.801540 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1310/2665] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:44:23.805604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfddad-b6de-4300-b79e-1dd6c013537f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:23.814828 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfddad-b6de-4300-b79e-1dd6c013537f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:23.819385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cb1dc-fcab-4feb-882b-4f860332d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:23.820025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb1dc-fcab-4feb-882b-4f860332d8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:23.820309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb1dc-fcab-4feb-882b-4f860332d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:23.820626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb1dc-fcab-4feb-882b-4f860332d8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:23.821316 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cb1dc-fcab-4feb-882b-4f860332d8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:23.823195 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cb1dc-fcab-4feb-882b-4f860332d8ff admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:23.848988 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1356/2666] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:44:23 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:23.852988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509cd31-c213-4e66-bc11-437e2bf5694c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:23.862787 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509cd31-c213-4e66-bc11-437e2bf5694c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:23.888830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:23.921125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd364724-c9a4-4872-8524-14a1785a5307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:23.921826 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364724-c9a4-4872-8524-14a1785a5307 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:23.922113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364724-c9a4-4872-8524-14a1785a5307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:23.922417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364724-c9a4-4872-8524-14a1785a5307 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:23.923113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd364724-c9a4-4872-8524-14a1785a5307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:23.925076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd364724-c9a4-4872-8524-14a1785a5307 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:23.944661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1311/2667] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:44:23 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:23.948722 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cb1dc-fcab-4feb-882b-4f860332d8ff admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:23.959911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cb1dc-fcab-4feb-882b-4f860332d8ff admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:23.965383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847ae4a-c4f3-48eb-acef-4df4eb0b5e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:23.966201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847ae4a-c4f3-48eb-acef-4df4eb0b5e59 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:23.966491 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847ae4a-c4f3-48eb-acef-4df4eb0b5e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:23.966769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847ae4a-c4f3-48eb-acef-4df4eb0b5e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:23.967501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847ae4a-c4f3-48eb-acef-4df4eb0b5e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:23.969134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847ae4a-c4f3-48eb-acef-4df4eb0b5e59 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:23.979974 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1357/2668] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:23.984152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd364724-c9a4-4872-8524-14a1785a5307 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:23.994437 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd364724-c9a4-4872-8524-14a1785a5307 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:23.999720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b906228-6103-4868-af22-222aa1bfb104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:24.000410 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b906228-6103-4868-af22-222aa1bfb104 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:24.000713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b906228-6103-4868-af22-222aa1bfb104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:24.000992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b906228-6103-4868-af22-222aa1bfb104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:24.001716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b906228-6103-4868-af22-222aa1bfb104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:24.003302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b906228-6103-4868-af22-222aa1bfb104 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:24.017270 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1312/2669] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:24.018452 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847ae4a-c4f3-48eb-acef-4df4eb0b5e59 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:24.029346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847ae4a-c4f3-48eb-acef-4df4eb0b5e59 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:24.033976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adaa7a2-8296-4eef-bf1a-b665a2cfd0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:24.034811 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaa7a2-8296-4eef-bf1a-b665a2cfd0fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:24.035093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaa7a2-8296-4eef-bf1a-b665a2cfd0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:24.035367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaa7a2-8296-4eef-bf1a-b665a2cfd0fd admin admin] PATH_INFO: `/v3/projects/fd41ca7d480f4e84bcbca1cc15d572d6/users/e0e13762259147e4855c34702140d57c/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:24.050441 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adaa7a2-8296-4eef-bf1a-b665a2cfd0fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd41ca7d480f4e84bcbca1cc15d572d6, user_id=e0e13762259147e4855c34702140d57c, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:24.053227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adaa7a2-8296-4eef-bf1a-b665a2cfd0fd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:24.066583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1358/2670] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:44:24 2022] PUT /identity/v3/projects/fd41ca7d480f4e84bcbca1cc15d572d6/users/e0e13762259147e4855c34702140d57c/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:24.081865 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85994c-89c1-4c64-9646-6f7d32eef0ad None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:24.082621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85994c-89c1-4c64-9646-6f7d32eef0ad None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:24.082621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85994c-89c1-4c64-9646-6f7d32eef0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:24.111367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7d85994c-89c1-4c64-9646-6f7d32eef0ad None None] MFA Rules not processed for user `e0e13762259147e4855c34702140d57c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:24.112707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7d85994c-89c1-4c64-9646-6f7d32eef0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:24.186833 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1313/2671] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:24.197562 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adaa7a2-8296-4eef-bf1a-b665a2cfd0fd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:24.199893 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8adaa7a2-8296-4eef-bf1a-b665a2cfd0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:24.256174 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adaa7a2-8296-4eef-bf1a-b665a2cfd0fd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:24.260217 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9af24-6236-4490-8d35-d63dd41cb23a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93958c7dad0540b296b316169932d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:24.261002 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9af24-6236-4490-8d35-d63dd41cb23a service glance] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:24.261310 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9af24-6236-4490-8d35-d63dd41cb23a service glance] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:24.262198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9af24-6236-4490-8d35-d63dd41cb23a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:24.270914 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9af24-6236-4490-8d35-d63dd41cb23a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:24.273040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9af24-6236-4490-8d35-d63dd41cb23a service glance] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:24.282598 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1359/2672] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:28.978694 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85994c-89c1-4c64-9646-6f7d32eef0ad None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:28.980125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7d85994c-89c1-4c64-9646-6f7d32eef0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:29.056011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85994c-89c1-4c64-9646-6f7d32eef0ad None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:29.061038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd26863-65dd-48fe-aaaa-7d9e72752075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:29.062279 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd26863-65dd-48fe-aaaa-7d9e72752075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:29.062279 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd26863-65dd-48fe-aaaa-7d9e72752075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:29.062489 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd26863-65dd-48fe-aaaa-7d9e72752075 admin admin] PATH_INFO: `/v3/users/bdf31e0226824f80bb4332444d1c0ad0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:29.063620 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd26863-65dd-48fe-aaaa-7d9e72752075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf31e0226824f80bb4332444d1c0ad0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:29.065599 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd26863-65dd-48fe-aaaa-7d9e72752075 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:29.108587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:29.120079 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bcd26863-65dd-48fe-aaaa-7d9e72752075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf31e0226824f80bb4332444d1c0ad0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:29.132940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bcd26863-65dd-48fe-aaaa-7d9e72752075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf31e0226824f80bb4332444d1c0ad0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:29.133629 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bcd26863-65dd-48fe-aaaa-7d9e72752075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf31e0226824f80bb4332444d1c0ad0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:29.141621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bcd26863-65dd-48fe-aaaa-7d9e72752075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf31e0226824f80bb4332444d1c0ad0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:29.142257 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bcd26863-65dd-48fe-aaaa-7d9e72752075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf31e0226824f80bb4332444d1c0ad0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:29.156619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1314/2673] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:44:28 2022] DELETE /identity/v3/users/bdf31e0226824f80bb4332444d1c0ad0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:29.161314 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b344af-37af-403f-a35e-d1aaddce51e3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:29.161907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b344af-37af-403f-a35e-d1aaddce51e3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:29.162192 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b344af-37af-403f-a35e-d1aaddce51e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:29.181481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-47b344af-37af-403f-a35e-d1aaddce51e3 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:29.182707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-47b344af-37af-403f-a35e-d1aaddce51e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:29.232504 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:29.246509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1360/2674] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:29.257102 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd26863-65dd-48fe-aaaa-7d9e72752075 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:29.258720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bcd26863-65dd-48fe-aaaa-7d9e72752075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:29.325009 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd26863-65dd-48fe-aaaa-7d9e72752075 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:29.329734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e800f-ecf9-4c90-abf8-ea096a49f5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:29.330394 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e800f-ecf9-4c90-abf8-ea096a49f5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:29.330685 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e800f-ecf9-4c90-abf8-ea096a49f5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:29.330968 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e800f-ecf9-4c90-abf8-ea096a49f5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:29.340587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e800f-ecf9-4c90-abf8-ea096a49f5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:29.342869 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e800f-ecf9-4c90-abf8-ea096a49f5e4 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:29.353179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1315/2675] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:44:29.646091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b344af-37af-403f-a35e-d1aaddce51e3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:29.647612 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-47b344af-37af-403f-a35e-d1aaddce51e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:29.660311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b344af-37af-403f-a35e-d1aaddce51e3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:29.665225 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cbf7f-33d8-4450-abe7-b20f9c124c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:29.666083 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cbf7f-33d8-4450-abe7-b20f9c124c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:29.666374 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cbf7f-33d8-4450-abe7-b20f9c124c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:29.666650 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cbf7f-33d8-4450-abe7-b20f9c124c98 admin admin] PATH_INFO: `/v3/projects/5da51e0fe43d4d789d801d82e3080319` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:29.667839 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cbf7f-33d8-4450-abe7-b20f9c124c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da51e0fe43d4d789d801d82e3080319)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:29.669802 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cbf7f-33d8-4450-abe7-b20f9c124c98 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:29.718135 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-182cbf7f-33d8-4450-abe7-b20f9c124c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da51e0fe43d4d789d801d82e3080319', 'request_id': 'req-182cbf7f-33d8-4450-abe7-b20f9c124c98'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:29.724187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-182cbf7f-33d8-4450-abe7-b20f9c124c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da51e0fe43d4d789d801d82e3080319', 'request_id': 'req-182cbf7f-33d8-4450-abe7-b20f9c124c98'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:29.729650 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-182cbf7f-33d8-4450-abe7-b20f9c124c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da51e0fe43d4d789d801d82e3080319', 'request_id': 'req-182cbf7f-33d8-4450-abe7-b20f9c124c98'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:29.741718 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-182cbf7f-33d8-4450-abe7-b20f9c124c98 admin admin] The token cache is being invalidate because project 5da51e0fe43d4d789d801d82e3080319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:44:29.742004 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-182cbf7f-33d8-4450-abe7-b20f9c124c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:29.742636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-182cbf7f-33d8-4450-abe7-b20f9c124c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:29.744198 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1361/2676] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:44:29 2022] DELETE /identity/v3/projects/5da51e0fe43d4d789d801d82e3080319 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:29.750266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a735-b41c-4629-8b8e-60a03ed098da None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:29.750496 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a735-b41c-4629-8b8e-60a03ed098da None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:29.750777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a735-b41c-4629-8b8e-60a03ed098da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:29.769779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b9a1a735-b41c-4629-8b8e-60a03ed098da None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:29.771025 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b9a1a735-b41c-4629-8b8e-60a03ed098da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:29.832302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1316/2677] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:44:29.841148 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d2e26-27d0-47ef-abf4-89d5dae898c8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:29.841460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d2e26-27d0-47ef-abf4-89d5dae898c8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:29.841742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d2e26-27d0-47ef-abf4-89d5dae898c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:29.860443 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-570d2e26-27d0-47ef-abf4-89d5dae898c8 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:29.861655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-570d2e26-27d0-47ef-abf4-89d5dae898c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:29.869777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1362/2678] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:29.874647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a735-b41c-4629-8b8e-60a03ed098da None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:29.885057 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a735-b41c-4629-8b8e-60a03ed098da None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:29.889778 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92b9e2-0ecc-49c9-921e-e7e4426f7ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:29.890433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92b9e2-0ecc-49c9-921e-e7e4426f7ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:29.890721 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92b9e2-0ecc-49c9-921e-e7e4426f7ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:29.891006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92b9e2-0ecc-49c9-921e-e7e4426f7ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:29.891734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92b9e2-0ecc-49c9-921e-e7e4426f7ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:44:29.892046 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92b9e2-0ecc-49c9-921e-e7e4426f7ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:29.893682 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92b9e2-0ecc-49c9-921e-e7e4426f7ef6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:29.908255 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1317/2679] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:44:29.912728 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d2e26-27d0-47ef-abf4-89d5dae898c8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:29.922681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d2e26-27d0-47ef-abf4-89d5dae898c8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:29.927294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b139ae-1b31-415d-aadf-0cd83cd47094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:29.927941 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b139ae-1b31-415d-aadf-0cd83cd47094 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:29.928224 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b139ae-1b31-415d-aadf-0cd83cd47094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:29.928531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b139ae-1b31-415d-aadf-0cd83cd47094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:29.929216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b139ae-1b31-415d-aadf-0cd83cd47094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:29.931107 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b139ae-1b31-415d-aadf-0cd83cd47094 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:29.956843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1363/2680] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:44:29 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:29.960861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92b9e2-0ecc-49c9-921e-e7e4426f7ef6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:29.971980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92b9e2-0ecc-49c9-921e-e7e4426f7ef6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:30.021418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:30.035133 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ce9e9-9881-464b-ba8f-a9e16f08afcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:30.036060 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ce9e9-9881-464b-ba8f-a9e16f08afcd admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:30.036572 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ce9e9-9881-464b-ba8f-a9e16f08afcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:30.037235 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ce9e9-9881-464b-ba8f-a9e16f08afcd admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:30.038025 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ce9e9-9881-464b-ba8f-a9e16f08afcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:30.040262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ce9e9-9881-464b-ba8f-a9e16f08afcd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:30.066458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1318/2681] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:44:29 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:30.067643 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b139ae-1b31-415d-aadf-0cd83cd47094 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:30.079025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b139ae-1b31-415d-aadf-0cd83cd47094 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:30.083631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ce06e-64e4-4804-86f6-ff11c5f418da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:30.084294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ce06e-64e4-4804-86f6-ff11c5f418da admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:30.084615 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ce06e-64e4-4804-86f6-ff11c5f418da admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:30.084897 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ce06e-64e4-4804-86f6-ff11c5f418da admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:30.085629 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ce06e-64e4-4804-86f6-ff11c5f418da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:30.087228 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ce06e-64e4-4804-86f6-ff11c5f418da admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:30.099218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1364/2682] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:44:30.103339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ce9e9-9881-464b-ba8f-a9e16f08afcd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:30.114595 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ce9e9-9881-464b-ba8f-a9e16f08afcd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:30.119337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246f8aa-7af2-4e63-b3f6-0865395a76ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:30.119996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246f8aa-7af2-4e63-b3f6-0865395a76ef admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:30.120285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246f8aa-7af2-4e63-b3f6-0865395a76ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:30.120803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246f8aa-7af2-4e63-b3f6-0865395a76ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:30.121737 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246f8aa-7af2-4e63-b3f6-0865395a76ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:30.124670 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246f8aa-7af2-4e63-b3f6-0865395a76ef admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:30.134948 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1319/2683] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:30.139098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ce06e-64e4-4804-86f6-ff11c5f418da admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:30.149046 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ce06e-64e4-4804-86f6-ff11c5f418da admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:30.154567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a148b-4f28-402d-b2b7-a5afee1e5f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:30.155430 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a148b-4f28-402d-b2b7-a5afee1e5f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:30.155710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a148b-4f28-402d-b2b7-a5afee1e5f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:30.155994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a148b-4f28-402d-b2b7-a5afee1e5f42 admin admin] PATH_INFO: `/v3/projects/6c09076eac534571bd221e2cc5872fc6/users/ce5f88b90c3b43439d4f3f9b3dc63fff/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:30.170966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a148b-4f28-402d-b2b7-a5afee1e5f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c09076eac534571bd221e2cc5872fc6, user_id=ce5f88b90c3b43439d4f3f9b3dc63fff, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:30.173655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a148b-4f28-402d-b2b7-a5afee1e5f42 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:30.187242 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1365/2684] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:44:30 2022] PUT /identity/v3/projects/6c09076eac534571bd221e2cc5872fc6/users/ce5f88b90c3b43439d4f3f9b3dc63fff/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:44:30.192147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca5235-15b5-40df-bdb7-37aed0ec9aff None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:30.192492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca5235-15b5-40df-bdb7-37aed0ec9aff None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:30.192779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca5235-15b5-40df-bdb7-37aed0ec9aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:30.210931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-90ca5235-15b5-40df-bdb7-37aed0ec9aff None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:30.212156 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-90ca5235-15b5-40df-bdb7-37aed0ec9aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:30.273292 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1320/2685] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:30.283479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a148b-4f28-402d-b2b7-a5afee1e5f42 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:30.285449 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bd5a148b-4f28-402d-b2b7-a5afee1e5f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:30.345616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a148b-4f28-402d-b2b7-a5afee1e5f42 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:30.349604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e574ca-2aef-4851-b9b1-01feb266e8c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:30.350260 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e574ca-2aef-4851-b9b1-01feb266e8c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:30.350543 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e574ca-2aef-4851-b9b1-01feb266e8c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:30.350826 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e574ca-2aef-4851-b9b1-01feb266e8c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:30.360446 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e574ca-2aef-4851-b9b1-01feb266e8c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:30.361883 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e574ca-2aef-4851-b9b1-01feb266e8c5 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:30.371448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1366/2686] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 20:44:33.123160 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdda46b-b00d-4ded-b92c-04e93f27a2fe None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:33.123714 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdda46b-b00d-4ded-b92c-04e93f27a2fe None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:33.123825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdda46b-b00d-4ded-b92c-04e93f27a2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:33.146304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3bdda46b-b00d-4ded-b92c-04e93f27a2fe None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:33.147790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3bdda46b-b00d-4ded-b92c-04e93f27a2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:33.267790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1321/2687] 10.222.0.66 () {58 vars in 967 bytes} [Fri Jul 15 20:44:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:33.283263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e574ca-2aef-4851-b9b1-01feb266e8c5 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:33.285663 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-49e574ca-2aef-4851-b9b1-01feb266e8c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:33.322162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:33.407572 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e574ca-2aef-4851-b9b1-01feb266e8c5 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:33.417849 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5ffaf-ec78-435b-9500-60a58638540a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:33.418557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ffaf-ec78-435b-9500-60a58638540a service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:33.418846 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ffaf-ec78-435b-9500-60a58638540a service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:33.419175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ffaf-ec78-435b-9500-60a58638540a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:33.430822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5ffaf-ec78-435b-9500-60a58638540a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:33.432474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5ffaf-ec78-435b-9500-60a58638540a service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:33.449426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1367/2688] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:44:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 20:44:34.957675 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3917c-13f3-4c87-bcd6-f26ec4ef0368 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:34.958203 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3917c-13f3-4c87-bcd6-f26ec4ef0368 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:34.958380 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3917c-13f3-4c87-bcd6-f26ec4ef0368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:34.995223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-47d3917c-13f3-4c87-bcd6-f26ec4ef0368 None None] MFA Rules not processed for user `ce5f88b90c3b43439d4f3f9b3dc63fff`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:34.996788 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-47d3917c-13f3-4c87-bcd6-f26ec4ef0368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:35.068210 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:35.072464 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1322/2689] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:35.077171 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5ffaf-ec78-435b-9500-60a58638540a service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:35.087994 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5ffaf-ec78-435b-9500-60a58638540a service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:35.094829 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb9910-b1de-4519-897b-d16c7148d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:35.095506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9910-b1de-4519-897b-d16c7148d9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:35.095795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9910-b1de-4519-897b-d16c7148d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:35.096076 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9910-b1de-4519-897b-d16c7148d9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:35.096830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb9910-b1de-4519-897b-d16c7148d9d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:35.098881 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb9910-b1de-4519-897b-d16c7148d9d0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:35.131211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1368/2690] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:44:35 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:44:35.132450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3917c-13f3-4c87-bcd6-f26ec4ef0368 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:35.143726 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3917c-13f3-4c87-bcd6-f26ec4ef0368 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:35.205517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650362dc-76f6-4aa2-b4b4-0a45baf009ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:35.206286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650362dc-76f6-4aa2-b4b4-0a45baf009ab admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:35.206590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650362dc-76f6-4aa2-b4b4-0a45baf009ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:35.206863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650362dc-76f6-4aa2-b4b4-0a45baf009ab admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:35.207748 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650362dc-76f6-4aa2-b4b4-0a45baf009ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:35.210068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650362dc-76f6-4aa2-b4b4-0a45baf009ab admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:35.235543 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1323/2691] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:44:35 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:35.239903 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb9910-b1de-4519-897b-d16c7148d9d0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:35.251568 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb9910-b1de-4519-897b-d16c7148d9d0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:35.256270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46e5a4-95d6-47a7-a261-01a0e0b641af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:35.257098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46e5a4-95d6-47a7-a261-01a0e0b641af admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:35.257382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46e5a4-95d6-47a7-a261-01a0e0b641af admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:35.257655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46e5a4-95d6-47a7-a261-01a0e0b641af admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:35.258378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46e5a4-95d6-47a7-a261-01a0e0b641af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:35.259983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46e5a4-95d6-47a7-a261-01a0e0b641af admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:35.271311 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1369/2692] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:35.275530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650362dc-76f6-4aa2-b4b4-0a45baf009ab admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:35.287733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650362dc-76f6-4aa2-b4b4-0a45baf009ab admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:35.293516 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209169d-f610-409b-9c28-2dbd015b701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:35.295126 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209169d-f610-409b-9c28-2dbd015b701b admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:35.295413 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209169d-f610-409b-9c28-2dbd015b701b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:35.295696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209169d-f610-409b-9c28-2dbd015b701b admin admin] PATH_INFO: `/v3/projects/56ba47e7d58442a1a11a998fb036a111/users/439ef95f27a34b7e94228cc74cf4caf7/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:35.313168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209169d-f610-409b-9c28-2dbd015b701b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ba47e7d58442a1a11a998fb036a111, user_id=439ef95f27a34b7e94228cc74cf4caf7, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:35.315919 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209169d-f610-409b-9c28-2dbd015b701b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:35.335574 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1324/2693] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:44:35 2022] PUT /identity/v3/projects/56ba47e7d58442a1a11a998fb036a111/users/439ef95f27a34b7e94228cc74cf4caf7/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:35.339627 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46e5a4-95d6-47a7-a261-01a0e0b641af admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:35.350579 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46e5a4-95d6-47a7-a261-01a0e0b641af admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:35.409360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37323988-91fa-485f-9315-5443e5ce8aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:35.410042 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37323988-91fa-485f-9315-5443e5ce8aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:35.410327 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37323988-91fa-485f-9315-5443e5ce8aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:35.410606 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37323988-91fa-485f-9315-5443e5ce8aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:35.411356 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37323988-91fa-485f-9315-5443e5ce8aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:35.412981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37323988-91fa-485f-9315-5443e5ce8aa4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:35.424102 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1370/2694] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:35.428590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209169d-f610-409b-9c28-2dbd015b701b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:35.443313 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209169d-f610-409b-9c28-2dbd015b701b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:35.447179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256a9b6-0cac-41ef-8167-079c00e0f08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:35.448101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a9b6-0cac-41ef-8167-079c00e0f08b admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:35.448383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a9b6-0cac-41ef-8167-079c00e0f08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:35.448691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a9b6-0cac-41ef-8167-079c00e0f08b admin admin] PATH_INFO: `/v3/projects/56ba47e7d58442a1a11a998fb036a111/users/439ef95f27a34b7e94228cc74cf4caf7/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:35.450772 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256a9b6-0cac-41ef-8167-079c00e0f08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ba47e7d58442a1a11a998fb036a111, user_id=439ef95f27a34b7e94228cc74cf4caf7, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:35.453512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256a9b6-0cac-41ef-8167-079c00e0f08b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:35.464285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1325/2695] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:44:35 2022] PUT /identity/v3/projects/56ba47e7d58442a1a11a998fb036a111/users/439ef95f27a34b7e94228cc74cf4caf7/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:39.774359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24296a1-7cf7-461a-930c-949b84c2754f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:39.775258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24296a1-7cf7-461a-930c-949b84c2754f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:39.775567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24296a1-7cf7-461a-930c-949b84c2754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:39.819607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f24296a1-7cf7-461a-930c-949b84c2754f None None] MFA Rules not processed for user `439ef95f27a34b7e94228cc74cf4caf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:39.820952 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f24296a1-7cf7-461a-930c-949b84c2754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:39.887112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:39.944100 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1371/2696] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:39.959244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256a9b6-0cac-41ef-8167-079c00e0f08b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:39.961654 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5256a9b6-0cac-41ef-8167-079c00e0f08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:40.101920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:40.135211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256a9b6-0cac-41ef-8167-079c00e0f08b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:40.141286 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcbbac-1c3e-4b45-9ed3-d223fb0bfac2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:40.141957 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcbbac-1c3e-4b45-9ed3-d223fb0bfac2 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:40.142249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcbbac-1c3e-4b45-9ed3-d223fb0bfac2 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:40.142532 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcbbac-1c3e-4b45-9ed3-d223fb0bfac2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:40.202108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcbbac-1c3e-4b45-9ed3-d223fb0bfac2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:40.203734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcbbac-1c3e-4b45-9ed3-d223fb0bfac2 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:40.216664 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1326/2697] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:41.091763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24296a1-7cf7-461a-930c-949b84c2754f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:41.093368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f24296a1-7cf7-461a-930c-949b84c2754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:41.210740 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24296a1-7cf7-461a-930c-949b84c2754f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:41.215589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bc874-14a5-49a5-8da1-5fd1968dbd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:41.216323 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bc874-14a5-49a5-8da1-5fd1968dbd95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:41.216647 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bc874-14a5-49a5-8da1-5fd1968dbd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:41.216929 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bc874-14a5-49a5-8da1-5fd1968dbd95 admin admin] PATH_INFO: `/v3/users/e0e13762259147e4855c34702140d57c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:41.218360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bc874-14a5-49a5-8da1-5fd1968dbd95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e13762259147e4855c34702140d57c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:41.221390 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bc874-14a5-49a5-8da1-5fd1968dbd95 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:41.295473 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0c4bc874-14a5-49a5-8da1-5fd1968dbd95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e13762259147e4855c34702140d57c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:41.305285 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0c4bc874-14a5-49a5-8da1-5fd1968dbd95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e13762259147e4855c34702140d57c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:41.314905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0c4bc874-14a5-49a5-8da1-5fd1968dbd95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e13762259147e4855c34702140d57c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:41.315676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0c4bc874-14a5-49a5-8da1-5fd1968dbd95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e13762259147e4855c34702140d57c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:41.330834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0c4bc874-14a5-49a5-8da1-5fd1968dbd95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e13762259147e4855c34702140d57c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:41.338770 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1372/2698] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:44:41 2022] DELETE /identity/v3/users/e0e13762259147e4855c34702140d57c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:41.343307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f856698-3371-474a-a02e-b3ba14a42eae None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:41.343990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f856698-3371-474a-a02e-b3ba14a42eae None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:41.344282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f856698-3371-474a-a02e-b3ba14a42eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:41.376964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8f856698-3371-474a-a02e-b3ba14a42eae None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:41.378233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8f856698-3371-474a-a02e-b3ba14a42eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:41.466683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1327/2699] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:41.476622 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bc874-14a5-49a5-8da1-5fd1968dbd95 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:41.478705 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0c4bc874-14a5-49a5-8da1-5fd1968dbd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:41.495690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:41.556079 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bc874-14a5-49a5-8da1-5fd1968dbd95 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:41.561317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e582a-9d0d-437a-beea-a01acb334402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:41.561993 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e582a-9d0d-437a-beea-a01acb334402 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:41.562667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e582a-9d0d-437a-beea-a01acb334402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:41.562667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e582a-9d0d-437a-beea-a01acb334402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:41.575651 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e582a-9d0d-437a-beea-a01acb334402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:41.577567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e582a-9d0d-437a-beea-a01acb334402 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:41.589109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1373/2700] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:41.892125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f856698-3371-474a-a02e-b3ba14a42eae None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:41.894064 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8f856698-3371-474a-a02e-b3ba14a42eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:41.909093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f856698-3371-474a-a02e-b3ba14a42eae None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:41.913956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e1feb-e158-4222-abf5-170e708c6d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:41.915219 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1feb-e158-4222-abf5-170e708c6d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:41.915573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1feb-e158-4222-abf5-170e708c6d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:41.915979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1feb-e158-4222-abf5-170e708c6d21 admin admin] PATH_INFO: `/v3/projects/fd41ca7d480f4e84bcbca1cc15d572d6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:41.917297 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e1feb-e158-4222-abf5-170e708c6d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd41ca7d480f4e84bcbca1cc15d572d6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:41.920070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e1feb-e158-4222-abf5-170e708c6d21 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:41.975130 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fc1e1feb-e158-4222-abf5-170e708c6d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd41ca7d480f4e84bcbca1cc15d572d6', 'request_id': 'req-fc1e1feb-e158-4222-abf5-170e708c6d21'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:41.984510 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fc1e1feb-e158-4222-abf5-170e708c6d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd41ca7d480f4e84bcbca1cc15d572d6', 'request_id': 'req-fc1e1feb-e158-4222-abf5-170e708c6d21'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:41.991409 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fc1e1feb-e158-4222-abf5-170e708c6d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd41ca7d480f4e84bcbca1cc15d572d6', 'request_id': 'req-fc1e1feb-e158-4222-abf5-170e708c6d21'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:42.001864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:42.006411 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fc1e1feb-e158-4222-abf5-170e708c6d21 admin admin] The token cache is being invalidate because project fd41ca7d480f4e84bcbca1cc15d572d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:44:42.006759 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fc1e1feb-e158-4222-abf5-170e708c6d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:42.007677 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fc1e1feb-e158-4222-abf5-170e708c6d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:42.009745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1328/2701] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:44:41 2022] DELETE /identity/v3/projects/fd41ca7d480f4e84bcbca1cc15d572d6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:44:42.014706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75238dd-d136-4184-8385-8425efd5a6c1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:42.015000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75238dd-d136-4184-8385-8425efd5a6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:42.015282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75238dd-d136-4184-8385-8425efd5a6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:42.076234 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a75238dd-d136-4184-8385-8425efd5a6c1 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:42.078595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a75238dd-d136-4184-8385-8425efd5a6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:42.149661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1374/2702] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:44:42.159421 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3a120-bd1d-463f-83d2-7aa5d5429c14 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:42.159713 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3a120-bd1d-463f-83d2-7aa5d5429c14 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:42.160035 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3a120-bd1d-463f-83d2-7aa5d5429c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:42.180696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-43e3a120-bd1d-463f-83d2-7aa5d5429c14 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:42.181898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-43e3a120-bd1d-463f-83d2-7aa5d5429c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:42.189997 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1329/2703] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:42.194595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75238dd-d136-4184-8385-8425efd5a6c1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:42.205216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75238dd-d136-4184-8385-8425efd5a6c1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:42.210238 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809efd9-2d20-4079-91c9-b19ce11d8910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:42.210906 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809efd9-2d20-4079-91c9-b19ce11d8910 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:42.211189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809efd9-2d20-4079-91c9-b19ce11d8910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:42.211468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809efd9-2d20-4079-91c9-b19ce11d8910 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:42.212190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809efd9-2d20-4079-91c9-b19ce11d8910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:44:42.212547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809efd9-2d20-4079-91c9-b19ce11d8910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:42.214392 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809efd9-2d20-4079-91c9-b19ce11d8910 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:42.228692 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1375/2704] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:44:42.233754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3a120-bd1d-463f-83d2-7aa5d5429c14 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:42.243167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3a120-bd1d-463f-83d2-7aa5d5429c14 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:42.247953 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fb041-bc03-4061-87d6-1a97bfea1825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:42.248651 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fb041-bc03-4061-87d6-1a97bfea1825 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:42.248938 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fb041-bc03-4061-87d6-1a97bfea1825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:42.249244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fb041-bc03-4061-87d6-1a97bfea1825 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:42.250292 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fb041-bc03-4061-87d6-1a97bfea1825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:42.252332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fb041-bc03-4061-87d6-1a97bfea1825 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:42.281089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1330/2705] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:44:42 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:42.285665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809efd9-2d20-4079-91c9-b19ce11d8910 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:42.298477 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809efd9-2d20-4079-91c9-b19ce11d8910 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:42.361400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f4fc5-5094-46c8-badb-57c807003e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:42.363582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f4fc5-5094-46c8-badb-57c807003e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:42.363582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f4fc5-5094-46c8-badb-57c807003e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:42.363582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f4fc5-5094-46c8-badb-57c807003e50 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:42.364014 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f4fc5-5094-46c8-badb-57c807003e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:42.366090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f4fc5-5094-46c8-badb-57c807003e50 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:42.391599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1376/2706] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:44:42 2022] POST /identity/v3/users => generated 280 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:42.395440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fb041-bc03-4061-87d6-1a97bfea1825 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:42.411336 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fb041-bc03-4061-87d6-1a97bfea1825 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:42.423049 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604c563-b7bd-4480-9686-d5017facc108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:42.423673 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604c563-b7bd-4480-9686-d5017facc108 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:42.423892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604c563-b7bd-4480-9686-d5017facc108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:42.424176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604c563-b7bd-4480-9686-d5017facc108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:42.425003 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604c563-b7bd-4480-9686-d5017facc108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:42.426609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604c563-b7bd-4480-9686-d5017facc108 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:42.439833 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1331/2707] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:42.443653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f4fc5-5094-46c8-badb-57c807003e50 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:42.454919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f4fc5-5094-46c8-badb-57c807003e50 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:42.479264 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af1570-cbd8-486c-b591-e06bd19c917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:42.479974 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af1570-cbd8-486c-b591-e06bd19c917b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:42.480484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af1570-cbd8-486c-b591-e06bd19c917b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:42.480784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af1570-cbd8-486c-b591-e06bd19c917b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:42.482479 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af1570-cbd8-486c-b591-e06bd19c917b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:42.484566 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af1570-cbd8-486c-b591-e06bd19c917b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:42.485960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:42.507557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1377/2708] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:42.508756 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604c563-b7bd-4480-9686-d5017facc108 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:42.523638 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604c563-b7bd-4480-9686-d5017facc108 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:42.529462 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a69d75-e641-4bc6-8018-eefc485cb58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:42.530373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a69d75-e641-4bc6-8018-eefc485cb58a admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:42.530660 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a69d75-e641-4bc6-8018-eefc485cb58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:42.530940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a69d75-e641-4bc6-8018-eefc485cb58a admin admin] PATH_INFO: `/v3/projects/fb601cdf178c4b18aeb001d4957f23f5/users/8063ade56a6b4248afa6d79f4fbb7e63/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:42.551055 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a69d75-e641-4bc6-8018-eefc485cb58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb601cdf178c4b18aeb001d4957f23f5, user_id=8063ade56a6b4248afa6d79f4fbb7e63, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:42.554817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a69d75-e641-4bc6-8018-eefc485cb58a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:42.580051 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1332/2709] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:44:42 2022] PUT /identity/v3/projects/fb601cdf178c4b18aeb001d4957f23f5/users/8063ade56a6b4248afa6d79f4fbb7e63/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:42.593830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb808c-6f31-4123-8b11-dba9e4a1312c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:42.594127 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb808c-6f31-4123-8b11-dba9e4a1312c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:42.594415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb808c-6f31-4123-8b11-dba9e4a1312c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:42.638146 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fdfb808c-6f31-4123-8b11-dba9e4a1312c None None] MFA Rules not processed for user `8063ade56a6b4248afa6d79f4fbb7e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:42.639496 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fdfb808c-6f31-4123-8b11-dba9e4a1312c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:42.724261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1378/2710] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:42 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:42.756346 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a69d75-e641-4bc6-8018-eefc485cb58a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:42.758101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b1a69d75-e641-4bc6-8018-eefc485cb58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:42.819874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a69d75-e641-4bc6-8018-eefc485cb58a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:42.823596 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8d1e6-0138-4c6a-bc9e-d8718d5670bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:42.824247 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8d1e6-0138-4c6a-bc9e-d8718d5670bb service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:42.824566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8d1e6-0138-4c6a-bc9e-d8718d5670bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:42.824845 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8d1e6-0138-4c6a-bc9e-d8718d5670bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:42.834988 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8d1e6-0138-4c6a-bc9e-d8718d5670bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:42.836500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8d1e6-0138-4c6a-bc9e-d8718d5670bb service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:42.847459 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1333/2711] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:42 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:42.861706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb808c-6f31-4123-8b11-dba9e4a1312c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:42.932337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb808c-6f31-4123-8b11-dba9e4a1312c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:42.937968 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e390c90-7663-4933-ba07-abb4e6ce3105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:42.938917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e390c90-7663-4933-ba07-abb4e6ce3105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:42.939270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e390c90-7663-4933-ba07-abb4e6ce3105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:42.939614 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e390c90-7663-4933-ba07-abb4e6ce3105 admin admin] PATH_INFO: `/v3/users/8063ade56a6b4248afa6d79f4fbb7e63` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:42.940953 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e390c90-7663-4933-ba07-abb4e6ce3105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8063ade56a6b4248afa6d79f4fbb7e63)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:42.942968 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e390c90-7663-4933-ba07-abb4e6ce3105 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:42.994324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4e390c90-7663-4933-ba07-abb4e6ce3105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8063ade56a6b4248afa6d79f4fbb7e63'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:43.002648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4e390c90-7663-4933-ba07-abb4e6ce3105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8063ade56a6b4248afa6d79f4fbb7e63'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:43.009735 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4e390c90-7663-4933-ba07-abb4e6ce3105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8063ade56a6b4248afa6d79f4fbb7e63'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:43.010410 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4e390c90-7663-4933-ba07-abb4e6ce3105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8063ade56a6b4248afa6d79f4fbb7e63'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:43.024185 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4e390c90-7663-4933-ba07-abb4e6ce3105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8063ade56a6b4248afa6d79f4fbb7e63'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:43.030307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1379/2712] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:44:42 2022] DELETE /identity/v3/users/8063ade56a6b4248afa6d79f4fbb7e63 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:44:43.035012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94830b4a-7d9c-4059-95b4-7c10f90f9c93 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:43.035501 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94830b4a-7d9c-4059-95b4-7c10f90f9c93 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:43.039937 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94830b4a-7d9c-4059-95b4-7c10f90f9c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:43.057650 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-94830b4a-7d9c-4059-95b4-7c10f90f9c93 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:43.058856 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-94830b4a-7d9c-4059-95b4-7c10f90f9c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:43.144557 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1334/2713] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:43.153876 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e390c90-7663-4933-ba07-abb4e6ce3105 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:43.156034 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4e390c90-7663-4933-ba07-abb4e6ce3105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:43.163837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:43.249567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e390c90-7663-4933-ba07-abb4e6ce3105 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:43.254329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab51cce-e997-427d-b0f3-8a1cda5b81b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:43.255088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab51cce-e997-427d-b0f3-8a1cda5b81b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:43.255484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab51cce-e997-427d-b0f3-8a1cda5b81b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:43.255831 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab51cce-e997-427d-b0f3-8a1cda5b81b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:43.269636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab51cce-e997-427d-b0f3-8a1cda5b81b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:43.271222 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab51cce-e997-427d-b0f3-8a1cda5b81b1 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:43.283293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1380/2714] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:43.665183 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94830b4a-7d9c-4059-95b4-7c10f90f9c93 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:43.666823 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-94830b4a-7d9c-4059-95b4-7c10f90f9c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:43.691659 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94830b4a-7d9c-4059-95b4-7c10f90f9c93 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:43.697890 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c6916-94ee-45eb-961d-9f79efdfdff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:43.698867 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6916-94ee-45eb-961d-9f79efdfdff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:43.699390 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6916-94ee-45eb-961d-9f79efdfdff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:43.699913 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6916-94ee-45eb-961d-9f79efdfdff5 admin admin] PATH_INFO: `/v3/projects/fb601cdf178c4b18aeb001d4957f23f5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:43.701517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c6916-94ee-45eb-961d-9f79efdfdff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb601cdf178c4b18aeb001d4957f23f5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:43.706259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c6916-94ee-45eb-961d-9f79efdfdff5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:43.755086 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:43.767892 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d42c6916-94ee-45eb-961d-9f79efdfdff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb601cdf178c4b18aeb001d4957f23f5', 'request_id': 'req-d42c6916-94ee-45eb-961d-9f79efdfdff5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:43.780055 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d42c6916-94ee-45eb-961d-9f79efdfdff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb601cdf178c4b18aeb001d4957f23f5', 'request_id': 'req-d42c6916-94ee-45eb-961d-9f79efdfdff5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:43.788571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d42c6916-94ee-45eb-961d-9f79efdfdff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb601cdf178c4b18aeb001d4957f23f5', 'request_id': 'req-d42c6916-94ee-45eb-961d-9f79efdfdff5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:43.800716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d42c6916-94ee-45eb-961d-9f79efdfdff5 admin admin] The token cache is being invalidate because project fb601cdf178c4b18aeb001d4957f23f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:44:43.800996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d42c6916-94ee-45eb-961d-9f79efdfdff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:43.802153 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d42c6916-94ee-45eb-961d-9f79efdfdff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:43.804020 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1335/2715] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:44:43 2022] DELETE /identity/v3/projects/fb601cdf178c4b18aeb001d4957f23f5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:43.808721 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a792-25e2-4e9e-82f9-c07e1487cfd3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:43.809607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a792-25e2-4e9e-82f9-c07e1487cfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:43.809607 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a792-25e2-4e9e-82f9-c07e1487cfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:43.830634 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3bc2a792-25e2-4e9e-82f9-c07e1487cfd3 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:43.831876 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3bc2a792-25e2-4e9e-82f9-c07e1487cfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:43.895224 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1381/2716] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:43.902918 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f88808-33c4-4dda-aa4f-d6416a9ad193 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:43.903899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f88808-33c4-4dda-aa4f-d6416a9ad193 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:43.904289 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f88808-33c4-4dda-aa4f-d6416a9ad193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:43.931608 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-02f88808-33c4-4dda-aa4f-d6416a9ad193 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:43.932894 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-02f88808-33c4-4dda-aa4f-d6416a9ad193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:43.941930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1336/2717] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:43.946129 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2a792-25e2-4e9e-82f9-c07e1487cfd3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:43.957173 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2a792-25e2-4e9e-82f9-c07e1487cfd3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:43.961969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520988f-9197-407f-a07b-faf5a7f25014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:43.962648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520988f-9197-407f-a07b-faf5a7f25014 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:43.962929 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520988f-9197-407f-a07b-faf5a7f25014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:43.963200 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520988f-9197-407f-a07b-faf5a7f25014 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:43.963938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520988f-9197-407f-a07b-faf5a7f25014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:44:43.964244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520988f-9197-407f-a07b-faf5a7f25014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:43.966648 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520988f-9197-407f-a07b-faf5a7f25014 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:43.979224 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1382/2718] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:44:43.984037 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f88808-33c4-4dda-aa4f-d6416a9ad193 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:43.994483 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f88808-33c4-4dda-aa4f-d6416a9ad193 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:43.999711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e18ca-0ac0-490d-966f-2743ebf5ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:44.000617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e18ca-0ac0-490d-966f-2743ebf5ca61 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:44.000903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e18ca-0ac0-490d-966f-2743ebf5ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:44.001177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e18ca-0ac0-490d-966f-2743ebf5ca61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:44.001922 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e18ca-0ac0-490d-966f-2743ebf5ca61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:44.003875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e18ca-0ac0-490d-966f-2743ebf5ca61 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:44.032460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1337/2719] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:44:43 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:44.035589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520988f-9197-407f-a07b-faf5a7f25014 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:44.046699 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520988f-9197-407f-a07b-faf5a7f25014 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:44.113397 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c28cc-517f-4e19-b46f-9f53bd53e395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:44.114091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c28cc-517f-4e19-b46f-9f53bd53e395 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:44.114387 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c28cc-517f-4e19-b46f-9f53bd53e395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:44.114662 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c28cc-517f-4e19-b46f-9f53bd53e395 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:44.115372 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c28cc-517f-4e19-b46f-9f53bd53e395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:44.117474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c28cc-517f-4e19-b46f-9f53bd53e395 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:44.142895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1383/2720] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:44:44 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:44.144268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e18ca-0ac0-490d-966f-2743ebf5ca61 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:44.155480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e18ca-0ac0-490d-966f-2743ebf5ca61 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:44.160238 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f84e4-f73c-4ccd-9589-4d33a21950f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:44.160957 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f84e4-f73c-4ccd-9589-4d33a21950f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:44.161243 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f84e4-f73c-4ccd-9589-4d33a21950f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:44.161543 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f84e4-f73c-4ccd-9589-4d33a21950f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:44.162661 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f84e4-f73c-4ccd-9589-4d33a21950f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:44.165379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f84e4-f73c-4ccd-9589-4d33a21950f4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:44.178454 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1338/2721] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:44.182529 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c28cc-517f-4e19-b46f-9f53bd53e395 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:44.196760 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c28cc-517f-4e19-b46f-9f53bd53e395 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:44.202791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa22e32-a41c-4aa3-99fe-8ecb667207bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:44.209602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa22e32-a41c-4aa3-99fe-8ecb667207bd admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:44.209961 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa22e32-a41c-4aa3-99fe-8ecb667207bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:44.210289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa22e32-a41c-4aa3-99fe-8ecb667207bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:44.211190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa22e32-a41c-4aa3-99fe-8ecb667207bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:44.212981 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa22e32-a41c-4aa3-99fe-8ecb667207bd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:44.228468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1384/2722] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:44:44.231069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f84e4-f73c-4ccd-9589-4d33a21950f4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:44.251054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f84e4-f73c-4ccd-9589-4d33a21950f4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:44.251054 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ece077-7a26-4914-a82b-4477997a8107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:44.251617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ece077-7a26-4914-a82b-4477997a8107 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:44.251617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ece077-7a26-4914-a82b-4477997a8107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:44.251804 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ece077-7a26-4914-a82b-4477997a8107 admin admin] PATH_INFO: `/v3/projects/0d0cce3342cf48d3a17fdee916589f33/users/7c468010f8264b99be3f19dedb9af71a/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:44.268711 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ece077-7a26-4914-a82b-4477997a8107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0cce3342cf48d3a17fdee916589f33, user_id=7c468010f8264b99be3f19dedb9af71a, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:44.271492 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ece077-7a26-4914-a82b-4477997a8107 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:44.286943 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1339/2723] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:44:44 2022] PUT /identity/v3/projects/0d0cce3342cf48d3a17fdee916589f33/users/7c468010f8264b99be3f19dedb9af71a/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:44:44.300601 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f989e-b231-4875-8798-d3ef9162f2c4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:44.300902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f989e-b231-4875-8798-d3ef9162f2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:44.301189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f989e-b231-4875-8798-d3ef9162f2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:44.327603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:44.334070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1f1f989e-b231-4875-8798-d3ef9162f2c4 None None] MFA Rules not processed for user `7c468010f8264b99be3f19dedb9af71a`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:44.336162 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1f1f989e-b231-4875-8798-d3ef9162f2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:44.420203 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1385/2724] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:44.424446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ece077-7a26-4914-a82b-4477997a8107 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:44.496866 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ece077-7a26-4914-a82b-4477997a8107 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:44.502018 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da8272-bb39-463c-bf57-b7ab54397d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:44.502803 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da8272-bb39-463c-bf57-b7ab54397d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:44.504978 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da8272-bb39-463c-bf57-b7ab54397d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:44.505293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da8272-bb39-463c-bf57-b7ab54397d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:44.506039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da8272-bb39-463c-bf57-b7ab54397d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:44.508029 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da8272-bb39-463c-bf57-b7ab54397d05 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:44.536547 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1340/2725] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:44:44 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:44:44.540755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f989e-b231-4875-8798-d3ef9162f2c4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:44.553557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f989e-b231-4875-8798-d3ef9162f2c4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:44.623317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c9705-6008-4cdd-a370-cacc7456d02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:44.624183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c9705-6008-4cdd-a370-cacc7456d02f admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:44.624657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c9705-6008-4cdd-a370-cacc7456d02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:44.624923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c9705-6008-4cdd-a370-cacc7456d02f admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:44.625633 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c9705-6008-4cdd-a370-cacc7456d02f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:44.627618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c9705-6008-4cdd-a370-cacc7456d02f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:44.652261 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1386/2726] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:44:44 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:44.656819 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da8272-bb39-463c-bf57-b7ab54397d05 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:44.669423 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da8272-bb39-463c-bf57-b7ab54397d05 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:44.674472 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897e5c4-317f-487b-bf31-d07fd19a80d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:44.675649 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897e5c4-317f-487b-bf31-d07fd19a80d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:44.676101 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897e5c4-317f-487b-bf31-d07fd19a80d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:44.676624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897e5c4-317f-487b-bf31-d07fd19a80d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:44.677377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897e5c4-317f-487b-bf31-d07fd19a80d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:44.679145 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897e5c4-317f-487b-bf31-d07fd19a80d3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:44.693746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1341/2727] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:44.697852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c9705-6008-4cdd-a370-cacc7456d02f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:44.708244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c9705-6008-4cdd-a370-cacc7456d02f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:44.713024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ca97b-04f9-41d5-bffa-c2609a6b0027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:44.714024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ca97b-04f9-41d5-bffa-c2609a6b0027 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:44.714024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ca97b-04f9-41d5-bffa-c2609a6b0027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:44.714276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ca97b-04f9-41d5-bffa-c2609a6b0027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:44.715093 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ca97b-04f9-41d5-bffa-c2609a6b0027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:44.717262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ca97b-04f9-41d5-bffa-c2609a6b0027 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:44.730977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1387/2728] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:44.735856 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897e5c4-317f-487b-bf31-d07fd19a80d3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:44.745916 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897e5c4-317f-487b-bf31-d07fd19a80d3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:44.750619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4600d8-03b9-4253-a0b3-704185e4d040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:44.751500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4600d8-03b9-4253-a0b3-704185e4d040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:44.751785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4600d8-03b9-4253-a0b3-704185e4d040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:44.752065 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4600d8-03b9-4253-a0b3-704185e4d040 admin admin] PATH_INFO: `/v3/projects/92886097ed6d4e2ca3e769becc1c5bc2/users/7e73e62e170b4ded9d35e577dcbc44a0/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:44.767016 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4600d8-03b9-4253-a0b3-704185e4d040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92886097ed6d4e2ca3e769becc1c5bc2, user_id=7e73e62e170b4ded9d35e577dcbc44a0, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:44.769873 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4600d8-03b9-4253-a0b3-704185e4d040 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:44.785513 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1342/2729] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:44:44 2022] PUT /identity/v3/projects/92886097ed6d4e2ca3e769becc1c5bc2/users/7e73e62e170b4ded9d35e577dcbc44a0/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:44.796420 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc50b47-5d68-447f-ac82-e03ef761a6d9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:44.796742 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc50b47-5d68-447f-ac82-e03ef761a6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:44.797022 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc50b47-5d68-447f-ac82-e03ef761a6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:44.824477 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8bc50b47-5d68-447f-ac82-e03ef761a6d9 None None] MFA Rules not processed for user `7e73e62e170b4ded9d35e577dcbc44a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:44.826665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8bc50b47-5d68-447f-ac82-e03ef761a6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:44.895141 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1388/2730] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:44.899795 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4600d8-03b9-4253-a0b3-704185e4d040 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:44.910823 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:44.969759 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4600d8-03b9-4253-a0b3-704185e4d040 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:44.974765 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9c317-754f-4f74-a7aa-91cad8a0bee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:44.975442 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9c317-754f-4f74-a7aa-91cad8a0bee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:44.975734 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9c317-754f-4f74-a7aa-91cad8a0bee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:44.976004 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9c317-754f-4f74-a7aa-91cad8a0bee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:44.976744 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9c317-754f-4f74-a7aa-91cad8a0bee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:44.978683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9c317-754f-4f74-a7aa-91cad8a0bee1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:45.005416 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1343/2731] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:44:44 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:45.009611 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc50b47-5d68-447f-ac82-e03ef761a6d9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:45.021201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc50b47-5d68-447f-ac82-e03ef761a6d9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:45.029676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:45.081645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a63d0b-c06b-4b17-acc7-140860842f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:45.082317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a63d0b-c06b-4b17-acc7-140860842f5e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:45.082602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a63d0b-c06b-4b17-acc7-140860842f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:45.082879 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a63d0b-c06b-4b17-acc7-140860842f5e admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:45.083559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a63d0b-c06b-4b17-acc7-140860842f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:45.085960 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a63d0b-c06b-4b17-acc7-140860842f5e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:45.111068 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1389/2732] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:44:45 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:44:45.112282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9c317-754f-4f74-a7aa-91cad8a0bee1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:45.123648 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9c317-754f-4f74-a7aa-91cad8a0bee1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:45.128725 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c56008-1f2f-46ba-ad91-164d0c9c74bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:45.129634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c56008-1f2f-46ba-ad91-164d0c9c74bf admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:45.129996 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c56008-1f2f-46ba-ad91-164d0c9c74bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:45.130285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c56008-1f2f-46ba-ad91-164d0c9c74bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:45.131191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c56008-1f2f-46ba-ad91-164d0c9c74bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:45.132943 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c56008-1f2f-46ba-ad91-164d0c9c74bf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:45.144796 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1344/2733] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:45.149056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a63d0b-c06b-4b17-acc7-140860842f5e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:45.159658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a63d0b-c06b-4b17-acc7-140860842f5e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:45.164618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1c4d4-063f-4eec-91da-12e50a4320fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:45.165496 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1c4d4-063f-4eec-91da-12e50a4320fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:45.165782 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1c4d4-063f-4eec-91da-12e50a4320fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:45.166059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1c4d4-063f-4eec-91da-12e50a4320fc admin admin] PATH_INFO: `/v3/projects/778af10d63694b49aea7b3f95ab4e1d5/users/ebf58f4323b94bb58296283f6f744a3f/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:45.183395 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1c4d4-063f-4eec-91da-12e50a4320fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=778af10d63694b49aea7b3f95ab4e1d5, user_id=ebf58f4323b94bb58296283f6f744a3f, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:45.187289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1c4d4-063f-4eec-91da-12e50a4320fc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:45.200857 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1390/2734] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:44:45 2022] PUT /identity/v3/projects/778af10d63694b49aea7b3f95ab4e1d5/users/ebf58f4323b94bb58296283f6f744a3f/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:45.204808 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c56008-1f2f-46ba-ad91-164d0c9c74bf admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:45.215168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c56008-1f2f-46ba-ad91-164d0c9c74bf admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:45.277652 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8225959-0f47-47cd-aca9-7798da3fd45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:45.278363 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225959-0f47-47cd-aca9-7798da3fd45f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:45.278643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225959-0f47-47cd-aca9-7798da3fd45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:45.278921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225959-0f47-47cd-aca9-7798da3fd45f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:45.279647 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8225959-0f47-47cd-aca9-7798da3fd45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:45.281338 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8225959-0f47-47cd-aca9-7798da3fd45f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:45.291814 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1345/2735] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:44:45.297137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1c4d4-063f-4eec-91da-12e50a4320fc admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:45.307754 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1c4d4-063f-4eec-91da-12e50a4320fc admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:45.313652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11877c7b-46ce-4b2b-8ddf-9b9879f0619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:45.314581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11877c7b-46ce-4b2b-8ddf-9b9879f0619e admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:45.314867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11877c7b-46ce-4b2b-8ddf-9b9879f0619e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:45.315144 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11877c7b-46ce-4b2b-8ddf-9b9879f0619e admin admin] PATH_INFO: `/v3/projects/778af10d63694b49aea7b3f95ab4e1d5/users/ebf58f4323b94bb58296283f6f744a3f/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:45.317137 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11877c7b-46ce-4b2b-8ddf-9b9879f0619e admin admin] RBAC: Authorizing `identity:create_grant(project_id=778af10d63694b49aea7b3f95ab4e1d5, user_id=ebf58f4323b94bb58296283f6f744a3f, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:45.319822 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11877c7b-46ce-4b2b-8ddf-9b9879f0619e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:45.331475 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1391/2736] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:44:45 2022] PUT /identity/v3/projects/778af10d63694b49aea7b3f95ab4e1d5/users/ebf58f4323b94bb58296283f6f744a3f/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:45.343446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad6efd-453a-4643-a4d4-82f946b425a7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:45.343735 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad6efd-453a-4643-a4d4-82f946b425a7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:45.344011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad6efd-453a-4643-a4d4-82f946b425a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:45.372769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-abad6efd-453a-4643-a4d4-82f946b425a7 None None] MFA Rules not processed for user `ebf58f4323b94bb58296283f6f744a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:45.373967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-abad6efd-453a-4643-a4d4-82f946b425a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:45.446377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1346/2737] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:45.461493 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11877c7b-46ce-4b2b-8ddf-9b9879f0619e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:45.463368 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-11877c7b-46ce-4b2b-8ddf-9b9879f0619e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:45.525878 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11877c7b-46ce-4b2b-8ddf-9b9879f0619e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:45.530343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7642ed1-35c7-409e-a7cd-095e533e6a66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:45.531035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642ed1-35c7-409e-a7cd-095e533e6a66 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:45.531330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642ed1-35c7-409e-a7cd-095e533e6a66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:45.531605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642ed1-35c7-409e-a7cd-095e533e6a66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:45.590474 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7642ed1-35c7-409e-a7cd-095e533e6a66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:45.591899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7642ed1-35c7-409e-a7cd-095e533e6a66 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:45.600693 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1392/2738] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:47.153119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad6efd-453a-4643-a4d4-82f946b425a7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:47.158954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:47.163116 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad6efd-453a-4643-a4d4-82f946b425a7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:47.167838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8126f85-d09b-4495-a218-d8ee35cd08f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:47.168506 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8126f85-d09b-4495-a218-d8ee35cd08f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:47.169358 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8126f85-d09b-4495-a218-d8ee35cd08f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:47.169652 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8126f85-d09b-4495-a218-d8ee35cd08f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:47.230560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8126f85-d09b-4495-a218-d8ee35cd08f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:47.232522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8126f85-d09b-4495-a218-d8ee35cd08f0 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:47.241331 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1347/2739] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:47.780735 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7642ed1-35c7-409e-a7cd-095e533e6a66 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:47.789650 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7642ed1-35c7-409e-a7cd-095e533e6a66 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:47.793207 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb15878-0e7e-4135-ac63-4dedcc8bdbdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:47.794341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb15878-0e7e-4135-ac63-4dedcc8bdbdd service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:47.794620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb15878-0e7e-4135-ac63-4dedcc8bdbdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:47.794895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb15878-0e7e-4135-ac63-4dedcc8bdbdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:47.803623 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb15878-0e7e-4135-ac63-4dedcc8bdbdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:47.805069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb15878-0e7e-4135-ac63-4dedcc8bdbdd service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:47.815421 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1393/2740] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:51.391177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8126f85-d09b-4495-a218-d8ee35cd08f0 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:51.392666 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c8126f85-d09b-4495-a218-d8ee35cd08f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:51.488064 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8126f85-d09b-4495-a218-d8ee35cd08f0 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:51.493178 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a1e08-1579-4a5e-b38e-fed258242551 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6693dd1ea26049c1ac8460faf1bc9b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:51.493827 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a1e08-1579-4a5e-b38e-fed258242551 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:51.494111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a1e08-1579-4a5e-b38e-fed258242551 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:51.494390 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a1e08-1579-4a5e-b38e-fed258242551 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:51.496165 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-980a1e08-1579-4a5e-b38e-fed258242551 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:51.508260 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a1e08-1579-4a5e-b38e-fed258242551 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:51.509878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a1e08-1579-4a5e-b38e-fed258242551 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:51.520590 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1348/2741] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:51.708267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb15878-0e7e-4135-ac63-4dedcc8bdbdd service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:51.713704 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:51.773616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb15878-0e7e-4135-ac63-4dedcc8bdbdd service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:51.779031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ae9ff-8658-4feb-91c7-90c4a44a53c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:51.779901 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ae9ff-8658-4feb-91c7-90c4a44a53c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:51.780181 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ae9ff-8658-4feb-91c7-90c4a44a53c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:51.780509 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ae9ff-8658-4feb-91c7-90c4a44a53c6 admin admin] PATH_INFO: `/v3/users/7c468010f8264b99be3f19dedb9af71a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:51.781741 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ae9ff-8658-4feb-91c7-90c4a44a53c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c468010f8264b99be3f19dedb9af71a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:51.783655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ae9ff-8658-4feb-91c7-90c4a44a53c6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:51.832955 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ae7ae9ff-8658-4feb-91c7-90c4a44a53c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c468010f8264b99be3f19dedb9af71a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:51.839796 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ae7ae9ff-8658-4feb-91c7-90c4a44a53c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c468010f8264b99be3f19dedb9af71a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:51.847537 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ae7ae9ff-8658-4feb-91c7-90c4a44a53c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c468010f8264b99be3f19dedb9af71a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:51.848190 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ae7ae9ff-8658-4feb-91c7-90c4a44a53c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c468010f8264b99be3f19dedb9af71a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:51.860343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ae7ae9ff-8658-4feb-91c7-90c4a44a53c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c468010f8264b99be3f19dedb9af71a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:51.867243 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1394/2742] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:44:51 2022] DELETE /identity/v3/users/7c468010f8264b99be3f19dedb9af71a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:51.872457 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f438922-40bb-4240-9730-c74049f476f2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:51.872799 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f438922-40bb-4240-9730-c74049f476f2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:51.873083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f438922-40bb-4240-9730-c74049f476f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:51.896906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6f438922-40bb-4240-9730-c74049f476f2 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:51.898108 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6f438922-40bb-4240-9730-c74049f476f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:51.958389 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1349/2743] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:44:51.968622 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ae9ff-8658-4feb-91c7-90c4a44a53c6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:51.970434 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ae7ae9ff-8658-4feb-91c7-90c4a44a53c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:52.031095 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ae9ff-8658-4feb-91c7-90c4a44a53c6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:52.034714 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6358758-6630-45c7-ad55-e1c7cc1e8bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:52.035402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358758-6630-45c7-ad55-e1c7cc1e8bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:52.035683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358758-6630-45c7-ad55-e1c7cc1e8bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:52.035957 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358758-6630-45c7-ad55-e1c7cc1e8bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:52.045282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6358758-6630-45c7-ad55-e1c7cc1e8bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:52.046721 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6358758-6630-45c7-ad55-e1c7cc1e8bb2 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:52.056385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1395/2744] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:44:52.335404 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f438922-40bb-4240-9730-c74049f476f2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:52.337332 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6f438922-40bb-4240-9730-c74049f476f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:52.349508 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f438922-40bb-4240-9730-c74049f476f2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:52.357052 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:52.358045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:52.358431 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:52.358885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] PATH_INFO: `/v3/projects/0d0cce3342cf48d3a17fdee916589f33` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:52.360415 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d0cce3342cf48d3a17fdee916589f33)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:52.363082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:52.374205 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:52.412619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d0cce3342cf48d3a17fdee916589f33', 'request_id': 'req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:52.420886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d0cce3342cf48d3a17fdee916589f33', 'request_id': 'req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:52.427154 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d0cce3342cf48d3a17fdee916589f33', 'request_id': 'req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:52.438587 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] The token cache is being invalidate because project 0d0cce3342cf48d3a17fdee916589f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:44:52.438902 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:52.439553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:52.441175 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1350/2745] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:44:52 2022] DELETE /identity/v3/projects/0d0cce3342cf48d3a17fdee916589f33 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:44:52.445490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6358758-6630-45c7-ad55-e1c7cc1e8bb2 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:52.455792 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6358758-6630-45c7-ad55-e1c7cc1e8bb2 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:52.479689 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:52.515402 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f209a-5c7f-447a-a99e-d394e13f4a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:52.516330 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f209a-5c7f-447a-a99e-d394e13f4a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:52.516660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f209a-5c7f-447a-a99e-d394e13f4a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:52.516938 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f209a-5c7f-447a-a99e-d394e13f4a61 admin admin] PATH_INFO: `/v3/users/7e73e62e170b4ded9d35e577dcbc44a0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:52.518658 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f209a-5c7f-447a-a99e-d394e13f4a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e73e62e170b4ded9d35e577dcbc44a0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:52.520610 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f209a-5c7f-447a-a99e-d394e13f4a61 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:52.567269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e51f209a-5c7f-447a-a99e-d394e13f4a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e73e62e170b4ded9d35e577dcbc44a0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:52.574490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e51f209a-5c7f-447a-a99e-d394e13f4a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e73e62e170b4ded9d35e577dcbc44a0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:52.582381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e51f209a-5c7f-447a-a99e-d394e13f4a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e73e62e170b4ded9d35e577dcbc44a0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:52.583050 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e51f209a-5c7f-447a-a99e-d394e13f4a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e73e62e170b4ded9d35e577dcbc44a0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:52.596053 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e51f209a-5c7f-447a-a99e-d394e13f4a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e73e62e170b4ded9d35e577dcbc44a0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:52.601947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1396/2746] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:44:52 2022] DELETE /identity/v3/users/7e73e62e170b4ded9d35e577dcbc44a0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:52.899545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:52.901012 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:52.921166 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76451b74-a4f0-43c0-9d0b-8fa4a5621e61 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:52.985683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:52.986469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:52.986754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:52.987033 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] PATH_INFO: `/v3/projects/92886097ed6d4e2ca3e769becc1c5bc2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:52.988249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] RBAC: Authorizing `identity:delete_project(project_id=92886097ed6d4e2ca3e769becc1c5bc2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:52.990198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:53.038006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92886097ed6d4e2ca3e769becc1c5bc2', 'request_id': 'req-6f175314-e3bc-42bc-8c89-aa240cae425f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.045762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92886097ed6d4e2ca3e769becc1c5bc2', 'request_id': 'req-6f175314-e3bc-42bc-8c89-aa240cae425f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.052005 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92886097ed6d4e2ca3e769becc1c5bc2', 'request_id': 'req-6f175314-e3bc-42bc-8c89-aa240cae425f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.062321 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] The token cache is being invalidate because project 92886097ed6d4e2ca3e769becc1c5bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:44:53.062610 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.063245 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.064800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1351/2747] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:44:52 2022] DELETE /identity/v3/projects/92886097ed6d4e2ca3e769becc1c5bc2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:53.068856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f209a-5c7f-447a-a99e-d394e13f4a61 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:53.070324 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e51f209a-5c7f-447a-a99e-d394e13f4a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:53.083470 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f209a-5c7f-447a-a99e-d394e13f4a61 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:53.140204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebac2d0-5a06-4a82-89da-27c91297a81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:53.141107 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebac2d0-5a06-4a82-89da-27c91297a81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:53.141397 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebac2d0-5a06-4a82-89da-27c91297a81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:53.141678 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebac2d0-5a06-4a82-89da-27c91297a81f admin admin] PATH_INFO: `/v3/users/ebf58f4323b94bb58296283f6f744a3f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:53.142872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebac2d0-5a06-4a82-89da-27c91297a81f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf58f4323b94bb58296283f6f744a3f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:53.144842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebac2d0-5a06-4a82-89da-27c91297a81f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:53.190088 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3ebac2d0-5a06-4a82-89da-27c91297a81f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf58f4323b94bb58296283f6f744a3f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.191789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:53.198853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3ebac2d0-5a06-4a82-89da-27c91297a81f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf58f4323b94bb58296283f6f744a3f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.207902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3ebac2d0-5a06-4a82-89da-27c91297a81f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf58f4323b94bb58296283f6f744a3f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.208578 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3ebac2d0-5a06-4a82-89da-27c91297a81f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf58f4323b94bb58296283f6f744a3f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.221128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3ebac2d0-5a06-4a82-89da-27c91297a81f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf58f4323b94bb58296283f6f744a3f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.226923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1397/2748] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:44:53 2022] DELETE /identity/v3/users/ebf58f4323b94bb58296283f6f744a3f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:53.499362 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:44:53.500833 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:53.516290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f175314-e3bc-42bc-8c89-aa240cae425f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:44:53.549992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:53.584732 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:44:53.585611 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:53.585899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:53.586177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] PATH_INFO: `/v3/projects/778af10d63694b49aea7b3f95ab4e1d5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:53.587383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] RBAC: Authorizing `identity:delete_project(project_id=778af10d63694b49aea7b3f95ab4e1d5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:44:53.589356 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:44:53.636907 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778af10d63694b49aea7b3f95ab4e1d5', 'request_id': 'req-9d17b51d-af89-4431-b7c0-47922d3deeba'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.644998 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778af10d63694b49aea7b3f95ab4e1d5', 'request_id': 'req-9d17b51d-af89-4431-b7c0-47922d3deeba'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.651317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778af10d63694b49aea7b3f95ab4e1d5', 'request_id': 'req-9d17b51d-af89-4431-b7c0-47922d3deeba'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.661931 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] The token cache is being invalidate because project 778af10d63694b49aea7b3f95ab4e1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:44:53.662215 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.662844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:44:53.664642 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1352/2749] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:44:53 2022] DELETE /identity/v3/projects/778af10d63694b49aea7b3f95ab4e1d5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:44:57.976336 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542f32-2eae-4b17-803c-6ac454a5cfbb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:44:57.976854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542f32-2eae-4b17-803c-6ac454a5cfbb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:44:57.976967 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542f32-2eae-4b17-803c-6ac454a5cfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:44:57.994351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f2542f32-2eae-4b17-803c-6ac454a5cfbb None None] MFA Rules not processed for user `ce5f88b90c3b43439d4f3f9b3dc63fff`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:44:57.995544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f2542f32-2eae-4b17-803c-6ac454a5cfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:44:58.050547 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1398/2750] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:44:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:45:03.658964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=39,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:08.043758 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=37 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:14.207645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:14.209174 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:14.295069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17b51d-af89-4431-b7c0-47922d3deeba admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:14.298895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c8edf-cba6-4d9a-824d-6e83fbb49711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:14.299539 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c8edf-cba6-4d9a-824d-6e83fbb49711 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:14.299825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c8edf-cba6-4d9a-824d-6e83fbb49711 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:14.300098 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c8edf-cba6-4d9a-824d-6e83fbb49711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:14.301958 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c10c8edf-cba6-4d9a-824d-6e83fbb49711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:14.368071 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c8edf-cba6-4d9a-824d-6e83fbb49711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:14.369541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c8edf-cba6-4d9a-824d-6e83fbb49711 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:14.379847 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1353/2751] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:45:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:45:19.474930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2542f32-2eae-4b17-803c-6ac454a5cfbb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:19.476534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f2542f32-2eae-4b17-803c-6ac454a5cfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:19.489721 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2542f32-2eae-4b17-803c-6ac454a5cfbb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:19.493595 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311a9bb-7067-4286-b6f9-3ce263bab2ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:19.494303 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311a9bb-7067-4286-b6f9-3ce263bab2ba service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:19.494604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311a9bb-7067-4286-b6f9-3ce263bab2ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:19.494884 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311a9bb-7067-4286-b6f9-3ce263bab2ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:19.497376 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0311a9bb-7067-4286-b6f9-3ce263bab2ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:19.561626 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311a9bb-7067-4286-b6f9-3ce263bab2ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:19.563082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311a9bb-7067-4286-b6f9-3ce263bab2ba service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:19.572578 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1399/2752] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:45:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:45:21.626882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b815-88bb-422a-a08c-adf8ac3a3638 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:21.627433 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b815-88bb-422a-a08c-adf8ac3a3638 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:21.627609 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b815-88bb-422a-a08c-adf8ac3a3638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:21.645634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-61c2b815-88bb-422a-a08c-adf8ac3a3638 None None] MFA Rules not processed for user `fbe7070e9384403ca998a996e8dd6b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:45:21.646858 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-61c2b815-88bb-422a-a08c-adf8ac3a3638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:21.703903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1354/2753] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:45:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:45:25.400462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311a9bb-7067-4286-b6f9-3ce263bab2ba service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:25.413723 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311a9bb-7067-4286-b6f9-3ce263bab2ba service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:25.418735 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811d39-5a29-41ba-b841-793c793b1f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:25.419287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811d39-5a29-41ba-b841-793c793b1f12 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:25.419732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811d39-5a29-41ba-b841-793c793b1f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:25.419837 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811d39-5a29-41ba-b841-793c793b1f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:25.421668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-21811d39-5a29-41ba-b841-793c793b1f12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:25.487497 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21811d39-5a29-41ba-b841-793c793b1f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:25.488974 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21811d39-5a29-41ba-b841-793c793b1f12 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:25.498798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1400/2754] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:45:29.000274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b815-88bb-422a-a08c-adf8ac3a3638 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:29.002693 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-61c2b815-88bb-422a-a08c-adf8ac3a3638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:29.061090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:29.113184 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b815-88bb-422a-a08c-adf8ac3a3638 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:29.118134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47619026-83b5-4a76-b272-233ca6d36c63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6693dd1ea26049c1ac8460faf1bc9b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:29.118797 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47619026-83b5-4a76-b272-233ca6d36c63 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:29.119084 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47619026-83b5-4a76-b272-233ca6d36c63 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:29.119366 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47619026-83b5-4a76-b272-233ca6d36c63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:29.121194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-47619026-83b5-4a76-b272-233ca6d36c63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:29.134554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47619026-83b5-4a76-b272-233ca6d36c63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:29.136244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47619026-83b5-4a76-b272-233ca6d36c63 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:29.169841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1355/2755] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:45:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:45:32.429928 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811d39-5a29-41ba-b841-793c793b1f12 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:32.431425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-21811d39-5a29-41ba-b841-793c793b1f12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:32.445861 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811d39-5a29-41ba-b841-793c793b1f12 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:32.451695 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fed576-24bd-479e-b44b-ad124b1404b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:32.452690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fed576-24bd-479e-b44b-ad124b1404b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:32.453040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fed576-24bd-479e-b44b-ad124b1404b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:32.453381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fed576-24bd-479e-b44b-ad124b1404b5 admin admin] PATH_INFO: `/v3/users/e2e27fccbf854a8b8c9d6d099893f783` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:32.454818 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fed576-24bd-479e-b44b-ad124b1404b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e27fccbf854a8b8c9d6d099893f783)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:32.457012 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fed576-24bd-479e-b44b-ad124b1404b5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:32.512583 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-32fed576-24bd-479e-b44b-ad124b1404b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e27fccbf854a8b8c9d6d099893f783'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.521743 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-32fed576-24bd-479e-b44b-ad124b1404b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e27fccbf854a8b8c9d6d099893f783'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.529492 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-32fed576-24bd-479e-b44b-ad124b1404b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e27fccbf854a8b8c9d6d099893f783'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.530133 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-32fed576-24bd-479e-b44b-ad124b1404b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e27fccbf854a8b8c9d6d099893f783'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.542209 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-32fed576-24bd-479e-b44b-ad124b1404b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e27fccbf854a8b8c9d6d099893f783'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.549183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1401/2756] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:45:32 2022] DELETE /identity/v3/users/e2e27fccbf854a8b8c9d6d099893f783 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:45:32.728643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47619026-83b5-4a76-b272-233ca6d36c63 service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:32.739390 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47619026-83b5-4a76-b272-233ca6d36c63 service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:32.804353 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:32.805256 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:32.805764 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:32.806057 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] PATH_INFO: `/v3/projects/13e1593c67704dbbafad13310ca35448` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:32.807279 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e1593c67704dbbafad13310ca35448)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:32.809875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:32.860930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e1593c67704dbbafad13310ca35448', 'request_id': 'req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.869703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e1593c67704dbbafad13310ca35448', 'request_id': 'req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.876979 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e1593c67704dbbafad13310ca35448', 'request_id': 'req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.889616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] The token cache is being invalidate because project 13e1593c67704dbbafad13310ca35448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:45:32.889907 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.890557 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:32.892112 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1356/2757] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:45:32 2022] DELETE /identity/v3/projects/13e1593c67704dbbafad13310ca35448 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:45:32.896082 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fed576-24bd-479e-b44b-ad124b1404b5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:32.897527 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-32fed576-24bd-479e-b44b-ad124b1404b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:32.907494 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:32.911519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fed576-24bd-479e-b44b-ad124b1404b5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:32.971366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44fd49-f6f5-4147-b676-a73661785652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:32.972174 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44fd49-f6f5-4147-b676-a73661785652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:32.972492 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44fd49-f6f5-4147-b676-a73661785652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:32.972775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44fd49-f6f5-4147-b676-a73661785652 admin admin] PATH_INFO: `/v3/users/5204aba60887459eb502e7345a6c39fc` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:32.973974 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44fd49-f6f5-4147-b676-a73661785652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5204aba60887459eb502e7345a6c39fc)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:32.976056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44fd49-f6f5-4147-b676-a73661785652 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:33.022320 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4a44fd49-f6f5-4147-b676-a73661785652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5204aba60887459eb502e7345a6c39fc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:33.030800 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4a44fd49-f6f5-4147-b676-a73661785652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5204aba60887459eb502e7345a6c39fc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:33.038066 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4a44fd49-f6f5-4147-b676-a73661785652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5204aba60887459eb502e7345a6c39fc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:33.038709 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4a44fd49-f6f5-4147-b676-a73661785652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5204aba60887459eb502e7345a6c39fc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:33.051895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4a44fd49-f6f5-4147-b676-a73661785652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5204aba60887459eb502e7345a6c39fc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:33.058226 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1402/2758] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:45:32 2022] DELETE /identity/v3/users/5204aba60887459eb502e7345a6c39fc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:45:33.295223 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:45:33.296984 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:45:33.310198 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb93f2-49ce-4ddc-8e38-7f0faec56f22 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:45:33.373153 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:33.380119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:45:33.381180 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:45:33.381800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:45:33.382091 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] PATH_INFO: `/v3/projects/5f4833ade1b146408b2a5b653f179fb2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:45:33.383769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f4833ade1b146408b2a5b653f179fb2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:45:33.385839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:45:33.435138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f4833ade1b146408b2a5b653f179fb2', 'request_id': 'req-c1a29807-e091-411a-bdf6-bd7cf2f202ea'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:33.448503 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f4833ade1b146408b2a5b653f179fb2', 'request_id': 'req-c1a29807-e091-411a-bdf6-bd7cf2f202ea'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:33.455696 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f4833ade1b146408b2a5b653f179fb2', 'request_id': 'req-c1a29807-e091-411a-bdf6-bd7cf2f202ea'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:33.468745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] The token cache is being invalidate because project 5f4833ade1b146408b2a5b653f179fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:45:33.469122 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:33.469847 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:45:33.471538 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1357/2759] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:45:33 2022] DELETE /identity/v3/projects/5f4833ade1b146408b2a5b653f179fb2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:45:43.054691 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:43.465266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:46:25.922057 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f23c47-b55c-49ed-be23-197f6dc60caa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:25.922550 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f23c47-b55c-49ed-be23-197f6dc60caa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:25.922673 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f23c47-b55c-49ed-be23-197f6dc60caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:25.950211 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-14f23c47-b55c-49ed-be23-197f6dc60caa None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:46:25.951602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-14f23c47-b55c-49ed-be23-197f6dc60caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:46:26.010835 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1403/2760] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:46:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:46:26.066355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:46:26.067827 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:46:26.140487 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a29807-e091-411a-bdf6-bd7cf2f202ea admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:46:26.145495 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda40b-1649-4e00-a1d5-7f89305877d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:46:26.146151 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda40b-1649-4e00-a1d5-7f89305877d5 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:26.146436 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda40b-1649-4e00-a1d5-7f89305877d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:26.146715 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda40b-1649-4e00-a1d5-7f89305877d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:26.155518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdda40b-1649-4e00-a1d5-7f89305877d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:46:26.157168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdda40b-1649-4e00-a1d5-7f89305877d5 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:46:26.165767 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1358/2761] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:46:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 20:46:35.998856 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=29 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:46:36.162262 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=32 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:46:38.885485 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce4f6a-cb7d-4853-9415-06e89c11727e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:38.886040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce4f6a-cb7d-4853-9415-06e89c11727e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:38.886183 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce4f6a-cb7d-4853-9415-06e89c11727e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:38.887660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1404/2762] 10.222.0.66 () {54 vars in 921 bytes} [Fri Jul 15 20:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 20:46:38.893300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475c12c-bc33-459a-9522-6092366393d5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:38.894107 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475c12c-bc33-459a-9522-6092366393d5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:38.894575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475c12c-bc33-459a-9522-6092366393d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:38.933792 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6475c12c-bc33-459a-9522-6092366393d5 None None] MFA Rules not processed for user `b042da9298894712a0a29787a343bf85`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:46:38.935738 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6475c12c-bc33-459a-9522-6092366393d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:46:39.004934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1359/2763] 10.222.0.66 () {58 vars in 1018 bytes} [Fri Jul 15 20:46:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:46:39.016899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce4f6a-cb7d-4853-9415-06e89c11727e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:46:39.018634 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c4ce4f6a-cb7d-4853-9415-06e89c11727e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:46:39.078201 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce4f6a-cb7d-4853-9415-06e89c11727e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:46:39.081705 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e4793-4416-4d95-9329-506b0e664470 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93958c7dad0540b296b316169932d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:46:39.082369 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e4793-4416-4d95-9329-506b0e664470 service glance] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:39.082652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e4793-4416-4d95-9329-506b0e664470 service glance] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:39.082929 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e4793-4416-4d95-9329-506b0e664470 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:39.093404 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e4793-4416-4d95-9329-506b0e664470 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:46:39.094836 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e4793-4416-4d95-9329-506b0e664470 service glance] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:46:39.105430 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1405/2764] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:46:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:46:40.846075 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f936573-e8c6-42d9-bde3-9e30433c448d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:40.846563 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f936573-e8c6-42d9-bde3-9e30433c448d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:40.846681 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f936573-e8c6-42d9-bde3-9e30433c448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:40.864138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4f936573-e8c6-42d9-bde3-9e30433c448d None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:46:40.865350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4f936573-e8c6-42d9-bde3-9e30433c448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:46:40.873185 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1360/2765] 10.222.0.66 () {58 vars in 1009 bytes} [Fri Jul 15 20:46:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:46:40.887425 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e4793-4416-4d95-9329-506b0e664470 service glance] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:46:40.899918 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e4793-4416-4d95-9329-506b0e664470 service glance] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:46:40.905556 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a29dc3-561f-43ce-bd95-103b02635fed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:46:40.906199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a29dc3-561f-43ce-bd95-103b02635fed service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:40.906483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a29dc3-561f-43ce-bd95-103b02635fed service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:40.906765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a29dc3-561f-43ce-bd95-103b02635fed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:40.914985 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a29dc3-561f-43ce-bd95-103b02635fed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:46:40.916609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a29dc3-561f-43ce-bd95-103b02635fed service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:46:40.925739 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1406/2766] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:46:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 20:46:42.482600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f936573-e8c6-42d9-bde3-9e30433c448d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:46:42.484277 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4f936573-e8c6-42d9-bde3-9e30433c448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:46:42.556187 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f936573-e8c6-42d9-bde3-9e30433c448d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:46:42.561136 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c29d7-c5bc-4c81-bd28-e56a64a6a248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:46:42.561932 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c29d7-c5bc-4c81-bd28-e56a64a6a248 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:42.562554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c29d7-c5bc-4c81-bd28-e56a64a6a248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:42.563041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c29d7-c5bc-4c81-bd28-e56a64a6a248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:42.565418 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dc4c29d7-c5bc-4c81-bd28-e56a64a6a248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:46:42.581956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c29d7-c5bc-4c81-bd28-e56a64a6a248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:46:42.583430 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c29d7-c5bc-4c81-bd28-e56a64a6a248 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:46:42.596676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1361/2767] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:46:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:46:46.174712 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a29dc3-561f-43ce-bd95-103b02635fed service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:46:46.184406 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a29dc3-561f-43ce-bd95-103b02635fed service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:46:46.188588 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babcd68-acca-4af6-bcea-f1dd36642ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:46:46.189231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babcd68-acca-4af6-bcea-f1dd36642ceb service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:46.189519 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babcd68-acca-4af6-bcea-f1dd36642ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:46.189943 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babcd68-acca-4af6-bcea-f1dd36642ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:46.191706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0babcd68-acca-4af6-bcea-f1dd36642ceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:46:46.206343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babcd68-acca-4af6-bcea-f1dd36642ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:46:46.207773 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babcd68-acca-4af6-bcea-f1dd36642ceb service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:46:46.219000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1407/2768] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:46:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:46:52.589782 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=66 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:46:56.213935 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=38 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:46:57.313085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc742-2f5f-4130-9235-5b69a5844bff None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:57.313530 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc742-2f5f-4130-9235-5b69a5844bff None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:57.313636 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc742-2f5f-4130-9235-5b69a5844bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:57.331128 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-840dc742-2f5f-4130-9235-5b69a5844bff None None] MFA Rules not processed for user `c02568cd42484dfc9c39c2088f024060`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:46:57.332317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-840dc742-2f5f-4130-9235-5b69a5844bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:46:57.339450 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1362/2769] 10.222.0.66 () {58 vars in 967 bytes} [Fri Jul 15 20:46:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:46:57.351521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babcd68-acca-4af6-bcea-f1dd36642ceb service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:46:57.364069 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babcd68-acca-4af6-bcea-f1dd36642ceb service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:46:57.369079 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819725c-558a-441c-a1a9-aa56d8c9a90c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eed1d3c16354c8c9af8c01cb541c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:46:57.369715 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819725c-558a-441c-a1a9-aa56d8c9a90c service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:46:57.370003 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819725c-558a-441c-a1a9-aa56d8c9a90c service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:46:57.370285 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819725c-558a-441c-a1a9-aa56d8c9a90c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:46:57.379378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819725c-558a-441c-a1a9-aa56d8c9a90c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:46:57.381000 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819725c-558a-441c-a1a9-aa56d8c9a90c service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:46:57.389696 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1408/2770] 10.222.0.66 () {60 vars in 1384 bytes} [Fri Jul 15 20:46:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 20:47:07.325992 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:07.385947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:17.157864 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bc2c0-5160-492f-a0d7-f6b4631a4e3b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:17.158326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bc2c0-5160-492f-a0d7-f6b4631a4e3b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:17.158441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bc2c0-5160-492f-a0d7-f6b4631a4e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:17.177015 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2e0bc2c0-5160-492f-a0d7-f6b4631a4e3b None None] MFA Rules not processed for user `ce5f88b90c3b43439d4f3f9b3dc63fff`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:17.178261 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2e0bc2c0-5160-492f-a0d7-f6b4631a4e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:17.232082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1363/2771] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:17.537318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819725c-558a-441c-a1a9-aa56d8c9a90c service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:17.547032 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819725c-558a-441c-a1a9-aa56d8c9a90c service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:17.550596 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ad199-3950-4b86-b5fd-bcced49ed392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:17.551230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ad199-3950-4b86-b5fd-bcced49ed392 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:17.551514 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ad199-3950-4b86-b5fd-bcced49ed392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:17.551791 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ad199-3950-4b86-b5fd-bcced49ed392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:17.553683 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-df4ad199-3950-4b86-b5fd-bcced49ed392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:17.563169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ad199-3950-4b86-b5fd-bcced49ed392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:17.564622 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ad199-3950-4b86-b5fd-bcced49ed392 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:17.572617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1409/2772] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:18.009512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0bc2c0-5160-492f-a0d7-f6b4631a4e3b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:18.010891 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2e0bc2c0-5160-492f-a0d7-f6b4631a4e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:18.081688 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0bc2c0-5160-492f-a0d7-f6b4631a4e3b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:18.089878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc23a4e-3571-4783-b7e9-036b49836430 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6693dd1ea26049c1ac8460faf1bc9b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:18.090527 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc23a4e-3571-4783-b7e9-036b49836430 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:18.090811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc23a4e-3571-4783-b7e9-036b49836430 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:18.091090 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc23a4e-3571-4783-b7e9-036b49836430 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:18.093518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dbc23a4e-3571-4783-b7e9-036b49836430 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:18.105197 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc23a4e-3571-4783-b7e9-036b49836430 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:18.106765 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc23a4e-3571-4783-b7e9-036b49836430 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:18.117444 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1364/2773] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:19.754462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ad199-3950-4b86-b5fd-bcced49ed392 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:19.756011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-df4ad199-3950-4b86-b5fd-bcced49ed392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:19.767725 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ad199-3950-4b86-b5fd-bcced49ed392 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:19.771581 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18537d-e8df-4ef8-a963-33e78688473a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:19.772237 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18537d-e8df-4ef8-a963-33e78688473a service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:19.772561 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18537d-e8df-4ef8-a963-33e78688473a service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:19.772845 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18537d-e8df-4ef8-a963-33e78688473a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:19.774776 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-db18537d-e8df-4ef8-a963-33e78688473a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:19.786175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18537d-e8df-4ef8-a963-33e78688473a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:19.787642 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18537d-e8df-4ef8-a963-33e78688473a service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:19.796700 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1410/2774] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:28.113174 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=57 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:29.792486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=12 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:34.208441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc23a4e-3571-4783-b7e9-036b49836430 service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:34.210089 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dbc23a4e-3571-4783-b7e9-036b49836430 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:34.227066 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc23a4e-3571-4783-b7e9-036b49836430 service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:34.233099 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7154505-2223-4abf-ab79-b69aede403fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:34.234769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7154505-2223-4abf-ab79-b69aede403fd service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:34.235047 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7154505-2223-4abf-ab79-b69aede403fd service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:34.235329 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7154505-2223-4abf-ab79-b69aede403fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:34.237161 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d7154505-2223-4abf-ab79-b69aede403fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:34.260214 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7154505-2223-4abf-ab79-b69aede403fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:34.263028 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7154505-2223-4abf-ab79-b69aede403fd service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:34.275471 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1365/2775] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:37.402708 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18537d-e8df-4ef8-a963-33e78688473a service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:37.416619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18537d-e8df-4ef8-a963-33e78688473a service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:37.423169 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167250e-ddff-43ad-9a1a-59a49186e08d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:37.423910 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167250e-ddff-43ad-9a1a-59a49186e08d service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:37.424257 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167250e-ddff-43ad-9a1a-59a49186e08d service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:37.424624 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167250e-ddff-43ad-9a1a-59a49186e08d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:37.426430 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a167250e-ddff-43ad-9a1a-59a49186e08d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:37.439343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167250e-ddff-43ad-9a1a-59a49186e08d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:37.441235 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167250e-ddff-43ad-9a1a-59a49186e08d service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:37.453253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1411/2776] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:42.167477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7154505-2223-4abf-ab79-b69aede403fd service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:42.169290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d7154505-2223-4abf-ab79-b69aede403fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:42.236102 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7154505-2223-4abf-ab79-b69aede403fd service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:42.240646 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6de7c-6a20-4164-8200-d08378b1f601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:42.241506 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6de7c-6a20-4164-8200-d08378b1f601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:42.241786 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6de7c-6a20-4164-8200-d08378b1f601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:42.242062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6de7c-6a20-4164-8200-d08378b1f601 admin admin] PATH_INFO: `/v3/users/fbe7070e9384403ca998a996e8dd6b50` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:42.243258 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6de7c-6a20-4164-8200-d08378b1f601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe7070e9384403ca998a996e8dd6b50)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:42.245199 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6de7c-6a20-4164-8200-d08378b1f601 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:42.292522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-aca6de7c-6a20-4164-8200-d08378b1f601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe7070e9384403ca998a996e8dd6b50'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:42.306069 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-aca6de7c-6a20-4164-8200-d08378b1f601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe7070e9384403ca998a996e8dd6b50'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:42.306765 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-aca6de7c-6a20-4164-8200-d08378b1f601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe7070e9384403ca998a996e8dd6b50'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:42.313740 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-aca6de7c-6a20-4164-8200-d08378b1f601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe7070e9384403ca998a996e8dd6b50'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:42.314491 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-aca6de7c-6a20-4164-8200-d08378b1f601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe7070e9384403ca998a996e8dd6b50'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:42.327571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1366/2777] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:47:42 2022] DELETE /identity/v3/users/fbe7070e9384403ca998a996e8dd6b50 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:47:42.337112 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167250e-ddff-43ad-9a1a-59a49186e08d service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:42.347014 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167250e-ddff-43ad-9a1a-59a49186e08d service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:42.394631 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ecc92-51b9-4a57-afaa-352f4c566010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:42.395284 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ecc92-51b9-4a57-afaa-352f4c566010 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:42.395572 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ecc92-51b9-4a57-afaa-352f4c566010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:42.395855 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ecc92-51b9-4a57-afaa-352f4c566010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:42.397707 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e02ecc92-51b9-4a57-afaa-352f4c566010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:42.464228 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ecc92-51b9-4a57-afaa-352f4c566010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:42.465753 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ecc92-51b9-4a57-afaa-352f4c566010 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:42.476570 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1412/2778] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:42.649379 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6de7c-6a20-4164-8200-d08378b1f601 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:42.650818 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aca6de7c-6a20-4164-8200-d08378b1f601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:42.665091 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6de7c-6a20-4164-8200-d08378b1f601 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:42.669995 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732169e-17a9-4453-b7b4-a1896a35bbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:42.670972 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732169e-17a9-4453-b7b4-a1896a35bbe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:42.671490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732169e-17a9-4453-b7b4-a1896a35bbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:42.671916 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732169e-17a9-4453-b7b4-a1896a35bbe7 admin admin] PATH_INFO: `/v3/projects/f852483a41394ef699c09ccee827fa28` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:42.673057 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732169e-17a9-4453-b7b4-a1896a35bbe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f852483a41394ef699c09ccee827fa28)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:42.675011 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732169e-17a9-4453-b7b4-a1896a35bbe7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:42.727134 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3732169e-17a9-4453-b7b4-a1896a35bbe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f852483a41394ef699c09ccee827fa28', 'request_id': 'req-3732169e-17a9-4453-b7b4-a1896a35bbe7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:42.734971 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3732169e-17a9-4453-b7b4-a1896a35bbe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f852483a41394ef699c09ccee827fa28', 'request_id': 'req-3732169e-17a9-4453-b7b4-a1896a35bbe7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:42.741142 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3732169e-17a9-4453-b7b4-a1896a35bbe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f852483a41394ef699c09ccee827fa28', 'request_id': 'req-3732169e-17a9-4453-b7b4-a1896a35bbe7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:42.742302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:42.753926 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3732169e-17a9-4453-b7b4-a1896a35bbe7 admin admin] The token cache is being invalidate because project f852483a41394ef699c09ccee827fa28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:47:42.754147 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3732169e-17a9-4453-b7b4-a1896a35bbe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:42.754844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3732169e-17a9-4453-b7b4-a1896a35bbe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:42.756350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1367/2779] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:47:42 2022] DELETE /identity/v3/projects/f852483a41394ef699c09ccee827fa28 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:42.761290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25a387-300f-4e8c-8516-7edc7ec6c53b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:42.761591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25a387-300f-4e8c-8516-7edc7ec6c53b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:42.761873 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25a387-300f-4e8c-8516-7edc7ec6c53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:42.779412 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2f25a387-300f-4e8c-8516-7edc7ec6c53b None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:42.781167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2f25a387-300f-4e8c-8516-7edc7ec6c53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:42.840922 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1413/2780] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:42.849373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89965fc-1323-4108-a213-00aa9f02f834 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:42.849669 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89965fc-1323-4108-a213-00aa9f02f834 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:42.849955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89965fc-1323-4108-a213-00aa9f02f834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:42.868907 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a89965fc-1323-4108-a213-00aa9f02f834 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:42.870118 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a89965fc-1323-4108-a213-00aa9f02f834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:42.878369 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1368/2781] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:42.882380 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25a387-300f-4e8c-8516-7edc7ec6c53b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:42.892737 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25a387-300f-4e8c-8516-7edc7ec6c53b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:42.897295 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a839f40-9363-452b-bfc5-69048424093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:42.897944 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a839f40-9363-452b-bfc5-69048424093e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:42.898230 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a839f40-9363-452b-bfc5-69048424093e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:42.898506 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a839f40-9363-452b-bfc5-69048424093e admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:42.899225 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a839f40-9363-452b-bfc5-69048424093e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:47:42.899531 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a839f40-9363-452b-bfc5-69048424093e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:42.901159 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a839f40-9363-452b-bfc5-69048424093e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:42.913486 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1414/2782] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:47:42.917627 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89965fc-1323-4108-a213-00aa9f02f834 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:42.927598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89965fc-1323-4108-a213-00aa9f02f834 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:42.932259 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc3729-f8a9-4122-87e5-09d028f6aaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:42.932952 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc3729-f8a9-4122-87e5-09d028f6aaec admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:42.933239 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc3729-f8a9-4122-87e5-09d028f6aaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:42.933518 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc3729-f8a9-4122-87e5-09d028f6aaec admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:42.934209 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc3729-f8a9-4122-87e5-09d028f6aaec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:42.936120 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc3729-f8a9-4122-87e5-09d028f6aaec admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:42.973405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1369/2783] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:47:42 2022] POST /identity/v3/projects => generated 403 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:47:42.977487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a839f40-9363-452b-bfc5-69048424093e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:42.987762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a839f40-9363-452b-bfc5-69048424093e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:43.007877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:43.044275 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9dafb-d91d-4073-925b-5d83fed3c068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:43.044975 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9dafb-d91d-4073-925b-5d83fed3c068 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:43.045262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9dafb-d91d-4073-925b-5d83fed3c068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:43.045539 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9dafb-d91d-4073-925b-5d83fed3c068 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:43.046728 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9dafb-d91d-4073-925b-5d83fed3c068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:43.048680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9dafb-d91d-4073-925b-5d83fed3c068 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:43.067762 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1415/2784] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:47:42 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:47:43.071812 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc3729-f8a9-4122-87e5-09d028f6aaec admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:43.082601 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc3729-f8a9-4122-87e5-09d028f6aaec admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:43.087152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97412538-9a41-4e6e-b2a0-485662e68a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:43.087801 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412538-9a41-4e6e-b2a0-485662e68a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:43.088087 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412538-9a41-4e6e-b2a0-485662e68a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:43.088359 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412538-9a41-4e6e-b2a0-485662e68a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:43.089234 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97412538-9a41-4e6e-b2a0-485662e68a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:43.090813 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97412538-9a41-4e6e-b2a0-485662e68a84 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:43.101817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1370/2785] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:47:43.106121 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9dafb-d91d-4073-925b-5d83fed3c068 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:43.116974 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9dafb-d91d-4073-925b-5d83fed3c068 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:43.121559 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cfb44-1323-4f38-b3b2-0f8b8ccf6a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:43.122215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cfb44-1323-4f38-b3b2-0f8b8ccf6a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:43.122501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cfb44-1323-4f38-b3b2-0f8b8ccf6a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:43.122779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cfb44-1323-4f38-b3b2-0f8b8ccf6a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:43.123501 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cfb44-1323-4f38-b3b2-0f8b8ccf6a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:43.129775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cfb44-1323-4f38-b3b2-0f8b8ccf6a04 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:43.141445 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1416/2786] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:47:43.145565 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97412538-9a41-4e6e-b2a0-485662e68a84 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:43.155662 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97412538-9a41-4e6e-b2a0-485662e68a84 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:43.160251 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae4c66-d88c-4277-8d5d-82467a81fc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:43.161154 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae4c66-d88c-4277-8d5d-82467a81fc32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:43.161441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae4c66-d88c-4277-8d5d-82467a81fc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:43.161716 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae4c66-d88c-4277-8d5d-82467a81fc32 admin admin] PATH_INFO: `/v3/projects/e4a4be38ea924bb1a42eed386d3d83bf/users/9d2ebbf498fd452bb34ccae1d3302617/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:43.177188 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae4c66-d88c-4277-8d5d-82467a81fc32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a4be38ea924bb1a42eed386d3d83bf, user_id=9d2ebbf498fd452bb34ccae1d3302617, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:43.179840 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae4c66-d88c-4277-8d5d-82467a81fc32 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:43.193314 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1371/2787] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:47:43 2022] PUT /identity/v3/projects/e4a4be38ea924bb1a42eed386d3d83bf/users/9d2ebbf498fd452bb34ccae1d3302617/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:43.203253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739262f-442f-4f8a-bb51-a3e57beaf1a5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:43.203546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739262f-442f-4f8a-bb51-a3e57beaf1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:43.203827 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739262f-442f-4f8a-bb51-a3e57beaf1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:43.229191 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1739262f-442f-4f8a-bb51-a3e57beaf1a5 None None] MFA Rules not processed for user `9d2ebbf498fd452bb34ccae1d3302617`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:43.230378 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1739262f-442f-4f8a-bb51-a3e57beaf1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:43.294340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1417/2788] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:43.299516 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae4c66-d88c-4277-8d5d-82467a81fc32 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:43.361209 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae4c66-d88c-4277-8d5d-82467a81fc32 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:43.365871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb8533-2919-473f-bb25-f7bd36ccbdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:43.366525 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb8533-2919-473f-bb25-f7bd36ccbdef admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:43.366809 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb8533-2919-473f-bb25-f7bd36ccbdef admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:43.367085 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb8533-2919-473f-bb25-f7bd36ccbdef admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:43.367805 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb8533-2919-473f-bb25-f7bd36ccbdef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:43.369744 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb8533-2919-473f-bb25-f7bd36ccbdef admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:43.394268 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1372/2789] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:47:43 2022] POST /identity/v3/projects => generated 405 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:47:43.398289 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739262f-442f-4f8a-bb51-a3e57beaf1a5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:43.409653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739262f-442f-4f8a-bb51-a3e57beaf1a5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:43.465968 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db7406-682a-4905-ab63-c127d28082a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:43.466642 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db7406-682a-4905-ab63-c127d28082a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:43.466930 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db7406-682a-4905-ab63-c127d28082a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:43.467208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db7406-682a-4905-ab63-c127d28082a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:43.468437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db7406-682a-4905-ab63-c127d28082a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:43.470464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db7406-682a-4905-ab63-c127d28082a8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:43.490745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1418/2790] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:47:43 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:47:43.494769 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb8533-2919-473f-bb25-f7bd36ccbdef admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:43.505281 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb8533-2919-473f-bb25-f7bd36ccbdef admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:43.509899 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf64f8-577f-4cde-b4b2-5c1538a2c7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:43.510556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf64f8-577f-4cde-b4b2-5c1538a2c7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:43.510841 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf64f8-577f-4cde-b4b2-5c1538a2c7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:43.511120 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf64f8-577f-4cde-b4b2-5c1538a2c7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:43.511870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf64f8-577f-4cde-b4b2-5c1538a2c7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:43.513524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf64f8-577f-4cde-b4b2-5c1538a2c7c1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:43.523779 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1373/2791] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:47:43.527769 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db7406-682a-4905-ab63-c127d28082a8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:43.538755 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db7406-682a-4905-ab63-c127d28082a8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:43.543385 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c73f06-907e-41b0-9c6f-26b75389e97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:43.544599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c73f06-907e-41b0-9c6f-26b75389e97b admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:43.544831 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c73f06-907e-41b0-9c6f-26b75389e97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:43.545109 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c73f06-907e-41b0-9c6f-26b75389e97b admin admin] PATH_INFO: `/v3/projects/fef3b3776f3c4198b911031b9c5aaca6/users/b0d47d49516d456ebafcf420d5d04d1b/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:43.560316 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c73f06-907e-41b0-9c6f-26b75389e97b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef3b3776f3c4198b911031b9c5aaca6, user_id=b0d47d49516d456ebafcf420d5d04d1b, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:43.563208 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c73f06-907e-41b0-9c6f-26b75389e97b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:43.570875 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:43.577603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1419/2792] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:47:43 2022] PUT /identity/v3/projects/fef3b3776f3c4198b911031b9c5aaca6/users/b0d47d49516d456ebafcf420d5d04d1b/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:43.581484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf64f8-577f-4cde-b4b2-5c1538a2c7c1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:43.591324 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf64f8-577f-4cde-b4b2-5c1538a2c7c1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:43.637446 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:43.648624 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01849df-e27b-4573-992d-f22fa5abc4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:43.649285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01849df-e27b-4573-992d-f22fa5abc4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:43.649568 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01849df-e27b-4573-992d-f22fa5abc4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:43.649843 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01849df-e27b-4573-992d-f22fa5abc4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:43.650554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01849df-e27b-4573-992d-f22fa5abc4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:43.652182 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01849df-e27b-4573-992d-f22fa5abc4b7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:43.662372 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1374/2793] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:47:43.666556 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c73f06-907e-41b0-9c6f-26b75389e97b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:43.677896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c73f06-907e-41b0-9c6f-26b75389e97b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:43.682507 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea520e-447e-42bb-8a5c-9b9d0110fcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:43.683381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea520e-447e-42bb-8a5c-9b9d0110fcdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:43.683668 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea520e-447e-42bb-8a5c-9b9d0110fcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:43.683947 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea520e-447e-42bb-8a5c-9b9d0110fcdc admin admin] PATH_INFO: `/v3/projects/fef3b3776f3c4198b911031b9c5aaca6/users/b0d47d49516d456ebafcf420d5d04d1b/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:43.685954 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea520e-447e-42bb-8a5c-9b9d0110fcdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef3b3776f3c4198b911031b9c5aaca6, user_id=b0d47d49516d456ebafcf420d5d04d1b, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:43.688766 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea520e-447e-42bb-8a5c-9b9d0110fcdc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:43.698865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1420/2794] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:47:43 2022] PUT /identity/v3/projects/fef3b3776f3c4198b911031b9c5aaca6/users/b0d47d49516d456ebafcf420d5d04d1b/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:43.710541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b04c7-4803-4cbd-9d2f-569daaad7b68 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:43.710832 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b04c7-4803-4cbd-9d2f-569daaad7b68 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:43.711117 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b04c7-4803-4cbd-9d2f-569daaad7b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:43.737413 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-010b04c7-4803-4cbd-9d2f-569daaad7b68 None None] MFA Rules not processed for user `b0d47d49516d456ebafcf420d5d04d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:43.738598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-010b04c7-4803-4cbd-9d2f-569daaad7b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:43.803934 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1375/2795] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:43 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:43.814932 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea520e-447e-42bb-8a5c-9b9d0110fcdc admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:43.816694 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-43ea520e-447e-42bb-8a5c-9b9d0110fcdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:43.894904 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea520e-447e-42bb-8a5c-9b9d0110fcdc admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:43.898612 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e173e5-1209-4fb4-ae64-e426315f5de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:43.899256 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e173e5-1209-4fb4-ae64-e426315f5de8 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:43.899544 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e173e5-1209-4fb4-ae64-e426315f5de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:43.899826 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e173e5-1209-4fb4-ae64-e426315f5de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:43.909655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e173e5-1209-4fb4-ae64-e426315f5de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:43.911090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e173e5-1209-4fb4-ae64-e426315f5de8 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:43.920832 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1421/2796] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:43 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:44.048481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b04c7-4803-4cbd-9d2f-569daaad7b68 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:44.110950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b04c7-4803-4cbd-9d2f-569daaad7b68 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:44.115463 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49571f33-df2b-4a3a-a83f-8e7efec8b425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:44.116325 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571f33-df2b-4a3a-a83f-8e7efec8b425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:44.116640 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571f33-df2b-4a3a-a83f-8e7efec8b425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:44.116920 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571f33-df2b-4a3a-a83f-8e7efec8b425 admin admin] PATH_INFO: `/v3/users/9d2ebbf498fd452bb34ccae1d3302617` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:44.118107 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49571f33-df2b-4a3a-a83f-8e7efec8b425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2ebbf498fd452bb34ccae1d3302617)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:44.120043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49571f33-df2b-4a3a-a83f-8e7efec8b425 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:44.176831 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-49571f33-df2b-4a3a-a83f-8e7efec8b425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2ebbf498fd452bb34ccae1d3302617'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.189566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-49571f33-df2b-4a3a-a83f-8e7efec8b425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2ebbf498fd452bb34ccae1d3302617'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.190226 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-49571f33-df2b-4a3a-a83f-8e7efec8b425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2ebbf498fd452bb34ccae1d3302617'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.197293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-49571f33-df2b-4a3a-a83f-8e7efec8b425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2ebbf498fd452bb34ccae1d3302617'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.197940 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-49571f33-df2b-4a3a-a83f-8e7efec8b425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2ebbf498fd452bb34ccae1d3302617'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.199641 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:44.211953 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1376/2797] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:47:44 2022] DELETE /identity/v3/users/9d2ebbf498fd452bb34ccae1d3302617 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:44.216444 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129d93f-2c7c-4d89-9d2b-bee79728ac40 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:44.216788 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129d93f-2c7c-4d89-9d2b-bee79728ac40 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:44.217070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129d93f-2c7c-4d89-9d2b-bee79728ac40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:44.234923 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9129d93f-2c7c-4d89-9d2b-bee79728ac40 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:44.236285 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9129d93f-2c7c-4d89-9d2b-bee79728ac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:44.294293 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1422/2798] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:44.304903 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49571f33-df2b-4a3a-a83f-8e7efec8b425 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:44.306289 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-49571f33-df2b-4a3a-a83f-8e7efec8b425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:44.363045 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49571f33-df2b-4a3a-a83f-8e7efec8b425 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:44.366554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99ccd9-27b4-4165-9226-57fc063f0ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:44.367191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99ccd9-27b4-4165-9226-57fc063f0ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:44.367473 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99ccd9-27b4-4165-9226-57fc063f0ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:44.367748 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99ccd9-27b4-4165-9226-57fc063f0ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:44.377665 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99ccd9-27b4-4165-9226-57fc063f0ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:44.379139 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99ccd9-27b4-4165-9226-57fc063f0ce9 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:44.388746 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1377/2799] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:44.657294 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129d93f-2c7c-4d89-9d2b-bee79728ac40 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:44.658753 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9129d93f-2c7c-4d89-9d2b-bee79728ac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:44.670780 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129d93f-2c7c-4d89-9d2b-bee79728ac40 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:44.676118 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:44.677014 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:44.677379 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:44.677660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] PATH_INFO: `/v3/projects/e4a4be38ea924bb1a42eed386d3d83bf` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:44.678840 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a4be38ea924bb1a42eed386d3d83bf)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:44.680784 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:44.728270 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a4be38ea924bb1a42eed386d3d83bf', 'request_id': 'req-007ae7f2-b10a-43f8-8941-35df01972978'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.734214 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a4be38ea924bb1a42eed386d3d83bf', 'request_id': 'req-007ae7f2-b10a-43f8-8941-35df01972978'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.740290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a4be38ea924bb1a42eed386d3d83bf', 'request_id': 'req-007ae7f2-b10a-43f8-8941-35df01972978'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.741917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:44.754229 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] The token cache is being invalidate because project e4a4be38ea924bb1a42eed386d3d83bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:47:44.754514 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.755134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.756682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1423/2800] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:47:44 2022] DELETE /identity/v3/projects/e4a4be38ea924bb1a42eed386d3d83bf => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:44.760980 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99ccd9-27b4-4165-9226-57fc063f0ce9 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:44.770745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99ccd9-27b4-4165-9226-57fc063f0ce9 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:44.827300 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22c234-72bd-474c-b085-a462b4372319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:44.828222 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22c234-72bd-474c-b085-a462b4372319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:44.828537 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22c234-72bd-474c-b085-a462b4372319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:44.828895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22c234-72bd-474c-b085-a462b4372319 admin admin] PATH_INFO: `/v3/users/b0d47d49516d456ebafcf420d5d04d1b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:44.830094 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22c234-72bd-474c-b085-a462b4372319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d47d49516d456ebafcf420d5d04d1b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:44.832021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22c234-72bd-474c-b085-a462b4372319 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:44.878925 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ab22c234-72bd-474c-b085-a462b4372319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d47d49516d456ebafcf420d5d04d1b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.890437 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ab22c234-72bd-474c-b085-a462b4372319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d47d49516d456ebafcf420d5d04d1b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.891128 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ab22c234-72bd-474c-b085-a462b4372319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d47d49516d456ebafcf420d5d04d1b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.898522 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ab22c234-72bd-474c-b085-a462b4372319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d47d49516d456ebafcf420d5d04d1b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.899149 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ab22c234-72bd-474c-b085-a462b4372319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d47d49516d456ebafcf420d5d04d1b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:44.912123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1378/2801] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:47:44 2022] DELETE /identity/v3/users/b0d47d49516d456ebafcf420d5d04d1b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:45.184976 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:45.186553 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:45.201715 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ae7f2-b10a-43f8-8941-35df01972978 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:45.265719 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb6945-0904-4f06-b46a-af597b4bc4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:45.267035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb6945-0904-4f06-b46a-af597b4bc4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:45.267323 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb6945-0904-4f06-b46a-af597b4bc4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:45.267601 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb6945-0904-4f06-b46a-af597b4bc4e8 admin admin] PATH_INFO: `/v3/projects/fef3b3776f3c4198b911031b9c5aaca6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:45.268895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb6945-0904-4f06-b46a-af597b4bc4e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fef3b3776f3c4198b911031b9c5aaca6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:45.270843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb6945-0904-4f06-b46a-af597b4bc4e8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:45.318872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-85bb6945-0904-4f06-b46a-af597b4bc4e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef3b3776f3c4198b911031b9c5aaca6', 'request_id': 'req-85bb6945-0904-4f06-b46a-af597b4bc4e8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:45.324902 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-85bb6945-0904-4f06-b46a-af597b4bc4e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef3b3776f3c4198b911031b9c5aaca6', 'request_id': 'req-85bb6945-0904-4f06-b46a-af597b4bc4e8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:45.330777 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-85bb6945-0904-4f06-b46a-af597b4bc4e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef3b3776f3c4198b911031b9c5aaca6', 'request_id': 'req-85bb6945-0904-4f06-b46a-af597b4bc4e8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:45.343286 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-85bb6945-0904-4f06-b46a-af597b4bc4e8 admin admin] The token cache is being invalidate because project fef3b3776f3c4198b911031b9c5aaca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:47:45.343688 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-85bb6945-0904-4f06-b46a-af597b4bc4e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:45.344933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-85bb6945-0904-4f06-b46a-af597b4bc4e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:45.346598 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1424/2802] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:47:45 2022] DELETE /identity/v3/projects/fef3b3776f3c4198b911031b9c5aaca6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:47:45.351592 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c90f8-01fb-4cf0-ba54-b87a41ec6875 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:45.352081 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c90f8-01fb-4cf0-ba54-b87a41ec6875 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:45.352283 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c90f8-01fb-4cf0-ba54-b87a41ec6875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:45.372031 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d06c90f8-01fb-4cf0-ba54-b87a41ec6875 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:45.373250 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d06c90f8-01fb-4cf0-ba54-b87a41ec6875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:45.382042 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:45.433335 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1379/2803] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:45.442414 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423fea7-2dd3-40a2-8fbf-13da4935e259 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:45.442713 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423fea7-2dd3-40a2-8fbf-13da4935e259 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:45.442998 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423fea7-2dd3-40a2-8fbf-13da4935e259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:45.461724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8423fea7-2dd3-40a2-8fbf-13da4935e259 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:45.462945 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8423fea7-2dd3-40a2-8fbf-13da4935e259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:45.471953 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1425/2804] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:45.476319 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c90f8-01fb-4cf0-ba54-b87a41ec6875 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:45.486822 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c90f8-01fb-4cf0-ba54-b87a41ec6875 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:45.491394 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff6d57-608d-45bc-9fcb-16ff4923e690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:45.492512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff6d57-608d-45bc-9fcb-16ff4923e690 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:45.492794 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff6d57-608d-45bc-9fcb-16ff4923e690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:45.493068 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff6d57-608d-45bc-9fcb-16ff4923e690 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:45.493830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff6d57-608d-45bc-9fcb-16ff4923e690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:47:45.494133 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff6d57-608d-45bc-9fcb-16ff4923e690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:45.495718 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff6d57-608d-45bc-9fcb-16ff4923e690 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:45.507115 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1380/2805] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:47:45.511482 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423fea7-2dd3-40a2-8fbf-13da4935e259 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:45.520830 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423fea7-2dd3-40a2-8fbf-13da4935e259 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:45.525521 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3cc52-9aa0-46e0-9197-c765cdec061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:45.526165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3cc52-9aa0-46e0-9197-c765cdec061d admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:45.526448 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3cc52-9aa0-46e0-9197-c765cdec061d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:45.526752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3cc52-9aa0-46e0-9197-c765cdec061d admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:45.527433 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3cc52-9aa0-46e0-9197-c765cdec061d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:45.529358 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3cc52-9aa0-46e0-9197-c765cdec061d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:45.555295 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1426/2806] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:47:45 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:47:45.559347 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff6d57-608d-45bc-9fcb-16ff4923e690 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:45.570094 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff6d57-608d-45bc-9fcb-16ff4923e690 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:45.625871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae0380-5ac6-4bfd-9166-2786c3ca9a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:45.626548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae0380-5ac6-4bfd-9166-2786c3ca9a3d admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:45.626830 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae0380-5ac6-4bfd-9166-2786c3ca9a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:45.627105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae0380-5ac6-4bfd-9166-2786c3ca9a3d admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:45.627798 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae0380-5ac6-4bfd-9166-2786c3ca9a3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:45.630284 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae0380-5ac6-4bfd-9166-2786c3ca9a3d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:45.650885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1381/2807] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:47:45 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:47:45.654911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3cc52-9aa0-46e0-9197-c765cdec061d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:45.665326 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3cc52-9aa0-46e0-9197-c765cdec061d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:45.670152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c1400-8ea6-4ca1-b648-874932dae949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:45.670810 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c1400-8ea6-4ca1-b648-874932dae949 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:45.671094 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c1400-8ea6-4ca1-b648-874932dae949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:45.671366 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c1400-8ea6-4ca1-b648-874932dae949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:45.672086 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c1400-8ea6-4ca1-b648-874932dae949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:45.673710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c1400-8ea6-4ca1-b648-874932dae949 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:45.683978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1427/2808] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:47:45.688459 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae0380-5ac6-4bfd-9166-2786c3ca9a3d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:45.698598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae0380-5ac6-4bfd-9166-2786c3ca9a3d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:45.703770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ea581-e00d-4732-8d2a-150afec7ffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:45.704642 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ea581-e00d-4732-8d2a-150afec7ffa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:45.704923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ea581-e00d-4732-8d2a-150afec7ffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:45.705201 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ea581-e00d-4732-8d2a-150afec7ffa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:45.705915 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ea581-e00d-4732-8d2a-150afec7ffa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:45.707495 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ea581-e00d-4732-8d2a-150afec7ffa7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:45.717194 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1382/2809] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:47:45.721259 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c1400-8ea6-4ca1-b648-874932dae949 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:45.731059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c1400-8ea6-4ca1-b648-874932dae949 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:45.735636 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5316f09-dedf-42e5-be8d-1354b628b347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:45.736524 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5316f09-dedf-42e5-be8d-1354b628b347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:45.736805 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5316f09-dedf-42e5-be8d-1354b628b347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:45.737078 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5316f09-dedf-42e5-be8d-1354b628b347 admin admin] PATH_INFO: `/v3/projects/e93215100823496e9913bcf48c6aa72c/users/b163cef1fe904258974b7d4e626c2a38/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:45.751485 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5316f09-dedf-42e5-be8d-1354b628b347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93215100823496e9913bcf48c6aa72c, user_id=b163cef1fe904258974b7d4e626c2a38, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:45.754154 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5316f09-dedf-42e5-be8d-1354b628b347 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:45.767437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1428/2810] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:47:45 2022] PUT /identity/v3/projects/e93215100823496e9913bcf48c6aa72c/users/b163cef1fe904258974b7d4e626c2a38/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:45.777617 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bc0b4-85a1-4240-b49a-1bb5c9160a9a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:45.777938 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bc0b4-85a1-4240-b49a-1bb5c9160a9a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:45.778224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bc0b4-85a1-4240-b49a-1bb5c9160a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:45.804961 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0b3bc0b4-85a1-4240-b49a-1bb5c9160a9a None None] MFA Rules not processed for user `b163cef1fe904258974b7d4e626c2a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:45.806169 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0b3bc0b4-85a1-4240-b49a-1bb5c9160a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:45.870533 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1383/2811] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:45.875004 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5316f09-dedf-42e5-be8d-1354b628b347 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:45.894352 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:45.937517 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5316f09-dedf-42e5-be8d-1354b628b347 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:45.943064 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b59d1-1d75-432d-a1d1-64d0dfdba826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:45.943724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b59d1-1d75-432d-a1d1-64d0dfdba826 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:45.944010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b59d1-1d75-432d-a1d1-64d0dfdba826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:45.944287 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b59d1-1d75-432d-a1d1-64d0dfdba826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:45.944998 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b59d1-1d75-432d-a1d1-64d0dfdba826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:45.946888 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b59d1-1d75-432d-a1d1-64d0dfdba826 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:45.971231 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1429/2812] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:47:45 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:47:45.975438 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bc0b4-85a1-4240-b49a-1bb5c9160a9a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:45.986550 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bc0b4-85a1-4240-b49a-1bb5c9160a9a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:45.991022 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:46.041411 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb85d31-7fc0-4a4c-9499-ab36c101ede9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:46.042073 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb85d31-7fc0-4a4c-9499-ab36c101ede9 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:46.042353 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb85d31-7fc0-4a4c-9499-ab36c101ede9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:46.042630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb85d31-7fc0-4a4c-9499-ab36c101ede9 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:46.043317 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb85d31-7fc0-4a4c-9499-ab36c101ede9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:46.045524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb85d31-7fc0-4a4c-9499-ab36c101ede9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:46.065588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1384/2813] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:47:45 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:47:46.069484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b59d1-1d75-432d-a1d1-64d0dfdba826 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:46.079774 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b59d1-1d75-432d-a1d1-64d0dfdba826 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:46.084296 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a1e76-e56c-47b8-9572-0686f01e4075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:46.084996 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a1e76-e56c-47b8-9572-0686f01e4075 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:46.085279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a1e76-e56c-47b8-9572-0686f01e4075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:46.085553 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a1e76-e56c-47b8-9572-0686f01e4075 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:46.086265 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a1e76-e56c-47b8-9572-0686f01e4075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:46.087845 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a1e76-e56c-47b8-9572-0686f01e4075 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:46.098878 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1430/2814] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:47:46.102888 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb85d31-7fc0-4a4c-9499-ab36c101ede9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:46.113480 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb85d31-7fc0-4a4c-9499-ab36c101ede9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:46.118254 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a5736-bdaf-4029-b41f-9d9de840a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:46.119159 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5736-bdaf-4029-b41f-9d9de840a170 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:46.119440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5736-bdaf-4029-b41f-9d9de840a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:46.119715 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5736-bdaf-4029-b41f-9d9de840a170 admin admin] PATH_INFO: `/v3/projects/fc5a685a4d2c4c9db04fd86f2d9595d9/users/b05f1505067f446b8c20f801cce341b6/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:46.135217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a5736-bdaf-4029-b41f-9d9de840a170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5a685a4d2c4c9db04fd86f2d9595d9, user_id=b05f1505067f446b8c20f801cce341b6, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:46.137910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a5736-bdaf-4029-b41f-9d9de840a170 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:46.150519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1385/2815] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:47:46 2022] PUT /identity/v3/projects/fc5a685a4d2c4c9db04fd86f2d9595d9/users/b05f1505067f446b8c20f801cce341b6/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:46.154333 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a1e76-e56c-47b8-9572-0686f01e4075 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:46.164423 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a1e76-e56c-47b8-9572-0686f01e4075 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:46.223040 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626146b-6af6-4ff6-8862-ce321c4d2f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:46.223616 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626146b-6af6-4ff6-8862-ce321c4d2f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:46.223905 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626146b-6af6-4ff6-8862-ce321c4d2f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:46.224188 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626146b-6af6-4ff6-8862-ce321c4d2f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:46.224992 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626146b-6af6-4ff6-8862-ce321c4d2f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:46.226605 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626146b-6af6-4ff6-8862-ce321c4d2f89 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:46.237306 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1431/2816] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:47:46.241506 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a5736-bdaf-4029-b41f-9d9de840a170 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:46.253214 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a5736-bdaf-4029-b41f-9d9de840a170 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:46.257950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820aef43-1dc1-49ed-9cc6-77ec7320ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:46.258829 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820aef43-1dc1-49ed-9cc6-77ec7320ba10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:46.259112 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820aef43-1dc1-49ed-9cc6-77ec7320ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:46.259389 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820aef43-1dc1-49ed-9cc6-77ec7320ba10 admin admin] PATH_INFO: `/v3/projects/fc5a685a4d2c4c9db04fd86f2d9595d9/users/b05f1505067f446b8c20f801cce341b6/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:46.261440 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820aef43-1dc1-49ed-9cc6-77ec7320ba10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5a685a4d2c4c9db04fd86f2d9595d9, user_id=b05f1505067f446b8c20f801cce341b6, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:46.264083 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820aef43-1dc1-49ed-9cc6-77ec7320ba10 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:46.274345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1386/2817] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:47:46 2022] PUT /identity/v3/projects/fc5a685a4d2c4c9db04fd86f2d9595d9/users/b05f1505067f446b8c20f801cce341b6/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:46.286078 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b2e07-0d4b-4aa7-b54d-1b41682109cd None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:46.286380 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b2e07-0d4b-4aa7-b54d-1b41682109cd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:46.286666 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b2e07-0d4b-4aa7-b54d-1b41682109cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:46.314318 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-979b2e07-0d4b-4aa7-b54d-1b41682109cd None None] MFA Rules not processed for user `b05f1505067f446b8c20f801cce341b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:46.315532 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-979b2e07-0d4b-4aa7-b54d-1b41682109cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:46.382398 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1432/2818] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:46.393566 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820aef43-1dc1-49ed-9cc6-77ec7320ba10 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:46.395304 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-820aef43-1dc1-49ed-9cc6-77ec7320ba10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:46.457015 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820aef43-1dc1-49ed-9cc6-77ec7320ba10 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:46.460707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9662f6-ff05-4a79-b148-e956bf47236d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:46.461352 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9662f6-ff05-4a79-b148-e956bf47236d service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:46.461637 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9662f6-ff05-4a79-b148-e956bf47236d service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:46.461916 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9662f6-ff05-4a79-b148-e956bf47236d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:46.472493 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9662f6-ff05-4a79-b148-e956bf47236d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:46.474031 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9662f6-ff05-4a79-b148-e956bf47236d service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:46.483558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1387/2819] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:46 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:46.559998 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b2e07-0d4b-4aa7-b54d-1b41682109cd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:46.569834 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b2e07-0d4b-4aa7-b54d-1b41682109cd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:46.573490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38871ef5-ee71-4df1-90d4-226da2b84240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:46.574128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38871ef5-ee71-4df1-90d4-226da2b84240 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:46.574420 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38871ef5-ee71-4df1-90d4-226da2b84240 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:46.574702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38871ef5-ee71-4df1-90d4-226da2b84240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:46.584467 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:46.633279 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38871ef5-ee71-4df1-90d4-226da2b84240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:46.634763 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38871ef5-ee71-4df1-90d4-226da2b84240 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:46.644268 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1433/2820] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:51.300299 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9662f6-ff05-4a79-b148-e956bf47236d service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:51.361882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9662f6-ff05-4a79-b148-e956bf47236d service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:51.366282 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e759ca7-36c3-4be8-9f28-c09b56974401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:51.367138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e759ca7-36c3-4be8-9f28-c09b56974401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:51.367419 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e759ca7-36c3-4be8-9f28-c09b56974401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:51.367693 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e759ca7-36c3-4be8-9f28-c09b56974401 admin admin] PATH_INFO: `/v3/users/b163cef1fe904258974b7d4e626c2a38` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:51.368880 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e759ca7-36c3-4be8-9f28-c09b56974401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b163cef1fe904258974b7d4e626c2a38)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:51.370786 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e759ca7-36c3-4be8-9f28-c09b56974401 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:51.375239 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:51.420006 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9e759ca7-36c3-4be8-9f28-c09b56974401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b163cef1fe904258974b7d4e626c2a38'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:51.432860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9e759ca7-36c3-4be8-9f28-c09b56974401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b163cef1fe904258974b7d4e626c2a38'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:51.433545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9e759ca7-36c3-4be8-9f28-c09b56974401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b163cef1fe904258974b7d4e626c2a38'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:51.441461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9e759ca7-36c3-4be8-9f28-c09b56974401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b163cef1fe904258974b7d4e626c2a38'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:51.442116 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9e759ca7-36c3-4be8-9f28-c09b56974401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b163cef1fe904258974b7d4e626c2a38'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:51.456291 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1388/2821] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:47:51 2022] DELETE /identity/v3/users/b163cef1fe904258974b7d4e626c2a38 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:51.461076 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6df1e-1272-4ca7-887c-a875c68d3873 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:51.461505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6df1e-1272-4ca7-887c-a875c68d3873 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:51.461877 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6df1e-1272-4ca7-887c-a875c68d3873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:51.480062 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e3b6df1e-1272-4ca7-887c-a875c68d3873 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:51.481307 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e3b6df1e-1272-4ca7-887c-a875c68d3873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:51.538696 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1434/2822] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:51.548930 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e759ca7-36c3-4be8-9f28-c09b56974401 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:51.550630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9e759ca7-36c3-4be8-9f28-c09b56974401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:51.606707 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e759ca7-36c3-4be8-9f28-c09b56974401 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:51.610353 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67be4b8-eb1b-44ab-8b4d-a2e4cc7da6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:51.611021 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67be4b8-eb1b-44ab-8b4d-a2e4cc7da6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:51.611305 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67be4b8-eb1b-44ab-8b4d-a2e4cc7da6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:51.611583 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67be4b8-eb1b-44ab-8b4d-a2e4cc7da6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:51.620491 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67be4b8-eb1b-44ab-8b4d-a2e4cc7da6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:51.621870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67be4b8-eb1b-44ab-8b4d-a2e4cc7da6b2 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:51.631802 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1389/2823] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:51.896618 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6df1e-1272-4ca7-887c-a875c68d3873 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:51.898264 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e3b6df1e-1272-4ca7-887c-a875c68d3873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:51.910795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6df1e-1272-4ca7-887c-a875c68d3873 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:51.915365 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:51.916216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:51.916589 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:51.916798 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] PATH_INFO: `/v3/projects/e93215100823496e9913bcf48c6aa72c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:51.917972 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93215100823496e9913bcf48c6aa72c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:51.920233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:51.969670 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93215100823496e9913bcf48c6aa72c', 'request_id': 'req-f084920a-d889-4bf2-96c1-c190e383e9ac'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:51.976204 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93215100823496e9913bcf48c6aa72c', 'request_id': 'req-f084920a-d889-4bf2-96c1-c190e383e9ac'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:51.981778 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93215100823496e9913bcf48c6aa72c', 'request_id': 'req-f084920a-d889-4bf2-96c1-c190e383e9ac'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:51.994885 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] The token cache is being invalidate because project e93215100823496e9913bcf48c6aa72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:47:51.995175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:51.995817 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:51.997426 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1435/2824] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:47:51 2022] DELETE /identity/v3/projects/e93215100823496e9913bcf48c6aa72c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:52.002886 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67be4b8-eb1b-44ab-8b4d-a2e4cc7da6b2 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:52.012481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67be4b8-eb1b-44ab-8b4d-a2e4cc7da6b2 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:52.069477 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d41810-015c-4c8e-adbc-d49bfa330dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:52.070339 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41810-015c-4c8e-adbc-d49bfa330dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:52.070622 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41810-015c-4c8e-adbc-d49bfa330dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:52.070900 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41810-015c-4c8e-adbc-d49bfa330dfa admin admin] PATH_INFO: `/v3/users/b05f1505067f446b8c20f801cce341b6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:52.072074 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d41810-015c-4c8e-adbc-d49bfa330dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05f1505067f446b8c20f801cce341b6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:52.074032 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d41810-015c-4c8e-adbc-d49bfa330dfa admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:52.102502 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:52.122004 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-92d41810-015c-4c8e-adbc-d49bfa330dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05f1505067f446b8c20f801cce341b6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:52.134191 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-92d41810-015c-4c8e-adbc-d49bfa330dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05f1505067f446b8c20f801cce341b6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:52.134877 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-92d41810-015c-4c8e-adbc-d49bfa330dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05f1505067f446b8c20f801cce341b6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:52.141619 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-92d41810-015c-4c8e-adbc-d49bfa330dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05f1505067f446b8c20f801cce341b6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:52.142426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-92d41810-015c-4c8e-adbc-d49bfa330dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05f1505067f446b8c20f801cce341b6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:52.155059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1390/2825] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:47:52 2022] DELETE /identity/v3/users/b05f1505067f446b8c20f801cce341b6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:52.426661 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:52.428216 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:52.449413 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084920a-d889-4bf2-96c1-c190e383e9ac admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:52.485882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:52.512455 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487890ac-9250-46c8-a885-999bebbc5bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:52.513452 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487890ac-9250-46c8-a885-999bebbc5bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:52.513789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487890ac-9250-46c8-a885-999bebbc5bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:52.514070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487890ac-9250-46c8-a885-999bebbc5bd4 admin admin] PATH_INFO: `/v3/projects/fc5a685a4d2c4c9db04fd86f2d9595d9` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:52.515263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487890ac-9250-46c8-a885-999bebbc5bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5a685a4d2c4c9db04fd86f2d9595d9)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:52.518511 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487890ac-9250-46c8-a885-999bebbc5bd4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:52.565317 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-487890ac-9250-46c8-a885-999bebbc5bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5a685a4d2c4c9db04fd86f2d9595d9', 'request_id': 'req-487890ac-9250-46c8-a885-999bebbc5bd4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:52.571329 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-487890ac-9250-46c8-a885-999bebbc5bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5a685a4d2c4c9db04fd86f2d9595d9', 'request_id': 'req-487890ac-9250-46c8-a885-999bebbc5bd4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:52.576867 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-487890ac-9250-46c8-a885-999bebbc5bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5a685a4d2c4c9db04fd86f2d9595d9', 'request_id': 'req-487890ac-9250-46c8-a885-999bebbc5bd4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:52.590056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-487890ac-9250-46c8-a885-999bebbc5bd4 admin admin] The token cache is being invalidate because project fc5a685a4d2c4c9db04fd86f2d9595d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:47:52.590345 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-487890ac-9250-46c8-a885-999bebbc5bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:52.590961 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-487890ac-9250-46c8-a885-999bebbc5bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:52.592510 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1436/2826] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:47:52 2022] DELETE /identity/v3/projects/fc5a685a4d2c4c9db04fd86f2d9595d9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:52.597687 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0cd00-4fdf-4091-a872-e32b82c3188e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:52.598152 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0cd00-4fdf-4091-a872-e32b82c3188e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:52.598297 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0cd00-4fdf-4091-a872-e32b82c3188e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:52.617040 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-46b0cd00-4fdf-4091-a872-e32b82c3188e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:52.618249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-46b0cd00-4fdf-4091-a872-e32b82c3188e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:52.678366 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1391/2827] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:52.685969 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a693b-fc38-4f9c-ad2b-c89e934dcd8e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:52.686258 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a693b-fc38-4f9c-ad2b-c89e934dcd8e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:52.686534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a693b-fc38-4f9c-ad2b-c89e934dcd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:52.713732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-656a693b-fc38-4f9c-ad2b-c89e934dcd8e None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:52.715009 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-656a693b-fc38-4f9c-ad2b-c89e934dcd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:52.723682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1437/2828] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:47:52.727914 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0cd00-4fdf-4091-a872-e32b82c3188e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:52.738458 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0cd00-4fdf-4091-a872-e32b82c3188e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:52.743070 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaace7-37f5-4eaa-873e-eb92fbdf93f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:52.743720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaace7-37f5-4eaa-873e-eb92fbdf93f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:52.744009 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaace7-37f5-4eaa-873e-eb92fbdf93f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:52.744293 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaace7-37f5-4eaa-873e-eb92fbdf93f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:52.745053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eaace7-37f5-4eaa-873e-eb92fbdf93f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:47:52.745363 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eaace7-37f5-4eaa-873e-eb92fbdf93f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:52.746956 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eaace7-37f5-4eaa-873e-eb92fbdf93f7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:52.759111 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1392/2829] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:47:52.763290 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a693b-fc38-4f9c-ad2b-c89e934dcd8e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:52.773567 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a693b-fc38-4f9c-ad2b-c89e934dcd8e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:52.778199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda0c14-a967-4d88-9ef4-06b6545fa04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:52.778854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda0c14-a967-4d88-9ef4-06b6545fa04b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:52.779139 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda0c14-a967-4d88-9ef4-06b6545fa04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:52.779415 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda0c14-a967-4d88-9ef4-06b6545fa04b admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:52.780096 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda0c14-a967-4d88-9ef4-06b6545fa04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:52.782034 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda0c14-a967-4d88-9ef4-06b6545fa04b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:52.807505 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1438/2830] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:47:52 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:47:52.811680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaace7-37f5-4eaa-873e-eb92fbdf93f7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:52.822436 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaace7-37f5-4eaa-873e-eb92fbdf93f7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:52.877935 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4f116-9405-42e4-a9e5-d5d6ad3b9f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:52.878600 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4f116-9405-42e4-a9e5-d5d6ad3b9f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:52.878885 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4f116-9405-42e4-a9e5-d5d6ad3b9f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:52.879163 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4f116-9405-42e4-a9e5-d5d6ad3b9f88 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:52.879860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4f116-9405-42e4-a9e5-d5d6ad3b9f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:52.881910 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4f116-9405-42e4-a9e5-d5d6ad3b9f88 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:52.903603 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1393/2831] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:47:52 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:47:52.907546 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda0c14-a967-4d88-9ef4-06b6545fa04b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:52.917785 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda0c14-a967-4d88-9ef4-06b6545fa04b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:52.922587 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8fbc4-d064-447f-97b0-3145df339a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:52.923732 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8fbc4-d064-447f-97b0-3145df339a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:52.924059 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8fbc4-d064-447f-97b0-3145df339a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:52.924285 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8fbc4-d064-447f-97b0-3145df339a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:52.925022 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8fbc4-d064-447f-97b0-3145df339a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:52.926602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8fbc4-d064-447f-97b0-3145df339a5f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:52.936865 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1439/2832] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:47:52.941565 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4f116-9405-42e4-a9e5-d5d6ad3b9f88 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:52.951478 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4f116-9405-42e4-a9e5-d5d6ad3b9f88 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:52.956605 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b2776-7d0d-4b72-8ada-0b2cd1007b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:52.957272 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b2776-7d0d-4b72-8ada-0b2cd1007b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:52.957561 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b2776-7d0d-4b72-8ada-0b2cd1007b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:52.957843 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b2776-7d0d-4b72-8ada-0b2cd1007b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:52.958567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b2776-7d0d-4b72-8ada-0b2cd1007b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:52.960234 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b2776-7d0d-4b72-8ada-0b2cd1007b2b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:52.970967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1394/2833] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:47:52.974966 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8fbc4-d064-447f-97b0-3145df339a5f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:52.985013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8fbc4-d064-447f-97b0-3145df339a5f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:52.990489 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb54c4-da10-4545-a13d-948ad65fa3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:52.991367 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb54c4-da10-4545-a13d-948ad65fa3e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:52.991653 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb54c4-da10-4545-a13d-948ad65fa3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:52.991934 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb54c4-da10-4545-a13d-948ad65fa3e9 admin admin] PATH_INFO: `/v3/projects/f5cdfe1f9eb047868b65941aeec78da8/users/ab5cc104f49042278de1bf72b473021e/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:53.006596 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb54c4-da10-4545-a13d-948ad65fa3e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cdfe1f9eb047868b65941aeec78da8, user_id=ab5cc104f49042278de1bf72b473021e, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:53.009342 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb54c4-da10-4545-a13d-948ad65fa3e9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:53.022123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1440/2834] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:47:52 2022] PUT /identity/v3/projects/f5cdfe1f9eb047868b65941aeec78da8/users/ab5cc104f49042278de1bf72b473021e/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:53.033967 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275ad59-0896-4a34-9e42-f66cbe21e4ab None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:53.034271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275ad59-0896-4a34-9e42-f66cbe21e4ab None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:53.034548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275ad59-0896-4a34-9e42-f66cbe21e4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:53.054014 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:53.061844 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c275ad59-0896-4a34-9e42-f66cbe21e4ab None None] MFA Rules not processed for user `ab5cc104f49042278de1bf72b473021e`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:53.063615 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c275ad59-0896-4a34-9e42-f66cbe21e4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:53.127231 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1395/2835] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:53.131761 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb54c4-da10-4545-a13d-948ad65fa3e9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:53.191899 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb54c4-da10-4545-a13d-948ad65fa3e9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:53.196365 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d7095-b5f2-4c81-8601-279a2ba676ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:53.197035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d7095-b5f2-4c81-8601-279a2ba676ad admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:53.197348 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d7095-b5f2-4c81-8601-279a2ba676ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:53.197591 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d7095-b5f2-4c81-8601-279a2ba676ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:53.198263 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d7095-b5f2-4c81-8601-279a2ba676ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:53.200132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d7095-b5f2-4c81-8601-279a2ba676ad admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:53.204132 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:53.227380 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1441/2836] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:47:53 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:47:53.231435 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275ad59-0896-4a34-9e42-f66cbe21e4ab None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:53.242671 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275ad59-0896-4a34-9e42-f66cbe21e4ab None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:53.297645 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4553ea-bc3e-441b-83f0-7e68ee28eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:53.298949 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4553ea-bc3e-441b-83f0-7e68ee28eb8b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:53.299226 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4553ea-bc3e-441b-83f0-7e68ee28eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:53.299499 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4553ea-bc3e-441b-83f0-7e68ee28eb8b admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:53.300264 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4553ea-bc3e-441b-83f0-7e68ee28eb8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:53.302607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4553ea-bc3e-441b-83f0-7e68ee28eb8b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:53.321720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1396/2837] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:47:53 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:47:53.325751 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d7095-b5f2-4c81-8601-279a2ba676ad admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:53.336435 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d7095-b5f2-4c81-8601-279a2ba676ad admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:53.340962 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6dd77-989e-4254-b2e3-28204a5ecf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:53.341609 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6dd77-989e-4254-b2e3-28204a5ecf5c admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:53.341890 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6dd77-989e-4254-b2e3-28204a5ecf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:53.342167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6dd77-989e-4254-b2e3-28204a5ecf5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:53.342882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6dd77-989e-4254-b2e3-28204a5ecf5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:53.344516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6dd77-989e-4254-b2e3-28204a5ecf5c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:53.355503 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1442/2838] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:47:53.359500 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4553ea-bc3e-441b-83f0-7e68ee28eb8b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:53.369271 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4553ea-bc3e-441b-83f0-7e68ee28eb8b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:53.373816 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61460a-63f5-4fa4-a597-aee49c113341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:53.374680 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61460a-63f5-4fa4-a597-aee49c113341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:53.374963 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61460a-63f5-4fa4-a597-aee49c113341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:53.375239 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61460a-63f5-4fa4-a597-aee49c113341 admin admin] PATH_INFO: `/v3/projects/e3937f223c054a9dbd760007825e092b/users/2eb97886d8754848bb36a9136d7511c4/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:53.389453 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61460a-63f5-4fa4-a597-aee49c113341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3937f223c054a9dbd760007825e092b, user_id=2eb97886d8754848bb36a9136d7511c4, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:53.392914 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61460a-63f5-4fa4-a597-aee49c113341 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:53.405229 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1397/2839] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:47:53 2022] PUT /identity/v3/projects/e3937f223c054a9dbd760007825e092b/users/2eb97886d8754848bb36a9136d7511c4/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 20:47:53.409363 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6dd77-989e-4254-b2e3-28204a5ecf5c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:53.419586 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6dd77-989e-4254-b2e3-28204a5ecf5c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:53.480977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149369df-ffda-4680-9468-5320f7b2d299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:53.481657 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149369df-ffda-4680-9468-5320f7b2d299 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:53.481946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149369df-ffda-4680-9468-5320f7b2d299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:53.482224 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149369df-ffda-4680-9468-5320f7b2d299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:53.482944 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149369df-ffda-4680-9468-5320f7b2d299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:53.484586 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149369df-ffda-4680-9468-5320f7b2d299 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:53.495645 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1443/2840] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:47:53.500076 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61460a-63f5-4fa4-a597-aee49c113341 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:53.510978 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61460a-63f5-4fa4-a597-aee49c113341 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:53.515621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de3453-396a-4afd-a9b2-9b02ea14a0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:53.516545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de3453-396a-4afd-a9b2-9b02ea14a0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:53.517032 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de3453-396a-4afd-a9b2-9b02ea14a0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:53.517468 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de3453-396a-4afd-a9b2-9b02ea14a0f7 admin admin] PATH_INFO: `/v3/projects/e3937f223c054a9dbd760007825e092b/users/2eb97886d8754848bb36a9136d7511c4/roles/43e0afe364894278be44a97662ca6f8e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:53.519461 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de3453-396a-4afd-a9b2-9b02ea14a0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3937f223c054a9dbd760007825e092b, user_id=2eb97886d8754848bb36a9136d7511c4, role_id=43e0afe364894278be44a97662ca6f8e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:53.522298 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de3453-396a-4afd-a9b2-9b02ea14a0f7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:53.532545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1398/2841] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:47:53 2022] PUT /identity/v3/projects/e3937f223c054a9dbd760007825e092b/users/2eb97886d8754848bb36a9136d7511c4/roles/43e0afe364894278be44a97662ca6f8e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:53.593179 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23d32c-f781-492a-b438-8ce21a68a376 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:53.593475 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23d32c-f781-492a-b438-8ce21a68a376 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:53.593781 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23d32c-f781-492a-b438-8ce21a68a376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:53.620221 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2e23d32c-f781-492a-b438-8ce21a68a376 None None] MFA Rules not processed for user `2eb97886d8754848bb36a9136d7511c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:53.621454 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2e23d32c-f781-492a-b438-8ce21a68a376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:53.689844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1444/2842] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:53.701330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de3453-396a-4afd-a9b2-9b02ea14a0f7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:53.703038 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b2de3453-396a-4afd-a9b2-9b02ea14a0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:53.759860 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de3453-396a-4afd-a9b2-9b02ea14a0f7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:53.763559 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1a6bf-6320-4714-8e34-2a1dbc2b6bd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:53.764200 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1a6bf-6320-4714-8e34-2a1dbc2b6bd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:53.764517 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1a6bf-6320-4714-8e34-2a1dbc2b6bd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:53.764800 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1a6bf-6320-4714-8e34-2a1dbc2b6bd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:53.772071 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:53.774811 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1a6bf-6320-4714-8e34-2a1dbc2b6bd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:53.777244 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1a6bf-6320-4714-8e34-2a1dbc2b6bd0 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:53.788074 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1399/2843] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:53.856872 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23d32c-f781-492a-b438-8ce21a68a376 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:53.867267 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23d32c-f781-492a-b438-8ce21a68a376 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:53.870844 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a17f2-0094-430d-b6ff-1a7658525752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:53.871481 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a17f2-0094-430d-b6ff-1a7658525752 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:53.871767 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a17f2-0094-430d-b6ff-1a7658525752 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:53.872047 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a17f2-0094-430d-b6ff-1a7658525752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:53.928745 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:53.931399 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a17f2-0094-430d-b6ff-1a7658525752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:53.933187 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a17f2-0094-430d-b6ff-1a7658525752 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:53.943979 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1445/2844] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:54.197987 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1a6bf-6320-4714-8e34-2a1dbc2b6bd0 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:54.257950 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1a6bf-6320-4714-8e34-2a1dbc2b6bd0 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:54.262628 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc7311-8389-49cb-8441-3d87523d6a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:54.263457 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc7311-8389-49cb-8441-3d87523d6a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:54.263740 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc7311-8389-49cb-8441-3d87523d6a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:54.264013 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc7311-8389-49cb-8441-3d87523d6a1b admin admin] PATH_INFO: `/v3/users/ab5cc104f49042278de1bf72b473021e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:54.265218 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc7311-8389-49cb-8441-3d87523d6a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5cc104f49042278de1bf72b473021e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:54.267213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc7311-8389-49cb-8441-3d87523d6a1b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:54.315720 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6fc7311-8389-49cb-8441-3d87523d6a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5cc104f49042278de1bf72b473021e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:54.327459 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6fc7311-8389-49cb-8441-3d87523d6a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5cc104f49042278de1bf72b473021e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:54.328135 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6fc7311-8389-49cb-8441-3d87523d6a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5cc104f49042278de1bf72b473021e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:54.335859 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6fc7311-8389-49cb-8441-3d87523d6a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5cc104f49042278de1bf72b473021e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:54.336523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6fc7311-8389-49cb-8441-3d87523d6a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5cc104f49042278de1bf72b473021e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:54.350233 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1400/2845] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:47:54 2022] DELETE /identity/v3/users/ab5cc104f49042278de1bf72b473021e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:54.354843 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104078b-6299-4d29-a08c-d1120ce0f8eb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:54.355158 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104078b-6299-4d29-a08c-d1120ce0f8eb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:54.355445 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104078b-6299-4d29-a08c-d1120ce0f8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:54.373314 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c104078b-6299-4d29-a08c-d1120ce0f8eb None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:54.374655 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c104078b-6299-4d29-a08c-d1120ce0f8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:54.435577 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1446/2846] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:47:54.450348 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc7311-8389-49cb-8441-3d87523d6a1b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:54.451898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d6fc7311-8389-49cb-8441-3d87523d6a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:54.511274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc7311-8389-49cb-8441-3d87523d6a1b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:54.515169 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300fbc-9c12-4e60-813d-76ccbca82658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:54.515752 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300fbc-9c12-4e60-813d-76ccbca82658 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:54.516039 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300fbc-9c12-4e60-813d-76ccbca82658 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:54.516318 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300fbc-9c12-4e60-813d-76ccbca82658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:54.527313 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04300fbc-9c12-4e60-813d-76ccbca82658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:54.528837 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04300fbc-9c12-4e60-813d-76ccbca82658 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:54.538519 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1401/2847] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:54.823045 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104078b-6299-4d29-a08c-d1120ce0f8eb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:54.824508 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c104078b-6299-4d29-a08c-d1120ce0f8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:54.838652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104078b-6299-4d29-a08c-d1120ce0f8eb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:54.843853 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:54.844825 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:54.845022 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:54.845301 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] PATH_INFO: `/v3/projects/f5cdfe1f9eb047868b65941aeec78da8` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:54.846913 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5cdfe1f9eb047868b65941aeec78da8)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:54.848705 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:54.895381 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5cdfe1f9eb047868b65941aeec78da8', 'request_id': 'req-1d73b195-a1df-4714-9912-7acb04f106bf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:54.901884 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5cdfe1f9eb047868b65941aeec78da8', 'request_id': 'req-1d73b195-a1df-4714-9912-7acb04f106bf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:54.907706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5cdfe1f9eb047868b65941aeec78da8', 'request_id': 'req-1d73b195-a1df-4714-9912-7acb04f106bf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:54.919665 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] The token cache is being invalidate because project f5cdfe1f9eb047868b65941aeec78da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:47:54.919937 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:54.920582 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:54.922107 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1447/2848] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:47:54 2022] DELETE /identity/v3/projects/f5cdfe1f9eb047868b65941aeec78da8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:54.926872 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300fbc-9c12-4e60-813d-76ccbca82658 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:54.936337 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300fbc-9c12-4e60-813d-76ccbca82658 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:54.948939 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:54.994350 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf716d18-8587-4e21-8771-b16096d5c593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:54.995211 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf716d18-8587-4e21-8771-b16096d5c593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:54.995494 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf716d18-8587-4e21-8771-b16096d5c593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:54.995770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf716d18-8587-4e21-8771-b16096d5c593 admin admin] PATH_INFO: `/v3/users/2eb97886d8754848bb36a9136d7511c4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:54.996975 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf716d18-8587-4e21-8771-b16096d5c593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb97886d8754848bb36a9136d7511c4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:54.998898 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf716d18-8587-4e21-8771-b16096d5c593 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:55.045621 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf716d18-8587-4e21-8771-b16096d5c593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb97886d8754848bb36a9136d7511c4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:55.058567 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf716d18-8587-4e21-8771-b16096d5c593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb97886d8754848bb36a9136d7511c4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:55.059331 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf716d18-8587-4e21-8771-b16096d5c593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb97886d8754848bb36a9136d7511c4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:55.066441 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf716d18-8587-4e21-8771-b16096d5c593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb97886d8754848bb36a9136d7511c4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:55.067082 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf716d18-8587-4e21-8771-b16096d5c593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb97886d8754848bb36a9136d7511c4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:55.079955 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1402/2849] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:47:54 2022] DELETE /identity/v3/users/2eb97886d8754848bb36a9136d7511c4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:55.347721 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:55.349340 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:55.363205 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73b195-a1df-4714-9912-7acb04f106bf admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:55.420346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfea425-ca54-4e48-97f6-cbb16244e334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:55.421223 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfea425-ca54-4e48-97f6-cbb16244e334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:55.421510 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfea425-ca54-4e48-97f6-cbb16244e334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:55.421789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfea425-ca54-4e48-97f6-cbb16244e334 admin admin] PATH_INFO: `/v3/projects/e3937f223c054a9dbd760007825e092b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:55.422967 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfea425-ca54-4e48-97f6-cbb16244e334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3937f223c054a9dbd760007825e092b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:55.425757 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfea425-ca54-4e48-97f6-cbb16244e334 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:55.448035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:55.473092 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1dfea425-ca54-4e48-97f6-cbb16244e334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3937f223c054a9dbd760007825e092b', 'request_id': 'req-1dfea425-ca54-4e48-97f6-cbb16244e334'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:55.479978 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1dfea425-ca54-4e48-97f6-cbb16244e334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3937f223c054a9dbd760007825e092b', 'request_id': 'req-1dfea425-ca54-4e48-97f6-cbb16244e334'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:55.486024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1dfea425-ca54-4e48-97f6-cbb16244e334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3937f223c054a9dbd760007825e092b', 'request_id': 'req-1dfea425-ca54-4e48-97f6-cbb16244e334'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:55.498934 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1dfea425-ca54-4e48-97f6-cbb16244e334 admin admin] The token cache is being invalidate because project e3937f223c054a9dbd760007825e092b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:47:55.499244 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1dfea425-ca54-4e48-97f6-cbb16244e334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:55.499863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1dfea425-ca54-4e48-97f6-cbb16244e334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:55.501437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1448/2850] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:47:55 2022] DELETE /identity/v3/projects/e3937f223c054a9dbd760007825e092b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:55.506691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a3f07-4d4d-4d75-8f00-2fe20affaa5d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:55.506989 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a3f07-4d4d-4d75-8f00-2fe20affaa5d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:55.507274 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a3f07-4d4d-4d75-8f00-2fe20affaa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:55.525649 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-147a3f07-4d4d-4d75-8f00-2fe20affaa5d None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:55.526887 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-147a3f07-4d4d-4d75-8f00-2fe20affaa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:55.591589 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1403/2851] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:55.600460 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479e4f2-fc53-40a1-a185-f66e8f32c849 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:55.600759 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479e4f2-fc53-40a1-a185-f66e8f32c849 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:55.601038 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479e4f2-fc53-40a1-a185-f66e8f32c849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:55.619047 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0479e4f2-fc53-40a1-a185-f66e8f32c849 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:55.620249 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0479e4f2-fc53-40a1-a185-f66e8f32c849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:55.628128 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1449/2852] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:55.632377 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a3f07-4d4d-4d75-8f00-2fe20affaa5d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:55.641882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a3f07-4d4d-4d75-8f00-2fe20affaa5d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:55.647302 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee4e48-f6fd-48bf-a6e7-b82a37887ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:55.647943 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee4e48-f6fd-48bf-a6e7-b82a37887ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:55.648225 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee4e48-f6fd-48bf-a6e7-b82a37887ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:55.648534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee4e48-f6fd-48bf-a6e7-b82a37887ba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:55.649252 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee4e48-f6fd-48bf-a6e7-b82a37887ba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:47:55.649555 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee4e48-f6fd-48bf-a6e7-b82a37887ba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:55.651140 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee4e48-f6fd-48bf-a6e7-b82a37887ba0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:55.663119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1404/2853] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:47:55.667276 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479e4f2-fc53-40a1-a185-f66e8f32c849 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:55.676946 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479e4f2-fc53-40a1-a185-f66e8f32c849 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:55.681710 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1910fd-363f-4135-af8b-0d74f6b1ac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:55.682351 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1910fd-363f-4135-af8b-0d74f6b1ac9a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:55.682640 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1910fd-363f-4135-af8b-0d74f6b1ac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:55.682919 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1910fd-363f-4135-af8b-0d74f6b1ac9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:55.683617 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1910fd-363f-4135-af8b-0d74f6b1ac9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:55.685602 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1910fd-363f-4135-af8b-0d74f6b1ac9a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:55.710973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1450/2854] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:47:55 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:47:55.714983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee4e48-f6fd-48bf-a6e7-b82a37887ba0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:55.725569 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee4e48-f6fd-48bf-a6e7-b82a37887ba0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:55.745524 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:55.782927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e9190-c5ca-473f-983a-2e4d604e357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:55.784303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e9190-c5ca-473f-983a-2e4d604e357c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:55.784838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e9190-c5ca-473f-983a-2e4d604e357c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:55.785236 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e9190-c5ca-473f-983a-2e4d604e357c admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:55.785938 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e9190-c5ca-473f-983a-2e4d604e357c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:55.787861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e9190-c5ca-473f-983a-2e4d604e357c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:55.807322 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1405/2855] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:47:55 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:47:55.811712 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1910fd-363f-4135-af8b-0d74f6b1ac9a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:55.822271 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1910fd-363f-4135-af8b-0d74f6b1ac9a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:55.826854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9583200-ea45-4b13-a7ef-6e348bac895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:55.827516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9583200-ea45-4b13-a7ef-6e348bac895f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:55.827801 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9583200-ea45-4b13-a7ef-6e348bac895f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:55.828081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9583200-ea45-4b13-a7ef-6e348bac895f admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:55.828838 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9583200-ea45-4b13-a7ef-6e348bac895f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:55.831051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9583200-ea45-4b13-a7ef-6e348bac895f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:55.841510 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1451/2856] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:47:55.845554 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e9190-c5ca-473f-983a-2e4d604e357c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:55.855978 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e9190-c5ca-473f-983a-2e4d604e357c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:55.860580 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ae254-0e6a-455c-a7e2-2258db333623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:55.861260 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ae254-0e6a-455c-a7e2-2258db333623 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:55.861544 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ae254-0e6a-455c-a7e2-2258db333623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:55.861953 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ae254-0e6a-455c-a7e2-2258db333623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:55.862676 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ae254-0e6a-455c-a7e2-2258db333623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:55.864265 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ae254-0e6a-455c-a7e2-2258db333623 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:55.873954 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1406/2857] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:47:55.877793 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9583200-ea45-4b13-a7ef-6e348bac895f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:55.887513 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9583200-ea45-4b13-a7ef-6e348bac895f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:55.892101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eac0a-1ad7-4e1c-ae5d-7d3d53b10434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:55.893578 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eac0a-1ad7-4e1c-ae5d-7d3d53b10434 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:55.894083 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eac0a-1ad7-4e1c-ae5d-7d3d53b10434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:55.894370 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eac0a-1ad7-4e1c-ae5d-7d3d53b10434 admin admin] PATH_INFO: `/v3/projects/1eff37ec05104b1abc406b640663c6b8/users/b628fad89dfb466fbf046743881cc1a7/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:55.909852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591eac0a-1ad7-4e1c-ae5d-7d3d53b10434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eff37ec05104b1abc406b640663c6b8, user_id=b628fad89dfb466fbf046743881cc1a7, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:55.912682 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591eac0a-1ad7-4e1c-ae5d-7d3d53b10434 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:55.931306 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1452/2858] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:47:55 2022] PUT /identity/v3/projects/1eff37ec05104b1abc406b640663c6b8/users/b628fad89dfb466fbf046743881cc1a7/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:55.943009 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c261e7-dfed-4bed-bb52-4154f5f70181 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:55.943490 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c261e7-dfed-4bed-bb52-4154f5f70181 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:55.943603 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c261e7-dfed-4bed-bb52-4154f5f70181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:55.969351 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-58c261e7-dfed-4bed-bb52-4154f5f70181 None None] MFA Rules not processed for user `b628fad89dfb466fbf046743881cc1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:55.970548 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-58c261e7-dfed-4bed-bb52-4154f5f70181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:56.034667 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1407/2859] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:56.047233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eac0a-1ad7-4e1c-ae5d-7d3d53b10434 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:56.048973 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-591eac0a-1ad7-4e1c-ae5d-7d3d53b10434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:56.108090 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eac0a-1ad7-4e1c-ae5d-7d3d53b10434 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:56.111639 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f644-1a71-46a7-99ea-9d1e84cf6110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:56.112555 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f644-1a71-46a7-99ea-9d1e84cf6110 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:56.112842 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f644-1a71-46a7-99ea-9d1e84cf6110 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:56.113116 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f644-1a71-46a7-99ea-9d1e84cf6110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:56.121789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f644-1a71-46a7-99ea-9d1e84cf6110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:56.123253 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f644-1a71-46a7-99ea-9d1e84cf6110 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:56.133283 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1453/2860] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:56.154278 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c261e7-dfed-4bed-bb52-4154f5f70181 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:56.216598 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c261e7-dfed-4bed-bb52-4154f5f70181 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:56.221935 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65d535-2003-4056-8d7f-3cff4cb6f28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:56.222861 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d535-2003-4056-8d7f-3cff4cb6f28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:56.223146 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d535-2003-4056-8d7f-3cff4cb6f28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:56.223451 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d535-2003-4056-8d7f-3cff4cb6f28e admin admin] PATH_INFO: `/v3/users/b628fad89dfb466fbf046743881cc1a7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:56.224699 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65d535-2003-4056-8d7f-3cff4cb6f28e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b628fad89dfb466fbf046743881cc1a7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:56.226639 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65d535-2003-4056-8d7f-3cff4cb6f28e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:56.263556 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:56.275044 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3d65d535-2003-4056-8d7f-3cff4cb6f28e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b628fad89dfb466fbf046743881cc1a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:56.287835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3d65d535-2003-4056-8d7f-3cff4cb6f28e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b628fad89dfb466fbf046743881cc1a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:56.288562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3d65d535-2003-4056-8d7f-3cff4cb6f28e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b628fad89dfb466fbf046743881cc1a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:56.295576 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3d65d535-2003-4056-8d7f-3cff4cb6f28e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b628fad89dfb466fbf046743881cc1a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:56.296222 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3d65d535-2003-4056-8d7f-3cff4cb6f28e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b628fad89dfb466fbf046743881cc1a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:56.310512 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1408/2861] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:47:56 2022] DELETE /identity/v3/users/b628fad89dfb466fbf046743881cc1a7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:56.315089 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067260aa-6d98-4eb4-aace-848d33c92163 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:56.315361 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067260aa-6d98-4eb4-aace-848d33c92163 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:56.315644 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067260aa-6d98-4eb4-aace-848d33c92163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:56.333523 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-067260aa-6d98-4eb4-aace-848d33c92163 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:56.334727 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-067260aa-6d98-4eb4-aace-848d33c92163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:56.377680 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:56.394120 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1454/2862] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:56.403777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65d535-2003-4056-8d7f-3cff4cb6f28e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:56.405227 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3d65d535-2003-4056-8d7f-3cff4cb6f28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:56.466287 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65d535-2003-4056-8d7f-3cff4cb6f28e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:56.470123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258027e0-1bac-4dc2-8082-82445c9262f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:56.470777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258027e0-1bac-4dc2-8082-82445c9262f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:56.471063 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258027e0-1bac-4dc2-8082-82445c9262f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:56.471362 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258027e0-1bac-4dc2-8082-82445c9262f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:56.481429 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258027e0-1bac-4dc2-8082-82445c9262f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:56.482871 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258027e0-1bac-4dc2-8082-82445c9262f9 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:56.492552 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1409/2863] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:47:56.773153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067260aa-6d98-4eb4-aace-848d33c92163 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:56.774642 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-067260aa-6d98-4eb4-aace-848d33c92163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:56.789696 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067260aa-6d98-4eb4-aace-848d33c92163 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:56.794628 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c23f5-305c-4633-826c-14191937b60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:56.795488 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c23f5-305c-4633-826c-14191937b60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:56.795787 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c23f5-305c-4633-826c-14191937b60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:56.796025 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c23f5-305c-4633-826c-14191937b60a admin admin] PATH_INFO: `/v3/projects/1eff37ec05104b1abc406b640663c6b8` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:56.797232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c23f5-305c-4633-826c-14191937b60a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eff37ec05104b1abc406b640663c6b8)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:56.799322 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c23f5-305c-4633-826c-14191937b60a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:56.845771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-425c23f5-305c-4633-826c-14191937b60a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eff37ec05104b1abc406b640663c6b8', 'request_id': 'req-425c23f5-305c-4633-826c-14191937b60a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:56.852080 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-425c23f5-305c-4633-826c-14191937b60a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eff37ec05104b1abc406b640663c6b8', 'request_id': 'req-425c23f5-305c-4633-826c-14191937b60a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:56.857476 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-425c23f5-305c-4633-826c-14191937b60a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eff37ec05104b1abc406b640663c6b8', 'request_id': 'req-425c23f5-305c-4633-826c-14191937b60a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:56.871098 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-425c23f5-305c-4633-826c-14191937b60a admin admin] The token cache is being invalidate because project 1eff37ec05104b1abc406b640663c6b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:47:56.871388 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-425c23f5-305c-4633-826c-14191937b60a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:56.872035 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-425c23f5-305c-4633-826c-14191937b60a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:47:56.873619 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1455/2864] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:47:56 2022] DELETE /identity/v3/projects/1eff37ec05104b1abc406b640663c6b8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:56.880913 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a50ed-40b2-4b6d-91c9-c2485e039094 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:56.881204 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a50ed-40b2-4b6d-91c9-c2485e039094 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:56.881481 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a50ed-40b2-4b6d-91c9-c2485e039094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:56.900951 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-853a50ed-40b2-4b6d-91c9-c2485e039094 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:56.902168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-853a50ed-40b2-4b6d-91c9-c2485e039094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:56.962709 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1410/2865] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:56.970437 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f259fc1-e919-4cad-bd8c-9c09e3e7af41 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:56.970735 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f259fc1-e919-4cad-bd8c-9c09e3e7af41 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:56.971017 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f259fc1-e919-4cad-bd8c-9c09e3e7af41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:56.991155 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7f259fc1-e919-4cad-bd8c-9c09e3e7af41 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:56.992359 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7f259fc1-e919-4cad-bd8c-9c09e3e7af41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:57.000247 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1456/2866] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:57.005056 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a50ed-40b2-4b6d-91c9-c2485e039094 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:57.014630 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a50ed-40b2-4b6d-91c9-c2485e039094 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:57.019639 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09b2bb-cb32-4437-86df-b34121a4b8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:57.020278 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09b2bb-cb32-4437-86df-b34121a4b8ca admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:57.020588 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09b2bb-cb32-4437-86df-b34121a4b8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:57.020867 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09b2bb-cb32-4437-86df-b34121a4b8ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:57.021579 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09b2bb-cb32-4437-86df-b34121a4b8ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:47:57.021882 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09b2bb-cb32-4437-86df-b34121a4b8ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:57.023466 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09b2bb-cb32-4437-86df-b34121a4b8ca admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:57.035188 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1411/2867] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:47:57.039360 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f259fc1-e919-4cad-bd8c-9c09e3e7af41 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:57.048936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f259fc1-e919-4cad-bd8c-9c09e3e7af41 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:57.053690 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52219c3b-c6de-43d9-87e0-bb319d858fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:57.054341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52219c3b-c6de-43d9-87e0-bb319d858fbf admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:57.054627 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52219c3b-c6de-43d9-87e0-bb319d858fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:57.054907 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52219c3b-c6de-43d9-87e0-bb319d858fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:57.055627 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52219c3b-c6de-43d9-87e0-bb319d858fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:57.057564 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52219c3b-c6de-43d9-87e0-bb319d858fbf admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:57.083705 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1457/2868] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:47:57 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:47:57.087745 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09b2bb-cb32-4437-86df-b34121a4b8ca admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:57.098835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09b2bb-cb32-4437-86df-b34121a4b8ca admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:57.137790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:57.156355 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8a3bc-acb2-4538-85c8-ddc71f7279c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:57.156990 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8a3bc-acb2-4538-85c8-ddc71f7279c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:57.157277 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8a3bc-acb2-4538-85c8-ddc71f7279c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:57.157553 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8a3bc-acb2-4538-85c8-ddc71f7279c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:57.158249 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8a3bc-acb2-4538-85c8-ddc71f7279c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:57.160762 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8a3bc-acb2-4538-85c8-ddc71f7279c2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:57.180103 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1412/2869] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:47:57 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:47:57.184217 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52219c3b-c6de-43d9-87e0-bb319d858fbf admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:57.194749 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52219c3b-c6de-43d9-87e0-bb319d858fbf admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:57.199442 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5280b-bf08-468d-bc8c-0df8c0ea8e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:57.200115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5280b-bf08-468d-bc8c-0df8c0ea8e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:57.200383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5280b-bf08-468d-bc8c-0df8c0ea8e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:57.200706 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5280b-bf08-468d-bc8c-0df8c0ea8e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:57.201432 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5280b-bf08-468d-bc8c-0df8c0ea8e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:57.203020 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5280b-bf08-468d-bc8c-0df8c0ea8e54 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:57.214484 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1458/2870] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:47:57.218405 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8a3bc-acb2-4538-85c8-ddc71f7279c2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:57.229228 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8a3bc-acb2-4538-85c8-ddc71f7279c2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:57.233906 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6032c-8fd7-40bf-9000-5a7726a805e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:57.234562 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6032c-8fd7-40bf-9000-5a7726a805e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:57.234850 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6032c-8fd7-40bf-9000-5a7726a805e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:57.235133 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6032c-8fd7-40bf-9000-5a7726a805e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:57.235854 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6032c-8fd7-40bf-9000-5a7726a805e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:57.239690 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6032c-8fd7-40bf-9000-5a7726a805e0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:57.253370 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1413/2871] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:47:57.257538 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5280b-bf08-468d-bc8c-0df8c0ea8e54 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:57.267464 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5280b-bf08-468d-bc8c-0df8c0ea8e54 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:57.272863 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a0431-a3fe-4c02-88d1-a4a8db6e9e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:57.273729 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a0431-a3fe-4c02-88d1-a4a8db6e9e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:57.274011 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a0431-a3fe-4c02-88d1-a4a8db6e9e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:57.274285 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a0431-a3fe-4c02-88d1-a4a8db6e9e98 admin admin] PATH_INFO: `/v3/projects/127e837b3805422884ef6d166cb70cb0/users/296fd952ef9d481eb01533247f4b04a1/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:57.289175 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a0431-a3fe-4c02-88d1-a4a8db6e9e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127e837b3805422884ef6d166cb70cb0, user_id=296fd952ef9d481eb01533247f4b04a1, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:57.291831 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a0431-a3fe-4c02-88d1-a4a8db6e9e98 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:57.306389 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1459/2872] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:47:57 2022] PUT /identity/v3/projects/127e837b3805422884ef6d166cb70cb0/users/296fd952ef9d481eb01533247f4b04a1/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:47:57.317043 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ad9e-7456-4283-b38b-200e49c71200 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:57.317345 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ad9e-7456-4283-b38b-200e49c71200 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:57.317632 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ad9e-7456-4283-b38b-200e49c71200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:57.343823 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cf02ad9e-7456-4283-b38b-200e49c71200 None None] MFA Rules not processed for user `296fd952ef9d481eb01533247f4b04a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:47:57.345057 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cf02ad9e-7456-4283-b38b-200e49c71200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:57.408464 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1414/2873] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:47:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:47:57.420628 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a0431-a3fe-4c02-88d1-a4a8db6e9e98 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:47:57.422298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cc6a0431-a3fe-4c02-88d1-a4a8db6e9e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:47:57.480597 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a0431-a3fe-4c02-88d1-a4a8db6e9e98 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:47:57.484282 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf98304-6c40-4d30-b6b3-4f127e18ded9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93958c7dad0540b296b316169932d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:47:57.484959 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf98304-6c40-4d30-b6b3-4f127e18ded9 service glance] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:47:57.485248 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf98304-6c40-4d30-b6b3-4f127e18ded9 service glance] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:47:57.485533 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf98304-6c40-4d30-b6b3-4f127e18ded9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:47:57.494170 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf98304-6c40-4d30-b6b3-4f127e18ded9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:47:57.495590 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf98304-6c40-4d30-b6b3-4f127e18ded9 service glance] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:47:57.505189 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1460/2874] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:47:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:48:07.405835 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:07.500672 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:24.107679 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02ad9e-7456-4283-b38b-200e49c71200 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:24.176119 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02ad9e-7456-4283-b38b-200e49c71200 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:24.180774 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc93f69-cd44-4608-bd3f-b08c9c0ce509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:24.182817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc93f69-cd44-4608-bd3f-b08c9c0ce509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:24.183107 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc93f69-cd44-4608-bd3f-b08c9c0ce509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:24.183389 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc93f69-cd44-4608-bd3f-b08c9c0ce509 admin admin] PATH_INFO: `/v3/users/296fd952ef9d481eb01533247f4b04a1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:24.184616 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc93f69-cd44-4608-bd3f-b08c9c0ce509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=296fd952ef9d481eb01533247f4b04a1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:24.186545 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc93f69-cd44-4608-bd3f-b08c9c0ce509 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:24.232560 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9dc93f69-cd44-4608-bd3f-b08c9c0ce509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '296fd952ef9d481eb01533247f4b04a1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:24.245575 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9dc93f69-cd44-4608-bd3f-b08c9c0ce509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '296fd952ef9d481eb01533247f4b04a1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:24.246266 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9dc93f69-cd44-4608-bd3f-b08c9c0ce509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '296fd952ef9d481eb01533247f4b04a1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:24.253125 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9dc93f69-cd44-4608-bd3f-b08c9c0ce509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '296fd952ef9d481eb01533247f4b04a1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:24.253757 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9dc93f69-cd44-4608-bd3f-b08c9c0ce509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '296fd952ef9d481eb01533247f4b04a1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:24.265770 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1415/2875] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:48:24 2022] DELETE /identity/v3/users/296fd952ef9d481eb01533247f4b04a1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:48:24.270382 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688807-a23a-45ad-b803-ac0d0c1164cb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:24.270855 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688807-a23a-45ad-b803-ac0d0c1164cb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:24.270977 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688807-a23a-45ad-b803-ac0d0c1164cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:24.288152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b3688807-a23a-45ad-b803-ac0d0c1164cb None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:24.289383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b3688807-a23a-45ad-b803-ac0d0c1164cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:24.348056 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1461/2876] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:48:24.358483 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc93f69-cd44-4608-bd3f-b08c9c0ce509 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:24.359870 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9dc93f69-cd44-4608-bd3f-b08c9c0ce509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:24.417510 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc93f69-cd44-4608-bd3f-b08c9c0ce509 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:24.421533 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7e57d-449e-4496-84e2-7269b479be1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:24.422248 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7e57d-449e-4496-84e2-7269b479be1a service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:24.422534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7e57d-449e-4496-84e2-7269b479be1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:24.422810 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7e57d-449e-4496-84e2-7269b479be1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:24.432326 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7e57d-449e-4496-84e2-7269b479be1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:24.433790 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7e57d-449e-4496-84e2-7269b479be1a service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:24.443307 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1416/2877] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:48:24.713337 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3688807-a23a-45ad-b803-ac0d0c1164cb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:24.714854 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b3688807-a23a-45ad-b803-ac0d0c1164cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:24.726876 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3688807-a23a-45ad-b803-ac0d0c1164cb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:24.731808 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:24.732715 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:24.732983 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:24.733278 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7 admin admin] PATH_INFO: `/v3/projects/127e837b3805422884ef6d166cb70cb0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:24.734475 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127e837b3805422884ef6d166cb70cb0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:24.736369 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:24.785373 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127e837b3805422884ef6d166cb70cb0', 'request_id': 'req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:24.792115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127e837b3805422884ef6d166cb70cb0', 'request_id': 'req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:24.798172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127e837b3805422884ef6d166cb70cb0', 'request_id': 'req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:24.810262 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7 admin admin] The token cache is being invalidate because project 127e837b3805422884ef6d166cb70cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:48:24.810552 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:24.811182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b6a991b0-86c3-4f5d-a5d0-1d7d5c9be5f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:24.813033 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1462/2878] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:48:24 2022] DELETE /identity/v3/projects/127e837b3805422884ef6d166cb70cb0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:48:24.817998 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40795019-19c1-4992-a905-a2f1dd0c8646 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:24.818290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40795019-19c1-4992-a905-a2f1dd0c8646 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:24.818571 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40795019-19c1-4992-a905-a2f1dd0c8646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:24.836189 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-40795019-19c1-4992-a905-a2f1dd0c8646 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:24.837921 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-40795019-19c1-4992-a905-a2f1dd0c8646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:24.855187 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:24.897464 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1417/2879] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:48:24.906599 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfccce-c2ad-4f22-b5e4-85c061f13258 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:24.906896 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfccce-c2ad-4f22-b5e4-85c061f13258 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:24.907182 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfccce-c2ad-4f22-b5e4-85c061f13258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:24.927070 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-83bfccce-c2ad-4f22-b5e4-85c061f13258 None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:24.928280 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-83bfccce-c2ad-4f22-b5e4-85c061f13258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:24.936803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1463/2880] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:48:24.940905 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40795019-19c1-4992-a905-a2f1dd0c8646 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:24.950607 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40795019-19c1-4992-a905-a2f1dd0c8646 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:24.955241 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acda72d-e7d8-4285-adfc-827824c52dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:24.955896 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acda72d-e7d8-4285-adfc-827824c52dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:24.956182 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acda72d-e7d8-4285-adfc-827824c52dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:24.956484 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acda72d-e7d8-4285-adfc-827824c52dfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:24.957213 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acda72d-e7d8-4285-adfc-827824c52dfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 20:48:24.957523 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acda72d-e7d8-4285-adfc-827824c52dfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:24.959168 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acda72d-e7d8-4285-adfc-827824c52dfd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:24.971242 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1418/2881] 10.222.0.66 () {58 vars in 1152 bytes} [Fri Jul 15 20:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 20:48:24.975502 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfccce-c2ad-4f22-b5e4-85c061f13258 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:24.985358 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfccce-c2ad-4f22-b5e4-85c061f13258 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:24.990001 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea10b0-e5af-4445-8327-085dc86b0e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:24.990663 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea10b0-e5af-4445-8327-085dc86b0e34 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:24.990936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea10b0-e5af-4445-8327-085dc86b0e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:24.991215 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea10b0-e5af-4445-8327-085dc86b0e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:24.991911 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea10b0-e5af-4445-8327-085dc86b0e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:24.993936 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea10b0-e5af-4445-8327-085dc86b0e34 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:25.019152 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1464/2882] 10.222.0.66 () {60 vars in 1152 bytes} [Fri Jul 15 20:48:24 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 20:48:25.023230 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acda72d-e7d8-4285-adfc-827824c52dfd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:25.033825 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acda72d-e7d8-4285-adfc-827824c52dfd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:25.090367 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9e133-1342-40ca-aee7-ccbbf7016026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:25.091041 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9e133-1342-40ca-aee7-ccbbf7016026 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:25.091323 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9e133-1342-40ca-aee7-ccbbf7016026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:25.091604 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9e133-1342-40ca-aee7-ccbbf7016026 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:25.092301 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9e133-1342-40ca-aee7-ccbbf7016026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:25.094252 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9e133-1342-40ca-aee7-ccbbf7016026 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:25.113534 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1419/2883] 10.222.0.66 () {60 vars in 1143 bytes} [Fri Jul 15 20:48:25 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 20:48:25.117570 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea10b0-e5af-4445-8327-085dc86b0e34 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:25.127904 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea10b0-e5af-4445-8327-085dc86b0e34 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:25.132468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932d97f-deec-454a-b1ab-7e7d6196bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:25.133123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932d97f-deec-454a-b1ab-7e7d6196bcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:25.133465 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932d97f-deec-454a-b1ab-7e7d6196bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:25.133747 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932d97f-deec-454a-b1ab-7e7d6196bcb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:25.135013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932d97f-deec-454a-b1ab-7e7d6196bcb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:25.136620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932d97f-deec-454a-b1ab-7e7d6196bcb3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:25.146803 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1465/2884] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 20:48:25.151383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9e133-1342-40ca-aee7-ccbbf7016026 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:25.161237 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9e133-1342-40ca-aee7-ccbbf7016026 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:25.165784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a69773-31ba-4792-940f-e09c763c8e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:25.166502 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a69773-31ba-4792-940f-e09c763c8e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:25.166784 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a69773-31ba-4792-940f-e09c763c8e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:25.167058 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a69773-31ba-4792-940f-e09c763c8e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:25.167777 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a69773-31ba-4792-940f-e09c763c8e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:25.169634 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a69773-31ba-4792-940f-e09c763c8e42 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:25.179170 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1420/2885] 10.222.0.66 () {58 vars in 1121 bytes} [Fri Jul 15 20:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 20:48:25.183236 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932d97f-deec-454a-b1ab-7e7d6196bcb3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:25.193165 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932d97f-deec-454a-b1ab-7e7d6196bcb3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:25.198702 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e87aba-cad9-428c-8fae-6c048adef7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:25.199576 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87aba-cad9-428c-8fae-6c048adef7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:25.199859 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87aba-cad9-428c-8fae-6c048adef7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:25.200134 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87aba-cad9-428c-8fae-6c048adef7d8 admin admin] PATH_INFO: `/v3/projects/ff6c2c8845a44e74bb8bcd1339a921eb/users/c22d4f9cfd574b4ab162541e4660c8b1/roles/83a7ac2bd20743b78fe0f4689037d83b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:25.215383 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e87aba-cad9-428c-8fae-6c048adef7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6c2c8845a44e74bb8bcd1339a921eb, user_id=c22d4f9cfd574b4ab162541e4660c8b1, role_id=83a7ac2bd20743b78fe0f4689037d83b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:25.218103 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e87aba-cad9-428c-8fae-6c048adef7d8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:25.230916 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1466/2886] 10.222.0.66 () {60 vars in 1482 bytes} [Fri Jul 15 20:48:25 2022] PUT /identity/v3/projects/ff6c2c8845a44e74bb8bcd1339a921eb/users/c22d4f9cfd574b4ab162541e4660c8b1/roles/83a7ac2bd20743b78fe0f4689037d83b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:48:25.241105 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e367-5fdf-4d32-878c-13e0b10fa98a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:25.241400 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e367-5fdf-4d32-878c-13e0b10fa98a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:25.241682 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e367-5fdf-4d32-878c-13e0b10fa98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:25.268785 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a326e367-5fdf-4d32-878c-13e0b10fa98a None None] MFA Rules not processed for user `c22d4f9cfd574b4ab162541e4660c8b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:25.269977 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a326e367-5fdf-4d32-878c-13e0b10fa98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:25.333558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1421/2887] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:48:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 20:48:25.344622 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e87aba-cad9-428c-8fae-6c048adef7d8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:25.346292 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e1e87aba-cad9-428c-8fae-6c048adef7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:25.367558 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:25.404882 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e87aba-cad9-428c-8fae-6c048adef7d8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:25.408468 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d40258-5de2-4b6e-8987-7610f0fb9df1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4739b31f6647d89132f79f3f811d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:25.409115 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d40258-5de2-4b6e-8987-7610f0fb9df1 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:25.409409 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d40258-5de2-4b6e-8987-7610f0fb9df1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:25.409692 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d40258-5de2-4b6e-8987-7610f0fb9df1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:25.418161 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d40258-5de2-4b6e-8987-7610f0fb9df1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:25.419895 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d40258-5de2-4b6e-8987-7610f0fb9df1 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:25.428752 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1467/2888] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:48:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:48:35.099733 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326e367-5fdf-4d32-878c-13e0b10fa98a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:35.119349 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:35.162994 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326e367-5fdf-4d32-878c-13e0b10fa98a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:35.167528 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd5e1b-a72f-4276-929f-5737f49947fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:35.168383 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd5e1b-a72f-4276-929f-5737f49947fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:35.168691 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd5e1b-a72f-4276-929f-5737f49947fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:35.168964 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd5e1b-a72f-4276-929f-5737f49947fe admin admin] PATH_INFO: `/v3/users/c22d4f9cfd574b4ab162541e4660c8b1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:35.173258 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd5e1b-a72f-4276-929f-5737f49947fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c22d4f9cfd574b4ab162541e4660c8b1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:35.173258 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd5e1b-a72f-4276-929f-5737f49947fe admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:35.223460 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f4dd5e1b-a72f-4276-929f-5737f49947fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c22d4f9cfd574b4ab162541e4660c8b1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:35.235426 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f4dd5e1b-a72f-4276-929f-5737f49947fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c22d4f9cfd574b4ab162541e4660c8b1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:35.236091 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f4dd5e1b-a72f-4276-929f-5737f49947fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c22d4f9cfd574b4ab162541e4660c8b1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:35.242983 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f4dd5e1b-a72f-4276-929f-5737f49947fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c22d4f9cfd574b4ab162541e4660c8b1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:35.244469 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f4dd5e1b-a72f-4276-929f-5737f49947fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c22d4f9cfd574b4ab162541e4660c8b1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:35.257053 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1422/2889] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:48:35 2022] DELETE /identity/v3/users/c22d4f9cfd574b4ab162541e4660c8b1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:48:35.262148 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738dd288-5552-4083-bca4-362e09670baa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:35.262676 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738dd288-5552-4083-bca4-362e09670baa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:35.262795 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738dd288-5552-4083-bca4-362e09670baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:35.280664 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-738dd288-5552-4083-bca4-362e09670baa None None] MFA Rules not processed for user `95a76fa60149455a8ad27ef586bc5044`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:48:35.281862 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-738dd288-5552-4083-bca4-362e09670baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:35.342620 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1468/2890] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:48:35.352217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd5e1b-a72f-4276-929f-5737f49947fe admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:35.353643 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f4dd5e1b-a72f-4276-929f-5737f49947fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:35.409909 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd5e1b-a72f-4276-929f-5737f49947fe admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:35.413542 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827b0b6-0f33-4a89-927d-692e5251cd62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:35.414176 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827b0b6-0f33-4a89-927d-692e5251cd62 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:35.414456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827b0b6-0f33-4a89-927d-692e5251cd62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:35.414732 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827b0b6-0f33-4a89-927d-692e5251cd62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:35.423817 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827b0b6-0f33-4a89-927d-692e5251cd62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:35.425267 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827b0b6-0f33-4a89-927d-692e5251cd62 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:35.435121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1423/2891] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:48:35.704789 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738dd288-5552-4083-bca4-362e09670baa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:48:35.706218 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-738dd288-5552-4083-bca4-362e09670baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:48:35.719462 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738dd288-5552-4083-bca4-362e09670baa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:48:35.724269 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:48:35.725199 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:48:35.725490 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:48:35.725771 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] PATH_INFO: `/v3/projects/ff6c2c8845a44e74bb8bcd1339a921eb` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:48:35.727013 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6c2c8845a44e74bb8bcd1339a921eb)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:48:35.729656 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:48:35.777659 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6c2c8845a44e74bb8bcd1339a921eb', 'request_id': 'req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:35.783825 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6c2c8845a44e74bb8bcd1339a921eb', 'request_id': 'req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:35.789268 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6c2c8845a44e74bb8bcd1339a921eb', 'request_id': 'req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:35.801117 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] The token cache is being invalidate because project ff6c2c8845a44e74bb8bcd1339a921eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:48:35.801400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:35.802007 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:48:35.803554 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1469/2892] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:48:35 2022] DELETE /identity/v3/projects/ff6c2c8845a44e74bb8bcd1339a921eb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:48:45.430330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:48:45.798167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:29.600305 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fceac-8103-46c5-b41d-6dd57d8e6a2c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:29.600875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fceac-8103-46c5-b41d-6dd57d8e6a2c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:29.600875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fceac-8103-46c5-b41d-6dd57d8e6a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:29.620357 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8e0fceac-8103-46c5-b41d-6dd57d8e6a2c None None] MFA Rules not processed for user `ce5f88b90c3b43439d4f3f9b3dc63fff`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 20:49:29.621602 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8e0fceac-8103-46c5-b41d-6dd57d8e6a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:29.675827 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1424/2893] 10.222.0.66 () {58 vars in 957 bytes} [Fri Jul 15 20:49:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 20:49:39.615172 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:49:39.616759 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:39.668149 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=25 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:39.690233 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eca95f-9eb2-4a29-872a-8e7b38bcacf7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:49:39.695660 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261496f-b625-49cb-8283-f3e87d27d948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:49:39.696321 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261496f-b625-49cb-8283-f3e87d27d948 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:39.696638 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261496f-b625-49cb-8283-f3e87d27d948 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:39.696917 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261496f-b625-49cb-8283-f3e87d27d948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:39.698674 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5261496f-b625-49cb-8283-f3e87d27d948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:39.709675 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261496f-b625-49cb-8283-f3e87d27d948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:49:39.711051 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261496f-b625-49cb-8283-f3e87d27d948 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:49:39.720572 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1470/2894] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:49:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:49:44.407897 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fceac-8103-46c5-b41d-6dd57d8e6a2c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:49:44.409772 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8e0fceac-8103-46c5-b41d-6dd57d8e6a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:44.431447 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fceac-8103-46c5-b41d-6dd57d8e6a2c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:49:44.437007 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355beca9-885e-4e00-9961-45a2cd1baf1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b042da9298894712a0a29787a343bf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:49:44.437726 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355beca9-885e-4e00-9961-45a2cd1baf1b service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:44.438093 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355beca9-885e-4e00-9961-45a2cd1baf1b service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:44.438438 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355beca9-885e-4e00-9961-45a2cd1baf1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:44.443573 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-355beca9-885e-4e00-9961-45a2cd1baf1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:44.458558 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355beca9-885e-4e00-9961-45a2cd1baf1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:49:44.460303 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355beca9-885e-4e00-9961-45a2cd1baf1b service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:49:44.473014 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1425/2895] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:49:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:49:49.715833 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=34 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:54.467781 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:58.402799 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261496f-b625-49cb-8283-f3e87d27d948 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:49:58.404319 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5261496f-b625-49cb-8283-f3e87d27d948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:58.473496 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261496f-b625-49cb-8283-f3e87d27d948 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:49:58.478580 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590f9fa-9c08-47f2-88bb-b5f0e8bc6606 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6693dd1ea26049c1ac8460faf1bc9b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:49:58.479227 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590f9fa-9c08-47f2-88bb-b5f0e8bc6606 service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:49:58.479516 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590f9fa-9c08-47f2-88bb-b5f0e8bc6606 service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:49:58.479797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590f9fa-9c08-47f2-88bb-b5f0e8bc6606 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:49:58.481557 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2590f9fa-9c08-47f2-88bb-b5f0e8bc6606 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:49:58.493023 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590f9fa-9c08-47f2-88bb-b5f0e8bc6606 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:49:58.494601 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590f9fa-9c08-47f2-88bb-b5f0e8bc6606 service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:49:58.504487 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1471/2896] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:49:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:50:08.500232 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=32 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:51:29.662306 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355beca9-885e-4e00-9961-45a2cd1baf1b service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:51:29.663722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-355beca9-885e-4e00-9961-45a2cd1baf1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:51:29.721703 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355beca9-885e-4e00-9961-45a2cd1baf1b service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:51:29.725224 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51d17f-9242-4d01-ba19-f5a9c16264c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633e05f021544b669749f941f40cbf58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:51:29.725895 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51d17f-9242-4d01-ba19-f5a9c16264c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:51:29.726177 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51d17f-9242-4d01-ba19-f5a9c16264c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:51:29.726456 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51d17f-9242-4d01-ba19-f5a9c16264c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:51:29.728217 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-db51d17f-9242-4d01-ba19-f5a9c16264c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:51:29.790417 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51d17f-9242-4d01-ba19-f5a9c16264c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:51:29.791875 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51d17f-9242-4d01-ba19-f5a9c16264c1 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:51:29.802670 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1426/2897] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:51:32.870534 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590f9fa-9c08-47f2-88bb-b5f0e8bc6606 service placement] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:51:32.883010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590f9fa-9c08-47f2-88bb-b5f0e8bc6606 service placement] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:51:32.889539 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac9416-e720-4b1c-b082-7e0e7f24fd4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6693dd1ea26049c1ac8460faf1bc9b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:51:32.890225 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac9416-e720-4b1c-b082-7e0e7f24fd4c service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:51:32.891010 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac9416-e720-4b1c-b082-7e0e7f24fd4c service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:51:32.891667 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac9416-e720-4b1c-b082-7e0e7f24fd4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:51:32.893603 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-62ac9416-e720-4b1c-b082-7e0e7f24fd4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:51:32.907746 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac9416-e720-4b1c-b082-7e0e7f24fd4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:51:32.909483 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac9416-e720-4b1c-b082-7e0e7f24fd4c service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:51:32.935298 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1472/2898] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:51:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:51:36.035373 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51d17f-9242-4d01-ba19-f5a9c16264c1 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:51:36.047754 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51d17f-9242-4d01-ba19-f5a9c16264c1 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:51:36.052722 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7ceb6-d54d-49d9-b2c8-2bfc22d33ca4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6693dd1ea26049c1ac8460faf1bc9b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:51:36.053364 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7ceb6-d54d-49d9-b2c8-2bfc22d33ca4 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:51:36.053678 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7ceb6-d54d-49d9-b2c8-2bfc22d33ca4 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:51:36.053960 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7ceb6-d54d-49d9-b2c8-2bfc22d33ca4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:51:36.055705 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d7c7ceb6-d54d-49d9-b2c8-2bfc22d33ca4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:51:36.068192 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7ceb6-d54d-49d9-b2c8-2bfc22d33ca4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:51:36.069838 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7ceb6-d54d-49d9-b2c8-2bfc22d33ca4 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:51:36.085138 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1427/2899] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:51:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:51:36.096765 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac9416-e720-4b1c-b082-7e0e7f24fd4c service placement] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:51:36.098783 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-62ac9416-e720-4b1c-b082-7e0e7f24fd4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:51:36.117868 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac9416-e720-4b1c-b082-7e0e7f24fd4c service placement] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:51:36.123091 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557d91f-d127-4516-8752-e2e0721bb88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:51:36.124066 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d91f-d127-4516-8752-e2e0721bb88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:51:36.124339 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d91f-d127-4516-8752-e2e0721bb88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:51:36.124652 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d91f-d127-4516-8752-e2e0721bb88e admin admin] PATH_INFO: `/v3/users/ce5f88b90c3b43439d4f3f9b3dc63fff` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:51:36.125859 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557d91f-d127-4516-8752-e2e0721bb88e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5f88b90c3b43439d4f3f9b3dc63fff)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:51:36.127779 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557d91f-d127-4516-8752-e2e0721bb88e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:51:36.175400 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2557d91f-d127-4516-8752-e2e0721bb88e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5f88b90c3b43439d4f3f9b3dc63fff'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.183343 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2557d91f-d127-4516-8752-e2e0721bb88e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5f88b90c3b43439d4f3f9b3dc63fff'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.190309 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2557d91f-d127-4516-8752-e2e0721bb88e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5f88b90c3b43439d4f3f9b3dc63fff'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.190942 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2557d91f-d127-4516-8752-e2e0721bb88e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5f88b90c3b43439d4f3f9b3dc63fff'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.202852 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2557d91f-d127-4516-8752-e2e0721bb88e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5f88b90c3b43439d4f3f9b3dc63fff'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.208734 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1473/2900] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:51:36 2022] DELETE /identity/v3/users/ce5f88b90c3b43439d4f3f9b3dc63fff => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:51:36.383285 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7ceb6-d54d-49d9-b2c8-2bfc22d33ca4 service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:51:36.394923 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7ceb6-d54d-49d9-b2c8-2bfc22d33ca4 service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:51:36.457157 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:51:36.458123 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:51:36.458406 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:51:36.459137 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] PATH_INFO: `/v3/projects/6c09076eac534571bd221e2cc5872fc6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:51:36.459878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c09076eac534571bd221e2cc5872fc6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:51:36.461839 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:51:36.501059 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:51:36.509330 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c09076eac534571bd221e2cc5872fc6', 'request_id': 'req-26d14f95-2b52-4930-8930-5338f3c597a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.517121 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c09076eac534571bd221e2cc5872fc6', 'request_id': 'req-26d14f95-2b52-4930-8930-5338f3c597a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.523439 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c09076eac534571bd221e2cc5872fc6', 'request_id': 'req-26d14f95-2b52-4930-8930-5338f3c597a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.534402 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] The token cache is being invalidate because project 6c09076eac534571bd221e2cc5872fc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:51:36.534692 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.535329 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.536927 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1428/2901] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:51:36 2022] DELETE /identity/v3/projects/6c09076eac534571bd221e2cc5872fc6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:51:36.540933 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557d91f-d127-4516-8752-e2e0721bb88e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:51:36.543167 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2557d91f-d127-4516-8752-e2e0721bb88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:51:36.556848 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557d91f-d127-4516-8752-e2e0721bb88e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:51:36.618034 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fd9b3-eb12-4f34-b5d8-d6959a4eac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:51:36.618797 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd9b3-eb12-4f34-b5d8-d6959a4eac52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:51:36.619081 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd9b3-eb12-4f34-b5d8-d6959a4eac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:51:36.619356 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd9b3-eb12-4f34-b5d8-d6959a4eac52 admin admin] PATH_INFO: `/v3/users/439ef95f27a34b7e94228cc74cf4caf7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:51:36.620724 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fd9b3-eb12-4f34-b5d8-d6959a4eac52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=439ef95f27a34b7e94228cc74cf4caf7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:51:36.622681 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fd9b3-eb12-4f34-b5d8-d6959a4eac52 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:51:36.671750 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b1fd9b3-eb12-4f34-b5d8-d6959a4eac52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439ef95f27a34b7e94228cc74cf4caf7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.679300 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b1fd9b3-eb12-4f34-b5d8-d6959a4eac52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439ef95f27a34b7e94228cc74cf4caf7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.685240 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:51:36.687365 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b1fd9b3-eb12-4f34-b5d8-d6959a4eac52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439ef95f27a34b7e94228cc74cf4caf7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.688346 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b1fd9b3-eb12-4f34-b5d8-d6959a4eac52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439ef95f27a34b7e94228cc74cf4caf7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.702510 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b1fd9b3-eb12-4f34-b5d8-d6959a4eac52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439ef95f27a34b7e94228cc74cf4caf7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:36.708542 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1474/2902] 10.222.0.66 () {58 vars in 1223 bytes} [Fri Jul 15 20:51:36 2022] DELETE /identity/v3/users/439ef95f27a34b7e94228cc74cf4caf7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:51:36.880874 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:51:36.882290 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:51:36.895392 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d14f95-2b52-4930-8930-5338f3c597a7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:51:36.952589 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a76fa60149455a8ad27ef586bc5044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090394e10e7f467d9c567173bebe0143', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:51:36.953443 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:51:36.953726 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:51:36.954000 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3 admin admin] PATH_INFO: `/v3/projects/56ba47e7d58442a1a11a998fb036a111` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:51:36.955167 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ba47e7d58442a1a11a998fb036a111)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:51:36.957113 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:51:37.003863 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ba47e7d58442a1a11a998fb036a111', 'request_id': 'req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:37.010939 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ba47e7d58442a1a11a998fb036a111', 'request_id': 'req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:37.017878 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ba47e7d58442a1a11a998fb036a111', 'request_id': 'req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:37.028226 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3 admin admin] The token cache is being invalidate because project 56ba47e7d58442a1a11a998fb036a111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 20:51:37.028541 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:37.029179 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9fe4c6e0-ec33-4f7d-99a0-e6a9671df9d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 20:51:37.030683 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1429/2903] 10.222.0.66 () {58 vars in 1232 bytes} [Fri Jul 15 20:51:36 2022] DELETE /identity/v3/projects/56ba47e7d58442a1a11a998fb036a111 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 20:51:46.704995 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=8,keystone:DELETE=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:51:47.025062 dv-cinder-799871-35-iscsi devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:55:01.335535 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fd9b3-eb12-4f34-b5d8-d6959a4eac52 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 20:55:01.337031 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8b1fd9b3-eb12-4f34-b5d8-d6959a4eac52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:55:01.485101 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fd9b3-eb12-4f34-b5d8-d6959a4eac52 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 20:55:01.542123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728326-b1b5-478b-8918-d471db4fc432 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6693dd1ea26049c1ac8460faf1bc9b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52dd45fcba114e3f8ff40d8b954ee5cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 20:55:01.542775 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728326-b1b5-478b-8918-d471db4fc432 service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 20:55:01.543061 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728326-b1b5-478b-8918-d471db4fc432 service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 20:55:01.543341 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728326-b1b5-478b-8918-d471db4fc432 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 20:55:01.545116 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1d728326-b1b5-478b-8918-d471db4fc432 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 20:55:01.557024 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728326-b1b5-478b-8918-d471db4fc432 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 20:55:01.558604 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728326-b1b5-478b-8918-d471db4fc432 service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 20:55:01.569123 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1475/2904] 10.222.0.66 () {60 vars in 1365 bytes} [Fri Jul 15 20:55:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 20:55:11.564153 dv-cinder-799871-35-iscsi devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}